00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 869 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3534 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.031 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.031 The recommended git tool is: git 00:00:00.031 using credential 00000000-0000-0000-0000-000000000002 00:00:00.033 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.054 Fetching changes from the remote Git repository 00:00:00.056 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.082 Using shallow fetch with depth 1 00:00:00.083 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.083 > git --version # timeout=10 00:00:00.119 > git --version # 'git version 2.39.2' 00:00:00.119 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.157 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.158 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.911 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.922 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.931 Checking out Revision bc56972291bf21b4d2a602b495a165146a8d67a1 (FETCH_HEAD) 00:00:02.931 > git config core.sparsecheckout # timeout=10 00:00:02.940 > git read-tree -mu HEAD # timeout=10 00:00:02.954 > git checkout -f bc56972291bf21b4d2a602b495a165146a8d67a1 # timeout=5 00:00:02.969 Commit message: "jenkins/jjb-config: Remove extendedChoice from ipxe-test-images" 00:00:02.969 > git rev-list --no-walk bc56972291bf21b4d2a602b495a165146a8d67a1 # timeout=10 00:00:03.081 [Pipeline] Start of Pipeline 00:00:03.094 [Pipeline] library 00:00:03.096 Loading library shm_lib@master 00:00:06.735 Library shm_lib@master is cached. Copying from home. 00:00:06.772 [Pipeline] node 00:00:06.971 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.974 [Pipeline] { 00:00:06.989 [Pipeline] catchError 00:00:06.992 [Pipeline] { 00:00:07.010 [Pipeline] wrap 00:00:07.018 [Pipeline] { 00:00:07.034 [Pipeline] stage 00:00:07.037 [Pipeline] { (Prologue) 00:00:07.223 [Pipeline] sh 00:00:07.532 + logger -p user.info -t JENKINS-CI 00:00:07.547 [Pipeline] echo 00:00:07.548 Node: GP11 00:00:07.554 [Pipeline] sh 00:00:07.854 [Pipeline] setCustomBuildProperty 00:00:07.866 [Pipeline] echo 00:00:07.868 Cleanup processes 00:00:07.873 [Pipeline] sh 00:00:08.161 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.161 989476 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.176 [Pipeline] sh 00:00:08.465 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.465 ++ grep -v 'sudo pgrep' 00:00:08.465 ++ awk '{print $1}' 00:00:08.465 + sudo kill -9 00:00:08.465 + true 00:00:08.479 [Pipeline] cleanWs 00:00:08.489 [WS-CLEANUP] Deleting project workspace... 00:00:08.489 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.496 [WS-CLEANUP] done 00:00:08.500 [Pipeline] setCustomBuildProperty 00:00:08.516 [Pipeline] sh 00:00:08.801 + sudo git config --global --replace-all safe.directory '*' 00:00:08.922 [Pipeline] httpRequest 00:00:09.586 [Pipeline] echo 00:00:09.588 Sorcerer 10.211.164.101 is alive 00:00:09.597 [Pipeline] retry 00:00:09.599 [Pipeline] { 00:00:09.613 [Pipeline] httpRequest 00:00:09.618 HttpMethod: GET 00:00:09.619 URL: http://10.211.164.101/packages/jbp_bc56972291bf21b4d2a602b495a165146a8d67a1.tar.gz 00:00:09.620 Sending request to url: http://10.211.164.101/packages/jbp_bc56972291bf21b4d2a602b495a165146a8d67a1.tar.gz 00:00:09.623 Response Code: HTTP/1.1 200 OK 00:00:09.623 Success: Status code 200 is in the accepted range: 200,404 00:00:09.624 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_bc56972291bf21b4d2a602b495a165146a8d67a1.tar.gz 00:00:10.475 [Pipeline] } 00:00:10.491 [Pipeline] // retry 00:00:10.498 [Pipeline] sh 00:00:10.783 + tar --no-same-owner -xf jbp_bc56972291bf21b4d2a602b495a165146a8d67a1.tar.gz 00:00:10.801 [Pipeline] httpRequest 00:00:11.160 [Pipeline] echo 00:00:11.162 Sorcerer 10.211.164.101 is alive 00:00:11.172 [Pipeline] retry 00:00:11.174 [Pipeline] { 00:00:11.189 [Pipeline] httpRequest 00:00:11.194 HttpMethod: GET 00:00:11.194 URL: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:11.196 Sending request to url: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:11.199 Response Code: HTTP/1.1 200 OK 00:00:11.200 Success: Status code 200 is in the accepted range: 200,404 00:00:11.200 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:32.256 [Pipeline] } 00:00:32.283 [Pipeline] // retry 00:00:32.296 [Pipeline] sh 00:00:32.591 + tar --no-same-owner -xf spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:35.146 [Pipeline] sh 00:00:35.434 + git -C spdk log --oneline -n5 00:00:35.434 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:35.434 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:35.434 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:35.434 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:35.434 9469ea403 nvme/fio_plugin: add trim support 00:00:35.454 [Pipeline] withCredentials 00:00:35.465 > git --version # timeout=10 00:00:35.480 > git --version # 'git version 2.39.2' 00:00:35.499 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:35.502 [Pipeline] { 00:00:35.512 [Pipeline] retry 00:00:35.515 [Pipeline] { 00:00:35.533 [Pipeline] sh 00:00:35.821 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:00:35.834 [Pipeline] } 00:00:35.852 [Pipeline] // retry 00:00:35.857 [Pipeline] } 00:00:35.871 [Pipeline] // withCredentials 00:00:35.879 [Pipeline] httpRequest 00:00:36.270 [Pipeline] echo 00:00:36.271 Sorcerer 10.211.164.101 is alive 00:00:36.280 [Pipeline] retry 00:00:36.282 [Pipeline] { 00:00:36.296 [Pipeline] httpRequest 00:00:36.301 HttpMethod: GET 00:00:36.302 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:36.303 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:36.318 Response Code: HTTP/1.1 200 OK 00:00:36.318 Success: Status code 200 is in the accepted range: 200,404 00:00:36.319 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:02:14.088 [Pipeline] } 00:02:14.105 [Pipeline] // retry 00:02:14.112 [Pipeline] sh 00:02:14.400 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:02:16.328 [Pipeline] sh 00:02:16.617 + git -C dpdk log --oneline -n5 00:02:16.617 caf0f5d395 version: 22.11.4 00:02:16.617 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:02:16.617 dc9c799c7d vhost: fix missing spinlock unlock 00:02:16.617 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:02:16.617 6ef77f2a5e net/gve: fix RX buffer size alignment 00:02:16.627 [Pipeline] } 00:02:16.641 [Pipeline] // stage 00:02:16.649 [Pipeline] stage 00:02:16.651 [Pipeline] { (Prepare) 00:02:16.670 [Pipeline] writeFile 00:02:16.685 [Pipeline] sh 00:02:16.973 + logger -p user.info -t JENKINS-CI 00:02:16.987 [Pipeline] sh 00:02:17.298 + logger -p user.info -t JENKINS-CI 00:02:17.310 [Pipeline] sh 00:02:17.597 + cat autorun-spdk.conf 00:02:17.597 SPDK_RUN_FUNCTIONAL_TEST=1 00:02:17.597 SPDK_TEST_NVMF=1 00:02:17.597 SPDK_TEST_NVME_CLI=1 00:02:17.597 SPDK_TEST_NVMF_TRANSPORT=tcp 00:02:17.597 SPDK_TEST_NVMF_NICS=e810 00:02:17.597 SPDK_TEST_VFIOUSER=1 00:02:17.597 SPDK_RUN_UBSAN=1 00:02:17.597 NET_TYPE=phy 00:02:17.597 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:02:17.597 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:17.606 RUN_NIGHTLY=1 00:02:17.610 [Pipeline] readFile 00:02:17.634 [Pipeline] withEnv 00:02:17.636 [Pipeline] { 00:02:17.648 [Pipeline] sh 00:02:17.970 + set -ex 00:02:17.970 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:02:17.970 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:02:17.970 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:02:17.970 ++ SPDK_TEST_NVMF=1 00:02:17.970 ++ SPDK_TEST_NVME_CLI=1 00:02:17.970 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:02:17.970 ++ SPDK_TEST_NVMF_NICS=e810 00:02:17.970 ++ SPDK_TEST_VFIOUSER=1 00:02:17.970 ++ SPDK_RUN_UBSAN=1 00:02:17.970 ++ NET_TYPE=phy 00:02:17.970 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:02:17.970 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:17.970 ++ RUN_NIGHTLY=1 00:02:17.970 + case $SPDK_TEST_NVMF_NICS in 00:02:17.970 + DRIVERS=ice 00:02:17.970 + [[ tcp == \r\d\m\a ]] 00:02:17.970 + [[ -n ice ]] 00:02:17.970 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:02:17.970 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:02:17.970 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:02:17.970 rmmod: ERROR: Module irdma is not currently loaded 00:02:17.970 rmmod: ERROR: Module i40iw is not currently loaded 00:02:17.970 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:02:17.970 + true 00:02:17.970 + for D in $DRIVERS 00:02:17.970 + sudo modprobe ice 00:02:17.970 + exit 0 00:02:17.980 [Pipeline] } 00:02:17.995 [Pipeline] // withEnv 00:02:18.000 [Pipeline] } 00:02:18.013 [Pipeline] // stage 00:02:18.023 [Pipeline] catchError 00:02:18.025 [Pipeline] { 00:02:18.039 [Pipeline] timeout 00:02:18.040 Timeout set to expire in 1 hr 0 min 00:02:18.041 [Pipeline] { 00:02:18.055 [Pipeline] stage 00:02:18.057 [Pipeline] { (Tests) 00:02:18.071 [Pipeline] sh 00:02:18.361 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:02:18.361 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:02:18.361 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:02:18.361 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:02:18.361 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:18.361 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:02:18.361 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:02:18.361 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:02:18.361 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:02:18.361 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:02:18.361 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:02:18.361 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:02:18.361 + source /etc/os-release 00:02:18.361 ++ NAME='Fedora Linux' 00:02:18.361 ++ VERSION='39 (Cloud Edition)' 00:02:18.361 ++ ID=fedora 00:02:18.361 ++ VERSION_ID=39 00:02:18.361 ++ VERSION_CODENAME= 00:02:18.361 ++ PLATFORM_ID=platform:f39 00:02:18.361 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:02:18.361 ++ ANSI_COLOR='0;38;2;60;110;180' 00:02:18.361 ++ LOGO=fedora-logo-icon 00:02:18.361 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:02:18.361 ++ HOME_URL=https://fedoraproject.org/ 00:02:18.361 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:02:18.361 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:02:18.361 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:02:18.361 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:02:18.361 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:02:18.361 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:02:18.361 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:02:18.361 ++ SUPPORT_END=2024-11-12 00:02:18.361 ++ VARIANT='Cloud Edition' 00:02:18.361 ++ VARIANT_ID=cloud 00:02:18.361 + uname -a 00:02:18.361 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:02:18.361 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:19.302 Hugepages 00:02:19.302 node hugesize free / total 00:02:19.302 node0 1048576kB 0 / 0 00:02:19.302 node0 2048kB 0 / 0 00:02:19.302 node1 1048576kB 0 / 0 00:02:19.302 node1 2048kB 0 / 0 00:02:19.302 00:02:19.303 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:19.303 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:02:19.303 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:02:19.303 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:02:19.562 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:02:19.562 + rm -f /tmp/spdk-ld-path 00:02:19.562 + source autorun-spdk.conf 00:02:19.562 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:02:19.562 ++ SPDK_TEST_NVMF=1 00:02:19.562 ++ SPDK_TEST_NVME_CLI=1 00:02:19.562 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:02:19.562 ++ SPDK_TEST_NVMF_NICS=e810 00:02:19.562 ++ SPDK_TEST_VFIOUSER=1 00:02:19.562 ++ SPDK_RUN_UBSAN=1 00:02:19.562 ++ NET_TYPE=phy 00:02:19.562 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:02:19.562 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:19.562 ++ RUN_NIGHTLY=1 00:02:19.562 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:02:19.562 + [[ -n '' ]] 00:02:19.562 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:19.562 + for M in /var/spdk/build-*-manifest.txt 00:02:19.562 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:02:19.562 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:02:19.562 + for M in /var/spdk/build-*-manifest.txt 00:02:19.562 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:02:19.562 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:02:19.562 + for M in /var/spdk/build-*-manifest.txt 00:02:19.562 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:02:19.562 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:02:19.562 ++ uname 00:02:19.562 + [[ Linux == \L\i\n\u\x ]] 00:02:19.562 + sudo dmesg -T 00:02:19.562 + sudo dmesg --clear 00:02:19.562 + dmesg_pid=990197 00:02:19.562 + [[ Fedora Linux == FreeBSD ]] 00:02:19.562 + sudo dmesg -Tw 00:02:19.562 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:02:19.562 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:02:19.562 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:02:19.562 + [[ -x /usr/src/fio-static/fio ]] 00:02:19.562 + export FIO_BIN=/usr/src/fio-static/fio 00:02:19.562 + FIO_BIN=/usr/src/fio-static/fio 00:02:19.562 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:02:19.562 + [[ ! -v VFIO_QEMU_BIN ]] 00:02:19.562 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:02:19.562 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:02:19.562 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:02:19.562 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:02:19.562 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:02:19.562 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:02:19.562 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:02:19.562 Test configuration: 00:02:19.562 SPDK_RUN_FUNCTIONAL_TEST=1 00:02:19.562 SPDK_TEST_NVMF=1 00:02:19.562 SPDK_TEST_NVME_CLI=1 00:02:19.562 SPDK_TEST_NVMF_TRANSPORT=tcp 00:02:19.562 SPDK_TEST_NVMF_NICS=e810 00:02:19.562 SPDK_TEST_VFIOUSER=1 00:02:19.562 SPDK_RUN_UBSAN=1 00:02:19.562 NET_TYPE=phy 00:02:19.562 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:02:19.562 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:19.562 RUN_NIGHTLY=1 16:26:44 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:19.562 16:26:44 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:02:19.562 16:26:44 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:19.562 16:26:44 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:19.563 16:26:44 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:19.563 16:26:44 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:19.563 16:26:44 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:19.563 16:26:44 -- paths/export.sh@5 -- $ export PATH 00:02:19.563 16:26:44 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:19.563 16:26:44 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:19.563 16:26:44 -- common/autobuild_common.sh@440 -- $ date +%s 00:02:19.563 16:26:44 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1728829604.XXXXXX 00:02:19.563 16:26:44 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1728829604.hu5IBU 00:02:19.563 16:26:44 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:02:19.563 16:26:44 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:02:19.563 16:26:44 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:19.563 16:26:44 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:02:19.563 16:26:44 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:02:19.563 16:26:44 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:02:19.563 16:26:44 -- common/autobuild_common.sh@456 -- $ get_config_params 00:02:19.563 16:26:44 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:02:19.563 16:26:44 -- common/autotest_common.sh@10 -- $ set +x 00:02:19.563 16:26:44 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:02:19.563 16:26:44 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:02:19.563 16:26:44 -- spdk/autobuild.sh@12 -- $ umask 022 00:02:19.563 16:26:44 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:19.563 16:26:44 -- spdk/autobuild.sh@16 -- $ date -u 00:02:19.563 Sun Oct 13 02:26:44 PM UTC 2024 00:02:19.563 16:26:44 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:02:19.563 LTS-66-g726a04d70 00:02:19.563 16:26:44 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:02:19.563 16:26:44 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:02:19.563 16:26:44 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:02:19.563 16:26:44 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:02:19.563 16:26:44 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:02:19.563 16:26:44 -- common/autotest_common.sh@10 -- $ set +x 00:02:19.563 ************************************ 00:02:19.563 START TEST ubsan 00:02:19.563 ************************************ 00:02:19.563 16:26:44 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:02:19.563 using ubsan 00:02:19.563 00:02:19.563 real 0m0.000s 00:02:19.563 user 0m0.000s 00:02:19.563 sys 0m0.000s 00:02:19.563 16:26:44 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:19.563 16:26:44 -- common/autotest_common.sh@10 -- $ set +x 00:02:19.563 ************************************ 00:02:19.563 END TEST ubsan 00:02:19.563 ************************************ 00:02:19.563 16:26:44 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:02:19.563 16:26:44 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:02:19.563 16:26:44 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:02:19.563 16:26:44 -- common/autotest_common.sh@1077 -- $ '[' 2 -le 1 ']' 00:02:19.563 16:26:44 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:02:19.563 16:26:45 -- common/autotest_common.sh@10 -- $ set +x 00:02:19.563 ************************************ 00:02:19.563 START TEST build_native_dpdk 00:02:19.563 ************************************ 00:02:19.563 16:26:45 -- common/autotest_common.sh@1104 -- $ _build_native_dpdk 00:02:19.563 16:26:45 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:02:19.563 16:26:45 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:02:19.563 16:26:45 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:02:19.563 16:26:45 -- common/autobuild_common.sh@51 -- $ local compiler 00:02:19.563 16:26:45 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:02:19.563 16:26:45 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:02:19.563 16:26:45 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:02:19.563 16:26:45 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:02:19.563 16:26:45 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:02:19.563 16:26:45 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:02:19.563 16:26:45 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:02:19.563 16:26:45 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:02:19.563 16:26:45 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:19.563 16:26:45 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:19.563 16:26:45 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:02:19.563 16:26:45 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:19.563 16:26:45 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:02:19.563 caf0f5d395 version: 22.11.4 00:02:19.563 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:02:19.563 dc9c799c7d vhost: fix missing spinlock unlock 00:02:19.563 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:02:19.563 6ef77f2a5e net/gve: fix RX buffer size alignment 00:02:19.563 16:26:45 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:02:19.563 16:26:45 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:02:19.563 16:26:45 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:02:19.563 16:26:45 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:02:19.563 16:26:45 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:02:19.563 16:26:45 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:02:19.563 16:26:45 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:02:19.563 16:26:45 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:02:19.563 16:26:45 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:02:19.563 16:26:45 -- common/autobuild_common.sh@168 -- $ uname -s 00:02:19.563 16:26:45 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:02:19.563 16:26:45 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:02:19.563 16:26:45 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:02:19.563 16:26:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:02:19.563 16:26:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:02:19.563 16:26:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:02:19.563 16:26:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:02:19.563 16:26:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:02:19.563 16:26:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:02:19.563 16:26:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:02:19.563 16:26:45 -- scripts/common.sh@339 -- $ ver1_l=3 00:02:19.563 16:26:45 -- scripts/common.sh@340 -- $ ver2_l=3 00:02:19.563 16:26:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:02:19.563 16:26:45 -- scripts/common.sh@343 -- $ case "$op" in 00:02:19.563 16:26:45 -- scripts/common.sh@344 -- $ : 1 00:02:19.563 16:26:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:02:19.563 16:26:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:19.563 16:26:45 -- scripts/common.sh@364 -- $ decimal 22 00:02:19.563 16:26:45 -- scripts/common.sh@352 -- $ local d=22 00:02:19.563 16:26:45 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:02:19.563 16:26:45 -- scripts/common.sh@354 -- $ echo 22 00:02:19.563 16:26:45 -- scripts/common.sh@364 -- $ ver1[v]=22 00:02:19.563 16:26:45 -- scripts/common.sh@365 -- $ decimal 21 00:02:19.563 16:26:45 -- scripts/common.sh@352 -- $ local d=21 00:02:19.563 16:26:45 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:02:19.563 16:26:45 -- scripts/common.sh@354 -- $ echo 21 00:02:19.563 16:26:45 -- scripts/common.sh@365 -- $ ver2[v]=21 00:02:19.563 16:26:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:02:19.563 16:26:45 -- scripts/common.sh@366 -- $ return 1 00:02:19.563 16:26:45 -- common/autobuild_common.sh@173 -- $ patch -p1 00:02:19.563 patching file config/rte_config.h 00:02:19.563 Hunk #1 succeeded at 60 (offset 1 line). 00:02:19.563 16:26:45 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:02:19.563 16:26:45 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:02:19.563 16:26:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:02:19.563 16:26:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:02:19.563 16:26:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:02:19.563 16:26:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:02:19.563 16:26:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:02:19.563 16:26:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:02:19.563 16:26:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:02:19.563 16:26:45 -- scripts/common.sh@339 -- $ ver1_l=3 00:02:19.563 16:26:45 -- scripts/common.sh@340 -- $ ver2_l=3 00:02:19.563 16:26:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:02:19.563 16:26:45 -- scripts/common.sh@343 -- $ case "$op" in 00:02:19.563 16:26:45 -- scripts/common.sh@344 -- $ : 1 00:02:19.563 16:26:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:02:19.563 16:26:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:19.563 16:26:45 -- scripts/common.sh@364 -- $ decimal 22 00:02:19.563 16:26:45 -- scripts/common.sh@352 -- $ local d=22 00:02:19.564 16:26:45 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:02:19.564 16:26:45 -- scripts/common.sh@354 -- $ echo 22 00:02:19.564 16:26:45 -- scripts/common.sh@364 -- $ ver1[v]=22 00:02:19.564 16:26:45 -- scripts/common.sh@365 -- $ decimal 24 00:02:19.564 16:26:45 -- scripts/common.sh@352 -- $ local d=24 00:02:19.564 16:26:45 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:02:19.564 16:26:45 -- scripts/common.sh@354 -- $ echo 24 00:02:19.564 16:26:45 -- scripts/common.sh@365 -- $ ver2[v]=24 00:02:19.564 16:26:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:02:19.564 16:26:45 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:02:19.564 16:26:45 -- scripts/common.sh@367 -- $ return 0 00:02:19.564 16:26:45 -- common/autobuild_common.sh@177 -- $ patch -p1 00:02:19.564 patching file lib/pcapng/rte_pcapng.c 00:02:19.564 Hunk #1 succeeded at 110 (offset -18 lines). 00:02:19.564 16:26:45 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:02:19.564 16:26:45 -- common/autobuild_common.sh@181 -- $ uname -s 00:02:19.564 16:26:45 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:02:19.564 16:26:45 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:02:19.564 16:26:45 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:02:24.828 The Meson build system 00:02:24.828 Version: 1.5.0 00:02:24.828 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:02:24.828 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:02:24.828 Build type: native build 00:02:24.828 Program cat found: YES (/usr/bin/cat) 00:02:24.828 Project name: DPDK 00:02:24.828 Project version: 22.11.4 00:02:24.828 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:24.828 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:24.828 Host machine cpu family: x86_64 00:02:24.828 Host machine cpu: x86_64 00:02:24.828 Message: ## Building in Developer Mode ## 00:02:24.828 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:24.828 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:02:24.828 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:02:24.828 Program objdump found: YES (/usr/bin/objdump) 00:02:24.828 Program python3 found: YES (/usr/bin/python3) 00:02:24.828 Program cat found: YES (/usr/bin/cat) 00:02:24.828 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:02:24.828 Checking for size of "void *" : 8 00:02:24.828 Checking for size of "void *" : 8 (cached) 00:02:24.828 Library m found: YES 00:02:24.828 Library numa found: YES 00:02:24.828 Has header "numaif.h" : YES 00:02:24.828 Library fdt found: NO 00:02:24.828 Library execinfo found: NO 00:02:24.828 Has header "execinfo.h" : YES 00:02:24.828 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:24.828 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:24.828 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:24.828 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:24.828 Run-time dependency openssl found: YES 3.1.1 00:02:24.828 Run-time dependency libpcap found: YES 1.10.4 00:02:24.828 Has header "pcap.h" with dependency libpcap: YES 00:02:24.828 Compiler for C supports arguments -Wcast-qual: YES 00:02:24.828 Compiler for C supports arguments -Wdeprecated: YES 00:02:24.828 Compiler for C supports arguments -Wformat: YES 00:02:24.828 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:24.828 Compiler for C supports arguments -Wformat-security: NO 00:02:24.828 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:24.828 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:24.828 Compiler for C supports arguments -Wnested-externs: YES 00:02:24.828 Compiler for C supports arguments -Wold-style-definition: YES 00:02:24.828 Compiler for C supports arguments -Wpointer-arith: YES 00:02:24.828 Compiler for C supports arguments -Wsign-compare: YES 00:02:24.828 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:24.828 Compiler for C supports arguments -Wundef: YES 00:02:24.829 Compiler for C supports arguments -Wwrite-strings: YES 00:02:24.829 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:24.829 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:24.829 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:24.829 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:24.829 Compiler for C supports arguments -mavx512f: YES 00:02:24.829 Checking if "AVX512 checking" compiles: YES 00:02:24.829 Fetching value of define "__SSE4_2__" : 1 00:02:24.829 Fetching value of define "__AES__" : 1 00:02:24.829 Fetching value of define "__AVX__" : 1 00:02:24.829 Fetching value of define "__AVX2__" : (undefined) 00:02:24.829 Fetching value of define "__AVX512BW__" : (undefined) 00:02:24.829 Fetching value of define "__AVX512CD__" : (undefined) 00:02:24.829 Fetching value of define "__AVX512DQ__" : (undefined) 00:02:24.829 Fetching value of define "__AVX512F__" : (undefined) 00:02:24.829 Fetching value of define "__AVX512VL__" : (undefined) 00:02:24.829 Fetching value of define "__PCLMUL__" : 1 00:02:24.829 Fetching value of define "__RDRND__" : 1 00:02:24.829 Fetching value of define "__RDSEED__" : (undefined) 00:02:24.829 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:24.829 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:24.829 Message: lib/kvargs: Defining dependency "kvargs" 00:02:24.829 Message: lib/telemetry: Defining dependency "telemetry" 00:02:24.829 Checking for function "getentropy" : YES 00:02:24.829 Message: lib/eal: Defining dependency "eal" 00:02:24.829 Message: lib/ring: Defining dependency "ring" 00:02:24.829 Message: lib/rcu: Defining dependency "rcu" 00:02:24.829 Message: lib/mempool: Defining dependency "mempool" 00:02:24.829 Message: lib/mbuf: Defining dependency "mbuf" 00:02:24.829 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:24.829 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:24.829 Compiler for C supports arguments -mpclmul: YES 00:02:24.829 Compiler for C supports arguments -maes: YES 00:02:24.829 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:24.829 Compiler for C supports arguments -mavx512bw: YES 00:02:24.829 Compiler for C supports arguments -mavx512dq: YES 00:02:24.829 Compiler for C supports arguments -mavx512vl: YES 00:02:24.829 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:24.829 Compiler for C supports arguments -mavx2: YES 00:02:24.829 Compiler for C supports arguments -mavx: YES 00:02:24.829 Message: lib/net: Defining dependency "net" 00:02:24.829 Message: lib/meter: Defining dependency "meter" 00:02:24.829 Message: lib/ethdev: Defining dependency "ethdev" 00:02:24.829 Message: lib/pci: Defining dependency "pci" 00:02:24.829 Message: lib/cmdline: Defining dependency "cmdline" 00:02:24.829 Message: lib/metrics: Defining dependency "metrics" 00:02:24.829 Message: lib/hash: Defining dependency "hash" 00:02:24.829 Message: lib/timer: Defining dependency "timer" 00:02:24.829 Fetching value of define "__AVX2__" : (undefined) (cached) 00:02:24.829 Compiler for C supports arguments -mavx2: YES (cached) 00:02:24.829 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:02:24.829 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:02:24.829 Message: lib/acl: Defining dependency "acl" 00:02:24.829 Message: lib/bbdev: Defining dependency "bbdev" 00:02:24.829 Message: lib/bitratestats: Defining dependency "bitratestats" 00:02:24.829 Run-time dependency libelf found: YES 0.191 00:02:24.829 Message: lib/bpf: Defining dependency "bpf" 00:02:24.829 Message: lib/cfgfile: Defining dependency "cfgfile" 00:02:24.829 Message: lib/compressdev: Defining dependency "compressdev" 00:02:24.829 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:24.829 Message: lib/distributor: Defining dependency "distributor" 00:02:24.829 Message: lib/efd: Defining dependency "efd" 00:02:24.829 Message: lib/eventdev: Defining dependency "eventdev" 00:02:24.829 Message: lib/gpudev: Defining dependency "gpudev" 00:02:24.829 Message: lib/gro: Defining dependency "gro" 00:02:24.829 Message: lib/gso: Defining dependency "gso" 00:02:24.829 Message: lib/ip_frag: Defining dependency "ip_frag" 00:02:24.829 Message: lib/jobstats: Defining dependency "jobstats" 00:02:24.829 Message: lib/latencystats: Defining dependency "latencystats" 00:02:24.829 Message: lib/lpm: Defining dependency "lpm" 00:02:24.829 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512IFMA__" : (undefined) 00:02:24.829 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:02:24.829 Message: lib/member: Defining dependency "member" 00:02:24.829 Message: lib/pcapng: Defining dependency "pcapng" 00:02:24.829 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:24.829 Message: lib/power: Defining dependency "power" 00:02:24.829 Message: lib/rawdev: Defining dependency "rawdev" 00:02:24.829 Message: lib/regexdev: Defining dependency "regexdev" 00:02:24.829 Message: lib/dmadev: Defining dependency "dmadev" 00:02:24.829 Message: lib/rib: Defining dependency "rib" 00:02:24.829 Message: lib/reorder: Defining dependency "reorder" 00:02:24.829 Message: lib/sched: Defining dependency "sched" 00:02:24.829 Message: lib/security: Defining dependency "security" 00:02:24.829 Message: lib/stack: Defining dependency "stack" 00:02:24.829 Has header "linux/userfaultfd.h" : YES 00:02:24.829 Message: lib/vhost: Defining dependency "vhost" 00:02:24.829 Message: lib/ipsec: Defining dependency "ipsec" 00:02:24.829 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:24.829 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:02:24.829 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:02:24.829 Compiler for C supports arguments -mavx512bw: YES (cached) 00:02:24.829 Message: lib/fib: Defining dependency "fib" 00:02:24.829 Message: lib/port: Defining dependency "port" 00:02:24.829 Message: lib/pdump: Defining dependency "pdump" 00:02:24.829 Message: lib/table: Defining dependency "table" 00:02:24.829 Message: lib/pipeline: Defining dependency "pipeline" 00:02:24.829 Message: lib/graph: Defining dependency "graph" 00:02:24.829 Message: lib/node: Defining dependency "node" 00:02:24.829 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:24.829 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:24.829 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:24.829 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:24.829 Compiler for C supports arguments -Wno-sign-compare: YES 00:02:24.829 Compiler for C supports arguments -Wno-unused-value: YES 00:02:25.771 Compiler for C supports arguments -Wno-format: YES 00:02:25.771 Compiler for C supports arguments -Wno-format-security: YES 00:02:25.771 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:02:25.771 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:02:25.771 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:02:25.771 Compiler for C supports arguments -Wno-unused-parameter: YES 00:02:25.771 Fetching value of define "__AVX2__" : (undefined) (cached) 00:02:25.771 Compiler for C supports arguments -mavx2: YES (cached) 00:02:25.771 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:25.771 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:25.771 Compiler for C supports arguments -mavx512bw: YES (cached) 00:02:25.771 Compiler for C supports arguments -march=skylake-avx512: YES 00:02:25.771 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:02:25.771 Program doxygen found: YES (/usr/local/bin/doxygen) 00:02:25.771 Configuring doxy-api.conf using configuration 00:02:25.771 Program sphinx-build found: NO 00:02:25.771 Configuring rte_build_config.h using configuration 00:02:25.771 Message: 00:02:25.771 ================= 00:02:25.771 Applications Enabled 00:02:25.771 ================= 00:02:25.771 00:02:25.771 apps: 00:02:25.771 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:02:25.771 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:02:25.771 test-security-perf, 00:02:25.771 00:02:25.771 Message: 00:02:25.771 ================= 00:02:25.771 Libraries Enabled 00:02:25.771 ================= 00:02:25.771 00:02:25.771 libs: 00:02:25.771 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:02:25.771 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:02:25.771 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:02:25.771 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:02:25.771 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:02:25.771 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:02:25.771 table, pipeline, graph, node, 00:02:25.771 00:02:25.771 Message: 00:02:25.771 =============== 00:02:25.771 Drivers Enabled 00:02:25.771 =============== 00:02:25.771 00:02:25.771 common: 00:02:25.771 00:02:25.771 bus: 00:02:25.771 pci, vdev, 00:02:25.771 mempool: 00:02:25.771 ring, 00:02:25.771 dma: 00:02:25.771 00:02:25.771 net: 00:02:25.771 i40e, 00:02:25.771 raw: 00:02:25.771 00:02:25.771 crypto: 00:02:25.771 00:02:25.771 compress: 00:02:25.771 00:02:25.771 regex: 00:02:25.771 00:02:25.771 vdpa: 00:02:25.771 00:02:25.771 event: 00:02:25.771 00:02:25.771 baseband: 00:02:25.771 00:02:25.771 gpu: 00:02:25.771 00:02:25.771 00:02:25.771 Message: 00:02:25.771 ================= 00:02:25.771 Content Skipped 00:02:25.771 ================= 00:02:25.771 00:02:25.771 apps: 00:02:25.771 00:02:25.771 libs: 00:02:25.771 kni: explicitly disabled via build config (deprecated lib) 00:02:25.771 flow_classify: explicitly disabled via build config (deprecated lib) 00:02:25.771 00:02:25.771 drivers: 00:02:25.771 common/cpt: not in enabled drivers build config 00:02:25.771 common/dpaax: not in enabled drivers build config 00:02:25.771 common/iavf: not in enabled drivers build config 00:02:25.771 common/idpf: not in enabled drivers build config 00:02:25.771 common/mvep: not in enabled drivers build config 00:02:25.771 common/octeontx: not in enabled drivers build config 00:02:25.771 bus/auxiliary: not in enabled drivers build config 00:02:25.771 bus/dpaa: not in enabled drivers build config 00:02:25.771 bus/fslmc: not in enabled drivers build config 00:02:25.771 bus/ifpga: not in enabled drivers build config 00:02:25.771 bus/vmbus: not in enabled drivers build config 00:02:25.771 common/cnxk: not in enabled drivers build config 00:02:25.771 common/mlx5: not in enabled drivers build config 00:02:25.771 common/qat: not in enabled drivers build config 00:02:25.771 common/sfc_efx: not in enabled drivers build config 00:02:25.771 mempool/bucket: not in enabled drivers build config 00:02:25.771 mempool/cnxk: not in enabled drivers build config 00:02:25.771 mempool/dpaa: not in enabled drivers build config 00:02:25.771 mempool/dpaa2: not in enabled drivers build config 00:02:25.771 mempool/octeontx: not in enabled drivers build config 00:02:25.771 mempool/stack: not in enabled drivers build config 00:02:25.771 dma/cnxk: not in enabled drivers build config 00:02:25.771 dma/dpaa: not in enabled drivers build config 00:02:25.771 dma/dpaa2: not in enabled drivers build config 00:02:25.771 dma/hisilicon: not in enabled drivers build config 00:02:25.771 dma/idxd: not in enabled drivers build config 00:02:25.771 dma/ioat: not in enabled drivers build config 00:02:25.771 dma/skeleton: not in enabled drivers build config 00:02:25.771 net/af_packet: not in enabled drivers build config 00:02:25.771 net/af_xdp: not in enabled drivers build config 00:02:25.771 net/ark: not in enabled drivers build config 00:02:25.771 net/atlantic: not in enabled drivers build config 00:02:25.771 net/avp: not in enabled drivers build config 00:02:25.771 net/axgbe: not in enabled drivers build config 00:02:25.771 net/bnx2x: not in enabled drivers build config 00:02:25.771 net/bnxt: not in enabled drivers build config 00:02:25.771 net/bonding: not in enabled drivers build config 00:02:25.771 net/cnxk: not in enabled drivers build config 00:02:25.771 net/cxgbe: not in enabled drivers build config 00:02:25.771 net/dpaa: not in enabled drivers build config 00:02:25.771 net/dpaa2: not in enabled drivers build config 00:02:25.771 net/e1000: not in enabled drivers build config 00:02:25.771 net/ena: not in enabled drivers build config 00:02:25.771 net/enetc: not in enabled drivers build config 00:02:25.771 net/enetfec: not in enabled drivers build config 00:02:25.771 net/enic: not in enabled drivers build config 00:02:25.771 net/failsafe: not in enabled drivers build config 00:02:25.771 net/fm10k: not in enabled drivers build config 00:02:25.771 net/gve: not in enabled drivers build config 00:02:25.771 net/hinic: not in enabled drivers build config 00:02:25.771 net/hns3: not in enabled drivers build config 00:02:25.771 net/iavf: not in enabled drivers build config 00:02:25.771 net/ice: not in enabled drivers build config 00:02:25.771 net/idpf: not in enabled drivers build config 00:02:25.771 net/igc: not in enabled drivers build config 00:02:25.771 net/ionic: not in enabled drivers build config 00:02:25.771 net/ipn3ke: not in enabled drivers build config 00:02:25.771 net/ixgbe: not in enabled drivers build config 00:02:25.771 net/kni: not in enabled drivers build config 00:02:25.771 net/liquidio: not in enabled drivers build config 00:02:25.771 net/mana: not in enabled drivers build config 00:02:25.771 net/memif: not in enabled drivers build config 00:02:25.771 net/mlx4: not in enabled drivers build config 00:02:25.771 net/mlx5: not in enabled drivers build config 00:02:25.771 net/mvneta: not in enabled drivers build config 00:02:25.771 net/mvpp2: not in enabled drivers build config 00:02:25.771 net/netvsc: not in enabled drivers build config 00:02:25.771 net/nfb: not in enabled drivers build config 00:02:25.771 net/nfp: not in enabled drivers build config 00:02:25.771 net/ngbe: not in enabled drivers build config 00:02:25.771 net/null: not in enabled drivers build config 00:02:25.771 net/octeontx: not in enabled drivers build config 00:02:25.771 net/octeon_ep: not in enabled drivers build config 00:02:25.771 net/pcap: not in enabled drivers build config 00:02:25.771 net/pfe: not in enabled drivers build config 00:02:25.771 net/qede: not in enabled drivers build config 00:02:25.771 net/ring: not in enabled drivers build config 00:02:25.771 net/sfc: not in enabled drivers build config 00:02:25.771 net/softnic: not in enabled drivers build config 00:02:25.771 net/tap: not in enabled drivers build config 00:02:25.771 net/thunderx: not in enabled drivers build config 00:02:25.771 net/txgbe: not in enabled drivers build config 00:02:25.772 net/vdev_netvsc: not in enabled drivers build config 00:02:25.772 net/vhost: not in enabled drivers build config 00:02:25.772 net/virtio: not in enabled drivers build config 00:02:25.772 net/vmxnet3: not in enabled drivers build config 00:02:25.772 raw/cnxk_bphy: not in enabled drivers build config 00:02:25.772 raw/cnxk_gpio: not in enabled drivers build config 00:02:25.772 raw/dpaa2_cmdif: not in enabled drivers build config 00:02:25.772 raw/ifpga: not in enabled drivers build config 00:02:25.772 raw/ntb: not in enabled drivers build config 00:02:25.772 raw/skeleton: not in enabled drivers build config 00:02:25.772 crypto/armv8: not in enabled drivers build config 00:02:25.772 crypto/bcmfs: not in enabled drivers build config 00:02:25.772 crypto/caam_jr: not in enabled drivers build config 00:02:25.772 crypto/ccp: not in enabled drivers build config 00:02:25.772 crypto/cnxk: not in enabled drivers build config 00:02:25.772 crypto/dpaa_sec: not in enabled drivers build config 00:02:25.772 crypto/dpaa2_sec: not in enabled drivers build config 00:02:25.772 crypto/ipsec_mb: not in enabled drivers build config 00:02:25.772 crypto/mlx5: not in enabled drivers build config 00:02:25.772 crypto/mvsam: not in enabled drivers build config 00:02:25.772 crypto/nitrox: not in enabled drivers build config 00:02:25.772 crypto/null: not in enabled drivers build config 00:02:25.772 crypto/octeontx: not in enabled drivers build config 00:02:25.772 crypto/openssl: not in enabled drivers build config 00:02:25.772 crypto/scheduler: not in enabled drivers build config 00:02:25.772 crypto/uadk: not in enabled drivers build config 00:02:25.772 crypto/virtio: not in enabled drivers build config 00:02:25.772 compress/isal: not in enabled drivers build config 00:02:25.772 compress/mlx5: not in enabled drivers build config 00:02:25.772 compress/octeontx: not in enabled drivers build config 00:02:25.772 compress/zlib: not in enabled drivers build config 00:02:25.772 regex/mlx5: not in enabled drivers build config 00:02:25.772 regex/cn9k: not in enabled drivers build config 00:02:25.772 vdpa/ifc: not in enabled drivers build config 00:02:25.772 vdpa/mlx5: not in enabled drivers build config 00:02:25.772 vdpa/sfc: not in enabled drivers build config 00:02:25.772 event/cnxk: not in enabled drivers build config 00:02:25.772 event/dlb2: not in enabled drivers build config 00:02:25.772 event/dpaa: not in enabled drivers build config 00:02:25.772 event/dpaa2: not in enabled drivers build config 00:02:25.772 event/dsw: not in enabled drivers build config 00:02:25.772 event/opdl: not in enabled drivers build config 00:02:25.772 event/skeleton: not in enabled drivers build config 00:02:25.772 event/sw: not in enabled drivers build config 00:02:25.772 event/octeontx: not in enabled drivers build config 00:02:25.772 baseband/acc: not in enabled drivers build config 00:02:25.772 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:02:25.772 baseband/fpga_lte_fec: not in enabled drivers build config 00:02:25.772 baseband/la12xx: not in enabled drivers build config 00:02:25.772 baseband/null: not in enabled drivers build config 00:02:25.772 baseband/turbo_sw: not in enabled drivers build config 00:02:25.772 gpu/cuda: not in enabled drivers build config 00:02:25.772 00:02:25.772 00:02:25.772 Build targets in project: 316 00:02:25.772 00:02:25.772 DPDK 22.11.4 00:02:25.772 00:02:25.772 User defined options 00:02:25.772 libdir : lib 00:02:25.772 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:02:25.772 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:02:25.772 c_link_args : 00:02:25.772 enable_docs : false 00:02:25.772 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:02:25.772 enable_kmods : false 00:02:25.772 machine : native 00:02:25.772 tests : false 00:02:25.772 00:02:25.772 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:25.772 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:02:25.772 16:26:51 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:02:25.772 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:26.035 [1/745] Generating lib/rte_kvargs_def with a custom command 00:02:26.035 [2/745] Generating lib/rte_kvargs_mingw with a custom command 00:02:26.035 [3/745] Generating lib/rte_telemetry_def with a custom command 00:02:26.035 [4/745] Generating lib/rte_telemetry_mingw with a custom command 00:02:26.035 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:26.035 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:26.035 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:26.035 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:26.035 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:26.035 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:26.035 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:26.035 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:26.035 [13/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:26.035 [14/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:26.035 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:26.035 [16/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:26.035 [17/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:26.035 [18/745] Linking static target lib/librte_kvargs.a 00:02:26.035 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:26.035 [20/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:26.035 [21/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:26.035 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:26.035 [23/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:26.035 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:26.035 [25/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:26.035 [26/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:26.035 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:26.035 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:26.035 [29/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:26.035 [30/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:26.035 [31/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:26.297 [32/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:26.297 [33/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:02:26.297 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:26.297 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:26.297 [36/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:26.297 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:26.297 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:26.297 [39/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:26.297 [40/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:26.297 [41/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:26.297 [42/745] Generating lib/rte_eal_def with a custom command 00:02:26.297 [43/745] Generating lib/rte_eal_mingw with a custom command 00:02:26.297 [44/745] Generating lib/rte_ring_def with a custom command 00:02:26.297 [45/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:26.297 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:26.297 [47/745] Generating lib/rte_ring_mingw with a custom command 00:02:26.297 [48/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:26.297 [49/745] Generating lib/rte_rcu_def with a custom command 00:02:26.297 [50/745] Generating lib/rte_rcu_mingw with a custom command 00:02:26.297 [51/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:26.297 [52/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:26.297 [53/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:26.298 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:26.298 [55/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:26.298 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:26.298 [57/745] Generating lib/rte_mempool_def with a custom command 00:02:26.298 [58/745] Generating lib/rte_mempool_mingw with a custom command 00:02:26.298 [59/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:26.298 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:02:26.298 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:26.298 [62/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:26.298 [63/745] Generating lib/rte_mbuf_mingw with a custom command 00:02:26.298 [64/745] Generating lib/rte_mbuf_def with a custom command 00:02:26.298 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:26.298 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:26.298 [67/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:26.298 [68/745] Generating lib/rte_net_def with a custom command 00:02:26.298 [69/745] Generating lib/rte_net_mingw with a custom command 00:02:26.298 [70/745] Generating lib/rte_meter_def with a custom command 00:02:26.298 [71/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:26.298 [72/745] Generating lib/rte_meter_mingw with a custom command 00:02:26.298 [73/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:26.298 [74/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:26.298 [75/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:26.298 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:26.298 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:26.560 [78/745] Generating lib/rte_ethdev_def with a custom command 00:02:26.560 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.560 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:26.560 [81/745] Linking static target lib/librte_ring.a 00:02:26.560 [82/745] Generating lib/rte_ethdev_mingw with a custom command 00:02:26.560 [83/745] Linking target lib/librte_kvargs.so.23.0 00:02:26.560 [84/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:26.560 [85/745] Generating lib/rte_pci_def with a custom command 00:02:26.560 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:26.560 [87/745] Linking static target lib/librte_meter.a 00:02:26.560 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:26.560 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:26.560 [90/745] Generating lib/rte_pci_mingw with a custom command 00:02:26.560 [91/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:26.560 [92/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:26.560 [93/745] Linking static target lib/librte_pci.a 00:02:26.826 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:02:26.826 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:26.826 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:26.826 [97/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:26.826 [98/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:26.826 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.826 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:26.826 [101/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.087 [102/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:27.087 [103/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:27.087 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:27.087 [105/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:27.087 [106/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.087 [107/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:27.087 [108/745] Generating lib/rte_cmdline_def with a custom command 00:02:27.087 [109/745] Generating lib/rte_cmdline_mingw with a custom command 00:02:27.087 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:27.087 [111/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:27.087 [112/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:27.087 [113/745] Generating lib/rte_metrics_def with a custom command 00:02:27.087 [114/745] Linking static target lib/librte_telemetry.a 00:02:27.087 [115/745] Generating lib/rte_metrics_mingw with a custom command 00:02:27.087 [116/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:27.087 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:27.087 [118/745] Generating lib/rte_hash_def with a custom command 00:02:27.087 [119/745] Generating lib/rte_hash_mingw with a custom command 00:02:27.087 [120/745] Generating lib/rte_timer_def with a custom command 00:02:27.087 [121/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:27.087 [122/745] Generating lib/rte_timer_mingw with a custom command 00:02:27.349 [123/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:27.349 [124/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:02:27.349 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:27.349 [126/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:27.349 [127/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:27.349 [128/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:27.349 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:27.349 [130/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:27.349 [131/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:27.609 [132/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:27.609 [133/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:27.609 [134/745] Generating lib/rte_acl_def with a custom command 00:02:27.609 [135/745] Generating lib/rte_acl_mingw with a custom command 00:02:27.609 [136/745] Generating lib/rte_bbdev_def with a custom command 00:02:27.609 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:02:27.609 [138/745] Generating lib/rte_bitratestats_def with a custom command 00:02:27.609 [139/745] Generating lib/rte_bitratestats_mingw with a custom command 00:02:27.609 [140/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:27.609 [141/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:27.609 [142/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.609 [143/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:27.609 [144/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:27.609 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:27.609 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:27.609 [147/745] Linking target lib/librte_telemetry.so.23.0 00:02:27.609 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:27.609 [149/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:27.609 [150/745] Generating lib/rte_bpf_def with a custom command 00:02:27.875 [151/745] Generating lib/rte_bpf_mingw with a custom command 00:02:27.875 [152/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:27.875 [153/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:27.875 [154/745] Generating lib/rte_cfgfile_def with a custom command 00:02:27.875 [155/745] Generating lib/rte_cfgfile_mingw with a custom command 00:02:27.875 [156/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:27.875 [157/745] Generating lib/rte_compressdev_def with a custom command 00:02:27.875 [158/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:27.875 [159/745] Generating lib/rte_compressdev_mingw with a custom command 00:02:27.875 [160/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:27.875 [161/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:27.875 [162/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:02:27.875 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:02:27.875 [164/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:27.875 [165/745] Generating lib/rte_cryptodev_mingw with a custom command 00:02:27.875 [166/745] Linking static target lib/librte_rcu.a 00:02:27.875 [167/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:27.875 [168/745] Linking static target lib/librte_timer.a 00:02:27.875 [169/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:27.875 [170/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:27.875 [171/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:27.875 [172/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:28.137 [173/745] Linking static target lib/librte_cmdline.a 00:02:28.137 [174/745] Generating lib/rte_distributor_def with a custom command 00:02:28.137 [175/745] Generating lib/rte_distributor_mingw with a custom command 00:02:28.137 [176/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:28.137 [177/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:28.137 [178/745] Linking static target lib/librte_net.a 00:02:28.137 [179/745] Generating lib/rte_efd_def with a custom command 00:02:28.137 [180/745] Generating lib/rte_efd_mingw with a custom command 00:02:28.137 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:28.137 [182/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:02:28.137 [183/745] Linking static target lib/librte_cfgfile.a 00:02:28.400 [184/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:28.400 [185/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:02:28.400 [186/745] Linking static target lib/librte_mempool.a 00:02:28.400 [187/745] Linking static target lib/librte_metrics.a 00:02:28.400 [188/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:02:28.400 [189/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.400 [190/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.400 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.661 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:28.661 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:28.661 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:02:28.661 [195/745] Linking static target lib/librte_eal.a 00:02:28.661 [196/745] Generating lib/rte_eventdev_def with a custom command 00:02:28.661 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:02:28.661 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:02:28.661 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:02:28.661 [200/745] Generating lib/rte_gpudev_def with a custom command 00:02:28.661 [201/745] Generating lib/rte_gpudev_mingw with a custom command 00:02:28.661 [202/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:02:28.661 [203/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:02:28.661 [204/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.661 [205/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:02:28.924 [206/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:02:28.924 [207/745] Linking static target lib/librte_bitratestats.a 00:02:28.924 [208/745] Generating lib/rte_gro_mingw with a custom command 00:02:28.924 [209/745] Generating lib/rte_gro_def with a custom command 00:02:28.924 [210/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.924 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:02:28.924 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:29.187 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:02:29.187 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:29.187 [215/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:02:29.187 [216/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:02:29.187 [217/745] Generating lib/rte_gso_def with a custom command 00:02:29.187 [218/745] Generating lib/rte_gso_mingw with a custom command 00:02:29.187 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:02:29.187 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:02:29.453 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:02:29.453 [222/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:29.453 [223/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:29.453 [224/745] Generating lib/rte_ip_frag_mingw with a custom command 00:02:29.453 [225/745] Generating lib/rte_ip_frag_def with a custom command 00:02:29.453 [226/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:29.453 [227/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:02:29.453 [228/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:02:29.453 [229/745] Linking static target lib/librte_bbdev.a 00:02:29.453 [230/745] Generating lib/rte_jobstats_def with a custom command 00:02:29.453 [231/745] Generating lib/rte_jobstats_mingw with a custom command 00:02:29.453 [232/745] Generating lib/rte_latencystats_def with a custom command 00:02:29.453 [233/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:29.453 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:02:29.453 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:02:29.718 [236/745] Generating lib/rte_lpm_def with a custom command 00:02:29.718 [237/745] Generating lib/rte_lpm_mingw with a custom command 00:02:29.718 [238/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:29.718 [239/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:02:29.718 [240/745] Linking static target lib/librte_compressdev.a 00:02:29.718 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:02:29.718 [242/745] Linking static target lib/librte_jobstats.a 00:02:29.718 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:02:29.977 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:29.977 [245/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:02:29.977 [246/745] Linking static target lib/librte_distributor.a 00:02:29.977 [247/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:02:29.977 [248/745] Generating lib/rte_member_def with a custom command 00:02:29.977 [249/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:02:30.242 [250/745] Generating lib/rte_member_mingw with a custom command 00:02:30.242 [251/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:02:30.242 [252/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.242 [253/745] Generating lib/rte_pcapng_def with a custom command 00:02:30.242 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:02:30.242 [255/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:02:30.242 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:02:30.242 [257/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.242 [258/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:30.242 [259/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:30.505 [260/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:02:30.505 [261/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:02:30.505 [262/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:02:30.505 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:02:30.505 [264/745] Linking static target lib/librte_bpf.a 00:02:30.505 [265/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.505 [266/745] Generating lib/rte_power_def with a custom command 00:02:30.505 [267/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:02:30.505 [268/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:30.505 [269/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:02:30.505 [270/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:02:30.505 [271/745] Generating lib/rte_power_mingw with a custom command 00:02:30.505 [272/745] Generating lib/rte_rawdev_def with a custom command 00:02:30.505 [273/745] Linking static target lib/librte_gpudev.a 00:02:30.505 [274/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:02:30.505 [275/745] Linking static target lib/librte_gro.a 00:02:30.505 [276/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:02:30.505 [277/745] Generating lib/rte_rawdev_mingw with a custom command 00:02:30.505 [278/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:30.505 [279/745] Generating lib/rte_regexdev_mingw with a custom command 00:02:30.505 [280/745] Generating lib/rte_regexdev_def with a custom command 00:02:30.505 [281/745] Generating lib/rte_dmadev_def with a custom command 00:02:30.505 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:02:30.769 [283/745] Generating lib/rte_rib_def with a custom command 00:02:30.769 [284/745] Generating lib/rte_rib_mingw with a custom command 00:02:30.769 [285/745] Generating lib/rte_reorder_def with a custom command 00:02:30.769 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:02:30.769 [287/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:02:30.769 [288/745] Generating lib/rte_reorder_mingw with a custom command 00:02:31.034 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.034 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.034 [291/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:02:31.034 [292/745] Generating lib/rte_sched_def with a custom command 00:02:31.034 [293/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:02:31.034 [294/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:02:31.034 [295/745] Linking static target lib/librte_latencystats.a 00:02:31.034 [296/745] Generating lib/rte_sched_mingw with a custom command 00:02:31.034 [297/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.034 [298/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:02:31.034 [299/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:02:31.034 [300/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:02:31.034 [301/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:02:31.034 [302/745] Generating lib/rte_security_def with a custom command 00:02:31.034 [303/745] Generating lib/rte_security_mingw with a custom command 00:02:31.034 [304/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:02:31.034 [305/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:02:31.034 [306/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:02:31.034 [307/745] Generating lib/rte_stack_def with a custom command 00:02:31.034 [308/745] Generating lib/rte_stack_mingw with a custom command 00:02:31.293 [309/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:02:31.293 [310/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:02:31.293 [311/745] Linking static target lib/librte_rawdev.a 00:02:31.293 [312/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:02:31.293 [313/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:02:31.293 [314/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:02:31.293 [315/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:02:31.293 [316/745] Linking static target lib/librte_stack.a 00:02:31.293 [317/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:02:31.293 [318/745] Generating lib/rte_vhost_def with a custom command 00:02:31.293 [319/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:02:31.293 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:02:31.293 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:31.293 [322/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.293 [323/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:31.293 [324/745] Linking static target lib/librte_dmadev.a 00:02:31.293 [325/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:02:31.293 [326/745] Linking static target lib/librte_ip_frag.a 00:02:31.555 [327/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:02:31.555 [328/745] Generating lib/rte_ipsec_def with a custom command 00:02:31.555 [329/745] Generating lib/rte_ipsec_mingw with a custom command 00:02:31.555 [330/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:02:31.555 [331/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:02:31.555 [332/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.818 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:02:31.818 [334/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.818 [335/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.818 [336/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:02:31.818 [337/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:02:31.818 [338/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:31.818 [339/745] Generating lib/rte_fib_def with a custom command 00:02:31.818 [340/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:02:31.818 [341/745] Generating lib/rte_fib_mingw with a custom command 00:02:31.818 [342/745] Linking static target lib/librte_gso.a 00:02:32.081 [343/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:32.081 [344/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:02:32.081 [345/745] Linking static target lib/librte_regexdev.a 00:02:32.081 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:32.348 [347/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:02:32.348 [348/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:02:32.348 [349/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:02:32.348 [350/745] Linking static target lib/librte_pcapng.a 00:02:32.608 [351/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:02:32.609 [352/745] Linking static target lib/librte_lpm.a 00:02:32.609 [353/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:02:32.609 [354/745] Linking static target lib/librte_efd.a 00:02:32.609 [355/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:32.609 [356/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:02:32.609 [357/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:02:32.609 [358/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:32.609 [359/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:32.609 [360/745] Linking static target lib/librte_reorder.a 00:02:32.609 [361/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:02:32.609 [362/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:32.874 [363/745] Generating lib/rte_port_def with a custom command 00:02:32.874 [364/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:32.874 [365/745] Generating lib/rte_port_mingw with a custom command 00:02:32.874 [366/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:02:32.874 [367/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:02:32.874 [368/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:02:32.874 [369/745] Linking static target lib/acl/libavx2_tmp.a 00:02:32.874 [370/745] Generating lib/rte_pdump_def with a custom command 00:02:32.874 [371/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:02:32.874 [372/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:02:32.874 [373/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:02:32.874 [374/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:02:32.874 [375/745] Generating lib/rte_pdump_mingw with a custom command 00:02:32.874 [376/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:02:32.874 [377/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:02:32.874 [378/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:32.874 [379/745] Linking static target lib/librte_security.a 00:02:32.874 [380/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:32.874 [381/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.136 [382/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.136 [383/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:02:33.137 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:33.137 [385/745] Linking static target lib/librte_power.a 00:02:33.137 [386/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:33.137 [387/745] Linking static target lib/librte_hash.a 00:02:33.137 [388/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:02:33.137 [389/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.398 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:02:33.398 [391/745] Linking static target lib/librte_rib.a 00:02:33.398 [392/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:02:33.398 [393/745] Linking static target lib/acl/libavx512_tmp.a 00:02:33.398 [394/745] Linking static target lib/librte_acl.a 00:02:33.398 [395/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:02:33.398 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:02:33.398 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:02:33.660 [398/745] Generating lib/rte_table_def with a custom command 00:02:33.660 [399/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:33.660 [400/745] Generating lib/rte_table_mingw with a custom command 00:02:33.660 [401/745] Linking static target lib/librte_ethdev.a 00:02:33.660 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.950 [403/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.950 [404/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:02:33.950 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.950 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:02:34.213 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:02:34.213 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:02:34.213 [409/745] Generating lib/rte_pipeline_def with a custom command 00:02:34.213 [410/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:02:34.213 [411/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:02:34.213 [412/745] Generating lib/rte_pipeline_mingw with a custom command 00:02:34.213 [413/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:34.213 [414/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:02:34.213 [415/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:34.213 [416/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:02:34.213 [417/745] Generating lib/rte_graph_def with a custom command 00:02:34.213 [418/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:34.213 [419/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:02:34.213 [420/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:02:34.213 [421/745] Linking static target lib/librte_mbuf.a 00:02:34.213 [422/745] Generating lib/rte_graph_mingw with a custom command 00:02:34.213 [423/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:02:34.213 [424/745] Linking static target lib/librte_fib.a 00:02:34.473 [425/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:02:34.473 [426/745] Linking static target lib/librte_eventdev.a 00:02:34.473 [427/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:34.473 [428/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:02:34.473 [429/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:02:34.473 [430/745] Linking static target lib/librte_member.a 00:02:34.473 [431/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:02:34.738 [432/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:02:34.738 [433/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:02:34.738 [434/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:02:34.738 [435/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:02:34.738 [436/745] Generating lib/rte_node_mingw with a custom command 00:02:34.738 [437/745] Generating lib/rte_node_def with a custom command 00:02:34.738 [438/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:02:34.738 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:02:35.001 [440/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:35.001 [441/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:02:35.001 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:02:35.001 [443/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:02:35.001 [444/745] Linking static target lib/librte_sched.a 00:02:35.001 [445/745] Generating drivers/rte_bus_pci_def with a custom command 00:02:35.001 [446/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:35.001 [447/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:02:35.001 [448/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:02:35.001 [449/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:35.001 [450/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:02:35.262 [451/745] Generating drivers/rte_bus_vdev_def with a custom command 00:02:35.262 [452/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:35.262 [453/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:02:35.262 [454/745] Linking static target lib/librte_cryptodev.a 00:02:35.262 [455/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:35.262 [456/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:02:35.262 [457/745] Generating drivers/rte_mempool_ring_def with a custom command 00:02:35.262 [458/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:35.262 [459/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:02:35.262 [460/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:02:35.262 [461/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:02:35.262 [462/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:35.262 [463/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:02:35.530 [464/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:35.530 [465/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:02:35.530 [466/745] Linking static target lib/librte_pdump.a 00:02:35.531 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:02:35.531 [468/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:02:35.531 [469/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:02:35.531 [470/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:02:35.531 [471/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:02:35.531 [472/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:35.531 [473/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:35.793 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:35.793 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:02:35.793 [476/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:02:35.793 [477/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:02:35.793 [478/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:02:35.793 [479/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:02:35.793 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:02:35.793 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:02:35.793 [482/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:02:35.793 [483/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:02:36.059 [484/745] Linking static target lib/librte_table.a 00:02:36.059 [485/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:02:36.059 [486/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:36.059 [487/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:36.060 [488/745] Linking static target drivers/librte_bus_vdev.a 00:02:36.060 [489/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:02:36.060 [490/745] Linking static target lib/librte_ipsec.a 00:02:36.060 [491/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:02:36.060 [492/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:36.324 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:36.324 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:36.324 [495/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:02:36.585 [496/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:36.585 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:02:36.585 [498/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:02:36.585 [499/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:02:36.585 [500/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:02:36.585 [501/745] Linking static target lib/librte_graph.a 00:02:36.585 [502/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:02:36.585 [503/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:02:36.585 [504/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:02:36.585 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:02:36.848 [506/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:02:36.848 [507/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:36.848 [508/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:36.848 [509/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:02:36.848 [510/745] Linking static target drivers/librte_bus_pci.a 00:02:36.848 [511/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:36.848 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:02:37.111 [513/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:02:37.111 [514/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:02:37.375 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:02:37.375 [516/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:02:37.375 [517/745] Linking static target lib/librte_port.a 00:02:37.375 [518/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:37.375 [519/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:02:37.636 [520/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:02:37.636 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:02:37.636 [522/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:37.636 [523/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:37.636 [524/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:37.897 [525/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:02:37.897 [526/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:02:38.164 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:02:38.164 [528/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:38.164 [529/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:02:38.164 [530/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:02:38.164 [531/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:38.164 [532/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:38.164 [533/745] Linking static target drivers/librte_mempool_ring.a 00:02:38.164 [534/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:02:38.164 [535/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:02:38.423 [536/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:02:38.423 [537/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:02:38.423 [538/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:02:38.423 [539/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:02:38.423 [540/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:02:38.686 [541/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:38.949 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:02:38.949 [543/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:02:38.949 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:02:38.949 [545/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:02:39.209 [546/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:02:39.209 [547/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:02:39.209 [548/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:02:39.209 [549/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:02:39.209 [550/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:02:39.209 [551/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:02:39.478 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:02:39.478 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:02:39.737 [554/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:02:40.006 [555/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:02:40.006 [556/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:02:40.006 [557/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:02:40.006 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:02:40.006 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:02:40.269 [560/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:02:40.269 [561/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:02:40.532 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:02:40.532 [563/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:02:40.532 [564/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:02:40.532 [565/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:02:40.532 [566/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:02:40.532 [567/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:02:40.796 [568/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:40.796 [569/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:02:40.796 [570/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:02:40.796 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:02:40.796 [572/745] Linking target lib/librte_eal.so.23.0 00:02:40.796 [573/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:02:40.796 [574/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:02:41.059 [575/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:02:41.059 [576/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:02:41.059 [577/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:02:41.059 [578/745] Linking target lib/librte_ring.so.23.0 00:02:41.059 [579/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:02:41.320 [580/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:02:41.320 [581/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:02:41.320 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:02:41.320 [583/745] Linking target lib/librte_meter.so.23.0 00:02:41.320 [584/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:02:41.320 [585/745] Linking target lib/librte_timer.so.23.0 00:02:41.320 [586/745] Linking target lib/librte_pci.so.23.0 00:02:41.320 [587/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:02:41.320 [588/745] Linking target lib/librte_acl.so.23.0 00:02:41.320 [589/745] Linking target lib/librte_cfgfile.so.23.0 00:02:41.320 [590/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:02:41.320 [591/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:02:41.320 [592/745] Linking target lib/librte_jobstats.so.23.0 00:02:41.320 [593/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:41.320 [594/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:41.320 [595/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:02:41.320 [596/745] Linking target lib/librte_dmadev.so.23.0 00:02:41.320 [597/745] Linking target lib/librte_rawdev.so.23.0 00:02:41.320 [598/745] Linking target lib/librte_stack.so.23.0 00:02:41.320 [599/745] Linking target lib/librte_graph.so.23.0 00:02:41.320 [600/745] Linking target drivers/librte_bus_vdev.so.23.0 00:02:41.580 [601/745] Linking target lib/librte_rcu.so.23.0 00:02:41.580 [602/745] Linking target lib/librte_mempool.so.23.0 00:02:41.580 [603/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:02:41.580 [604/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:02:41.580 [605/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:02:41.580 [606/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:02:41.580 [607/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:02:41.580 [608/745] Linking target drivers/librte_bus_pci.so.23.0 00:02:41.580 [609/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:02:41.580 [610/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:02:41.580 [611/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:02:41.580 [612/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:02:41.580 [613/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:02:41.843 [614/745] Linking target lib/librte_mbuf.so.23.0 00:02:41.843 [615/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:02:41.843 [616/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:02:41.843 [617/745] Linking target lib/librte_rib.so.23.0 00:02:41.843 [618/745] Linking target drivers/librte_mempool_ring.so.23.0 00:02:41.843 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:02:42.105 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:02:42.105 [621/745] Linking target lib/librte_net.so.23.0 00:02:42.105 [622/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:02:42.105 [623/745] Linking target lib/librte_bbdev.so.23.0 00:02:42.105 [624/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:02:42.364 [625/745] Linking target lib/librte_compressdev.so.23.0 00:02:42.364 [626/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:02:42.364 [627/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:02:42.364 [628/745] Linking target lib/librte_distributor.so.23.0 00:02:42.364 [629/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:02:42.364 [630/745] Linking target lib/librte_cryptodev.so.23.0 00:02:42.364 [631/745] Linking target lib/librte_gpudev.so.23.0 00:02:42.364 [632/745] Linking target lib/librte_regexdev.so.23.0 00:02:42.364 [633/745] Linking target lib/librte_reorder.so.23.0 00:02:42.364 [634/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:42.364 [635/745] Linking target lib/librte_cmdline.so.23.0 00:02:42.364 [636/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:02:42.364 [637/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:42.364 [638/745] Linking target lib/librte_ethdev.so.23.0 00:02:42.364 [639/745] Linking target lib/librte_hash.so.23.0 00:02:42.364 [640/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:02:42.364 [641/745] Linking target lib/librte_sched.so.23.0 00:02:42.364 [642/745] Linking target lib/librte_fib.so.23.0 00:02:42.625 [643/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:02:42.625 [644/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:02:42.625 [645/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:02:42.625 [646/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:02:42.625 [647/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:02:42.625 [648/745] Linking target lib/librte_security.so.23.0 00:02:42.625 [649/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:02:42.625 [650/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:02:42.625 [651/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:02:42.625 [652/745] Linking target lib/librte_lpm.so.23.0 00:02:42.625 [653/745] Linking target lib/librte_efd.so.23.0 00:02:42.625 [654/745] Linking target lib/librte_member.so.23.0 00:02:42.625 [655/745] Linking target lib/librte_pcapng.so.23.0 00:02:42.625 [656/745] Linking target lib/librte_ip_frag.so.23.0 00:02:42.884 [657/745] Linking target lib/librte_metrics.so.23.0 00:02:42.884 [658/745] Linking target lib/librte_gso.so.23.0 00:02:42.884 [659/745] Linking target lib/librte_gro.so.23.0 00:02:42.884 [660/745] Linking target lib/librte_bpf.so.23.0 00:02:42.884 [661/745] Linking target lib/librte_power.so.23.0 00:02:42.884 [662/745] Linking target lib/librte_eventdev.so.23.0 00:02:42.884 [663/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:42.884 [664/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:42.884 [665/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:02:42.884 [666/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:02:42.884 [667/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:02:42.884 [668/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:02:42.884 [669/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:42.884 [670/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:02:42.884 [671/745] Linking target lib/librte_ipsec.so.23.0 00:02:42.884 [672/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:02:42.884 [673/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:02:42.884 [674/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:42.884 [675/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:02:42.884 [676/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:02:42.884 [677/745] Linking target lib/librte_bitratestats.so.23.0 00:02:42.884 [678/745] Linking target lib/librte_latencystats.so.23.0 00:02:43.142 [679/745] Linking target lib/librte_pdump.so.23.0 00:02:43.142 [680/745] Linking target lib/librte_port.so.23.0 00:02:43.142 [681/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:43.142 [682/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:43.142 [683/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:02:43.142 [684/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:43.400 [685/745] Linking target lib/librte_table.so.23.0 00:02:43.400 [686/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:02:43.400 [687/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:02:43.400 [688/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:43.400 [689/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:02:43.400 [690/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:43.400 [691/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:02:43.659 [692/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:43.659 [693/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:43.659 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:43.916 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:43.917 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:44.174 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:44.174 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:44.432 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:44.432 [700/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:44.432 [701/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:44.689 [702/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:44.689 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:44.947 [704/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:44.947 [705/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:44.947 [706/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:44.947 [707/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:44.947 [708/745] Linking static target drivers/librte_net_i40e.a 00:02:45.205 [709/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:45.463 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:45.463 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:45.722 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:02:46.287 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:46.287 [714/745] Linking static target lib/librte_node.a 00:02:46.544 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:46.544 [716/745] Linking target lib/librte_node.so.23.0 00:02:46.544 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:47.476 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:48.043 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:56.179 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:03:22.714 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:03:22.714 [722/745] Linking static target lib/librte_vhost.a 00:03:23.650 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:03:23.650 [724/745] Linking target lib/librte_vhost.so.23.0 00:03:38.542 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:03:38.542 [726/745] Linking static target lib/librte_pipeline.a 00:03:38.542 [727/745] Linking target app/dpdk-test-cmdline 00:03:38.542 [728/745] Linking target app/dpdk-pdump 00:03:38.542 [729/745] Linking target app/dpdk-dumpcap 00:03:38.542 [730/745] Linking target app/dpdk-proc-info 00:03:38.542 [731/745] Linking target app/dpdk-test-acl 00:03:38.542 [732/745] Linking target app/dpdk-test-fib 00:03:38.542 [733/745] Linking target app/dpdk-test-sad 00:03:38.542 [734/745] Linking target app/dpdk-test-gpudev 00:03:38.542 [735/745] Linking target app/dpdk-test-regex 00:03:38.542 [736/745] Linking target app/dpdk-test-flow-perf 00:03:38.542 [737/745] Linking target app/dpdk-test-pipeline 00:03:38.542 [738/745] Linking target app/dpdk-test-security-perf 00:03:38.542 [739/745] Linking target app/dpdk-test-crypto-perf 00:03:38.542 [740/745] Linking target app/dpdk-test-eventdev 00:03:38.542 [741/745] Linking target app/dpdk-test-bbdev 00:03:38.542 [742/745] Linking target app/dpdk-test-compress-perf 00:03:38.542 [743/745] Linking target app/dpdk-testpmd 00:03:38.802 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:39.061 [745/745] Linking target lib/librte_pipeline.so.23.0 00:03:39.061 16:28:04 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:03:39.061 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:03:39.061 [0/1] Installing files. 00:03:39.323 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.323 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:39.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:39.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:03:39.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:39.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:39.328 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.328 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.587 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:39.847 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:39.847 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:39.847 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:39.847 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:03:39.847 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.847 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:39.848 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.109 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.110 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.111 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:40.112 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:40.112 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:03:40.112 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:03:40.112 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:03:40.112 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:03:40.112 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:03:40.112 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:03:40.112 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:03:40.112 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:03:40.112 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:03:40.112 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:03:40.112 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:03:40.112 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:03:40.112 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:03:40.112 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:03:40.112 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:03:40.112 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:03:40.112 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:03:40.112 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:03:40.112 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:03:40.112 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:03:40.112 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:03:40.112 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:03:40.112 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:03:40.112 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:03:40.112 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:03:40.112 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:03:40.112 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:03:40.112 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:03:40.112 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:03:40.112 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:03:40.112 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:03:40.112 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:03:40.112 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:03:40.112 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:03:40.112 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:03:40.112 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:03:40.112 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:03:40.112 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:03:40.112 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:03:40.112 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:03:40.112 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:03:40.112 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:03:40.112 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:03:40.112 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:03:40.112 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:03:40.112 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:03:40.112 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:03:40.112 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:03:40.112 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:03:40.112 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:03:40.112 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:03:40.112 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:03:40.112 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:03:40.112 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:03:40.112 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:03:40.112 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:03:40.112 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:03:40.112 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:03:40.112 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:03:40.112 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:03:40.112 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:03:40.113 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:03:40.113 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:03:40.113 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:03:40.113 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:03:40.113 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:03:40.113 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:03:40.113 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:03:40.113 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:03:40.113 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:03:40.113 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:03:40.113 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:03:40.113 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:03:40.113 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:03:40.113 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:03:40.113 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:03:40.113 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:03:40.113 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:03:40.113 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:03:40.113 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:03:40.113 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:03:40.113 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:03:40.113 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:03:40.113 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:03:40.113 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:03:40.113 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:03:40.113 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:03:40.113 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:03:40.113 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:03:40.113 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:03:40.113 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:03:40.113 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:03:40.113 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:03:40.113 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:03:40.113 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:03:40.113 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:03:40.113 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:03:40.113 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:03:40.113 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:03:40.113 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:03:40.113 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:03:40.113 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:03:40.113 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:03:40.113 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:03:40.113 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:03:40.113 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:03:40.113 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:03:40.113 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:03:40.113 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:03:40.113 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:03:40.113 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:03:40.113 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:03:40.113 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:03:40.113 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:03:40.113 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:03:40.113 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:03:40.113 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:03:40.113 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:03:40.113 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:03:40.113 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:03:40.113 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:03:40.113 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:03:40.113 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:03:40.113 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:03:40.113 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:03:40.113 16:28:05 -- common/autobuild_common.sh@192 -- $ uname -s 00:03:40.113 16:28:05 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:03:40.113 16:28:05 -- common/autobuild_common.sh@203 -- $ cat 00:03:40.113 16:28:05 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:40.113 00:03:40.113 real 1m20.453s 00:03:40.113 user 14m21.415s 00:03:40.113 sys 1m49.067s 00:03:40.113 16:28:05 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:03:40.113 16:28:05 -- common/autotest_common.sh@10 -- $ set +x 00:03:40.113 ************************************ 00:03:40.113 END TEST build_native_dpdk 00:03:40.113 ************************************ 00:03:40.113 16:28:05 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:40.113 16:28:05 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:40.113 16:28:05 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:03:40.113 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:03:40.371 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:40.371 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:40.371 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:40.630 Using 'verbs' RDMA provider 00:03:50.872 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:04:00.855 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:04:00.855 Creating mk/config.mk...done. 00:04:00.855 Creating mk/cc.flags.mk...done. 00:04:00.855 Type 'make' to build. 00:04:00.855 16:28:25 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:04:00.855 16:28:25 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:04:00.855 16:28:25 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:04:00.855 16:28:25 -- common/autotest_common.sh@10 -- $ set +x 00:04:00.855 ************************************ 00:04:00.855 START TEST make 00:04:00.855 ************************************ 00:04:00.855 16:28:25 -- common/autotest_common.sh@1104 -- $ make -j48 00:04:00.855 make[1]: Nothing to be done for 'all'. 00:04:01.806 The Meson build system 00:04:01.806 Version: 1.5.0 00:04:01.806 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:04:01.806 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:04:01.806 Build type: native build 00:04:01.806 Project name: libvfio-user 00:04:01.806 Project version: 0.0.1 00:04:01.806 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:04:01.806 C linker for the host machine: gcc ld.bfd 2.40-14 00:04:01.806 Host machine cpu family: x86_64 00:04:01.806 Host machine cpu: x86_64 00:04:01.806 Run-time dependency threads found: YES 00:04:01.806 Library dl found: YES 00:04:01.806 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:04:01.806 Run-time dependency json-c found: YES 0.17 00:04:01.806 Run-time dependency cmocka found: YES 1.1.7 00:04:01.806 Program pytest-3 found: NO 00:04:01.806 Program flake8 found: NO 00:04:01.806 Program misspell-fixer found: NO 00:04:01.806 Program restructuredtext-lint found: NO 00:04:01.806 Program valgrind found: YES (/usr/bin/valgrind) 00:04:01.806 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:04:01.806 Compiler for C supports arguments -Wmissing-declarations: YES 00:04:01.806 Compiler for C supports arguments -Wwrite-strings: YES 00:04:01.806 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:04:01.806 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:04:01.806 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:04:01.806 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:04:01.806 Build targets in project: 8 00:04:01.806 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:04:01.806 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:04:01.806 00:04:01.806 libvfio-user 0.0.1 00:04:01.806 00:04:01.806 User defined options 00:04:01.806 buildtype : debug 00:04:01.806 default_library: shared 00:04:01.806 libdir : /usr/local/lib 00:04:01.806 00:04:01.806 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:04:02.384 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:04:02.652 [1/37] Compiling C object samples/lspci.p/lspci.c.o 00:04:02.653 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:04:02.653 [3/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:04:02.653 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:04:02.653 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:04:02.653 [6/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:04:02.653 [7/37] Compiling C object samples/null.p/null.c.o 00:04:02.653 [8/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:04:02.653 [9/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:04:02.912 [10/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:04:02.912 [11/37] Compiling C object test/unit_tests.p/mocks.c.o 00:04:02.912 [12/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:04:02.912 [13/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:04:02.912 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:04:02.912 [15/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:04:02.912 [16/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:04:02.912 [17/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:04:02.912 [18/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:04:02.912 [19/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:04:02.912 [20/37] Compiling C object samples/client.p/client.c.o 00:04:02.912 [21/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:04:02.912 [22/37] Compiling C object samples/server.p/server.c.o 00:04:02.912 [23/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:04:02.912 [24/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:04:02.912 [25/37] Linking target samples/client 00:04:02.912 [26/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:04:02.912 [27/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:04:02.912 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:04:02.912 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:04:03.171 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:04:03.171 [31/37] Linking target test/unit_tests 00:04:03.171 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:04:03.171 [33/37] Linking target samples/server 00:04:03.171 [34/37] Linking target samples/shadow_ioeventfd_server 00:04:03.171 [35/37] Linking target samples/null 00:04:03.171 [36/37] Linking target samples/lspci 00:04:03.171 [37/37] Linking target samples/gpio-pci-idio-16 00:04:03.434 INFO: autodetecting backend as ninja 00:04:03.434 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:04:03.434 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:04:04.376 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:04:04.376 ninja: no work to do. 00:04:16.584 CC lib/ut_mock/mock.o 00:04:16.584 CC lib/ut/ut.o 00:04:16.584 CC lib/log/log.o 00:04:16.584 CC lib/log/log_flags.o 00:04:16.584 CC lib/log/log_deprecated.o 00:04:16.584 LIB libspdk_ut_mock.a 00:04:16.584 SO libspdk_ut_mock.so.5.0 00:04:16.584 LIB libspdk_log.a 00:04:16.584 LIB libspdk_ut.a 00:04:16.584 SO libspdk_ut.so.1.0 00:04:16.584 SO libspdk_log.so.6.1 00:04:16.584 SYMLINK libspdk_ut_mock.so 00:04:16.584 SYMLINK libspdk_ut.so 00:04:16.584 SYMLINK libspdk_log.so 00:04:16.584 CC lib/dma/dma.o 00:04:16.584 CC lib/ioat/ioat.o 00:04:16.584 CXX lib/trace_parser/trace.o 00:04:16.584 CC lib/util/base64.o 00:04:16.584 CC lib/util/bit_array.o 00:04:16.584 CC lib/util/cpuset.o 00:04:16.584 CC lib/util/crc16.o 00:04:16.584 CC lib/util/crc32.o 00:04:16.584 CC lib/util/crc32c.o 00:04:16.584 CC lib/util/crc32_ieee.o 00:04:16.584 CC lib/util/crc64.o 00:04:16.584 CC lib/util/dif.o 00:04:16.584 CC lib/util/fd.o 00:04:16.584 CC lib/util/file.o 00:04:16.584 CC lib/util/hexlify.o 00:04:16.584 CC lib/util/iov.o 00:04:16.584 CC lib/util/math.o 00:04:16.584 CC lib/util/pipe.o 00:04:16.584 CC lib/util/strerror_tls.o 00:04:16.584 CC lib/util/string.o 00:04:16.584 CC lib/util/uuid.o 00:04:16.584 CC lib/util/fd_group.o 00:04:16.584 CC lib/util/zipf.o 00:04:16.584 CC lib/util/xor.o 00:04:16.584 CC lib/vfio_user/host/vfio_user.o 00:04:16.584 CC lib/vfio_user/host/vfio_user_pci.o 00:04:16.584 LIB libspdk_dma.a 00:04:16.584 SO libspdk_dma.so.3.0 00:04:16.584 LIB libspdk_ioat.a 00:04:16.584 SO libspdk_ioat.so.6.0 00:04:16.584 SYMLINK libspdk_dma.so 00:04:16.584 SYMLINK libspdk_ioat.so 00:04:16.584 LIB libspdk_vfio_user.a 00:04:16.584 SO libspdk_vfio_user.so.4.0 00:04:16.584 SYMLINK libspdk_vfio_user.so 00:04:16.584 LIB libspdk_util.a 00:04:16.584 SO libspdk_util.so.8.0 00:04:16.584 SYMLINK libspdk_util.so 00:04:16.584 CC lib/env_dpdk/env.o 00:04:16.584 CC lib/vmd/vmd.o 00:04:16.584 CC lib/conf/conf.o 00:04:16.584 CC lib/idxd/idxd.o 00:04:16.584 CC lib/json/json_util.o 00:04:16.584 CC lib/rdma/common.o 00:04:16.584 CC lib/json/json_parse.o 00:04:16.584 CC lib/env_dpdk/memory.o 00:04:16.584 CC lib/vmd/led.o 00:04:16.584 CC lib/rdma/rdma_verbs.o 00:04:16.584 CC lib/env_dpdk/pci.o 00:04:16.584 CC lib/json/json_write.o 00:04:16.584 CC lib/idxd/idxd_user.o 00:04:16.584 CC lib/env_dpdk/init.o 00:04:16.584 CC lib/idxd/idxd_kernel.o 00:04:16.584 CC lib/env_dpdk/threads.o 00:04:16.584 CC lib/env_dpdk/pci_ioat.o 00:04:16.584 CC lib/env_dpdk/pci_virtio.o 00:04:16.584 CC lib/env_dpdk/pci_vmd.o 00:04:16.584 CC lib/env_dpdk/pci_idxd.o 00:04:16.584 CC lib/env_dpdk/pci_event.o 00:04:16.584 CC lib/env_dpdk/sigbus_handler.o 00:04:16.584 CC lib/env_dpdk/pci_dpdk.o 00:04:16.584 CC lib/env_dpdk/pci_dpdk_2211.o 00:04:16.584 CC lib/env_dpdk/pci_dpdk_2207.o 00:04:16.584 LIB libspdk_trace_parser.a 00:04:16.584 SO libspdk_trace_parser.so.4.0 00:04:16.584 SYMLINK libspdk_trace_parser.so 00:04:16.584 LIB libspdk_conf.a 00:04:16.584 SO libspdk_conf.so.5.0 00:04:16.584 SYMLINK libspdk_conf.so 00:04:16.584 LIB libspdk_json.a 00:04:16.584 LIB libspdk_rdma.a 00:04:16.584 SO libspdk_json.so.5.1 00:04:16.584 SO libspdk_rdma.so.5.0 00:04:16.584 SYMLINK libspdk_json.so 00:04:16.584 SYMLINK libspdk_rdma.so 00:04:16.584 CC lib/jsonrpc/jsonrpc_server.o 00:04:16.584 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:04:16.584 CC lib/jsonrpc/jsonrpc_client.o 00:04:16.584 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:04:16.584 LIB libspdk_idxd.a 00:04:16.584 SO libspdk_idxd.so.11.0 00:04:16.584 SYMLINK libspdk_idxd.so 00:04:16.584 LIB libspdk_vmd.a 00:04:16.584 SO libspdk_vmd.so.5.0 00:04:16.584 SYMLINK libspdk_vmd.so 00:04:16.584 LIB libspdk_jsonrpc.a 00:04:16.584 SO libspdk_jsonrpc.so.5.1 00:04:16.584 SYMLINK libspdk_jsonrpc.so 00:04:16.842 CC lib/rpc/rpc.o 00:04:17.099 LIB libspdk_rpc.a 00:04:17.099 SO libspdk_rpc.so.5.0 00:04:17.099 SYMLINK libspdk_rpc.so 00:04:17.099 CC lib/notify/notify.o 00:04:17.099 CC lib/trace/trace.o 00:04:17.099 CC lib/notify/notify_rpc.o 00:04:17.099 CC lib/trace/trace_flags.o 00:04:17.099 CC lib/trace/trace_rpc.o 00:04:17.099 CC lib/sock/sock.o 00:04:17.099 CC lib/sock/sock_rpc.o 00:04:17.358 LIB libspdk_notify.a 00:04:17.358 SO libspdk_notify.so.5.0 00:04:17.358 LIB libspdk_trace.a 00:04:17.358 SYMLINK libspdk_notify.so 00:04:17.358 SO libspdk_trace.so.9.0 00:04:17.358 SYMLINK libspdk_trace.so 00:04:17.616 LIB libspdk_sock.a 00:04:17.616 SO libspdk_sock.so.8.0 00:04:17.616 CC lib/thread/thread.o 00:04:17.616 CC lib/thread/iobuf.o 00:04:17.616 SYMLINK libspdk_sock.so 00:04:17.616 CC lib/nvme/nvme_ctrlr_cmd.o 00:04:17.616 CC lib/nvme/nvme_ctrlr.o 00:04:17.616 CC lib/nvme/nvme_fabric.o 00:04:17.616 CC lib/nvme/nvme_ns_cmd.o 00:04:17.616 CC lib/nvme/nvme_ns.o 00:04:17.616 CC lib/nvme/nvme_pcie_common.o 00:04:17.616 CC lib/nvme/nvme_pcie.o 00:04:17.616 CC lib/nvme/nvme_qpair.o 00:04:17.616 CC lib/nvme/nvme.o 00:04:17.616 CC lib/nvme/nvme_quirks.o 00:04:17.616 CC lib/nvme/nvme_transport.o 00:04:17.616 CC lib/nvme/nvme_discovery.o 00:04:17.616 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:04:17.616 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:04:17.616 CC lib/nvme/nvme_tcp.o 00:04:17.616 CC lib/nvme/nvme_opal.o 00:04:17.616 CC lib/nvme/nvme_io_msg.o 00:04:17.616 CC lib/nvme/nvme_poll_group.o 00:04:17.616 CC lib/nvme/nvme_zns.o 00:04:17.616 CC lib/nvme/nvme_cuse.o 00:04:17.616 CC lib/nvme/nvme_vfio_user.o 00:04:17.616 CC lib/nvme/nvme_rdma.o 00:04:17.874 LIB libspdk_env_dpdk.a 00:04:17.874 SO libspdk_env_dpdk.so.13.0 00:04:18.132 SYMLINK libspdk_env_dpdk.so 00:04:19.158 LIB libspdk_thread.a 00:04:19.158 SO libspdk_thread.so.9.0 00:04:19.158 SYMLINK libspdk_thread.so 00:04:19.437 CC lib/blob/blobstore.o 00:04:19.437 CC lib/virtio/virtio.o 00:04:19.437 CC lib/accel/accel.o 00:04:19.437 CC lib/vfu_tgt/tgt_endpoint.o 00:04:19.437 CC lib/init/json_config.o 00:04:19.437 CC lib/accel/accel_rpc.o 00:04:19.437 CC lib/blob/request.o 00:04:19.437 CC lib/virtio/virtio_vhost_user.o 00:04:19.437 CC lib/vfu_tgt/tgt_rpc.o 00:04:19.437 CC lib/init/subsystem.o 00:04:19.437 CC lib/blob/zeroes.o 00:04:19.437 CC lib/accel/accel_sw.o 00:04:19.437 CC lib/virtio/virtio_vfio_user.o 00:04:19.437 CC lib/init/subsystem_rpc.o 00:04:19.437 CC lib/blob/blob_bs_dev.o 00:04:19.437 CC lib/virtio/virtio_pci.o 00:04:19.437 CC lib/init/rpc.o 00:04:19.695 LIB libspdk_init.a 00:04:19.695 SO libspdk_init.so.4.0 00:04:19.695 SYMLINK libspdk_init.so 00:04:19.695 LIB libspdk_virtio.a 00:04:19.695 LIB libspdk_vfu_tgt.a 00:04:19.695 SO libspdk_vfu_tgt.so.2.0 00:04:19.695 SO libspdk_virtio.so.6.0 00:04:19.695 SYMLINK libspdk_vfu_tgt.so 00:04:19.695 SYMLINK libspdk_virtio.so 00:04:19.695 CC lib/event/app.o 00:04:19.695 CC lib/event/reactor.o 00:04:19.695 CC lib/event/log_rpc.o 00:04:19.695 CC lib/event/app_rpc.o 00:04:19.695 CC lib/event/scheduler_static.o 00:04:20.260 LIB libspdk_nvme.a 00:04:20.260 SO libspdk_nvme.so.12.0 00:04:20.260 LIB libspdk_event.a 00:04:20.260 SO libspdk_event.so.12.0 00:04:20.260 SYMLINK libspdk_event.so 00:04:20.518 SYMLINK libspdk_nvme.so 00:04:20.518 LIB libspdk_accel.a 00:04:20.518 SO libspdk_accel.so.14.0 00:04:20.518 SYMLINK libspdk_accel.so 00:04:20.518 CC lib/bdev/bdev.o 00:04:20.518 CC lib/bdev/bdev_rpc.o 00:04:20.518 CC lib/bdev/bdev_zone.o 00:04:20.518 CC lib/bdev/part.o 00:04:20.518 CC lib/bdev/scsi_nvme.o 00:04:22.417 LIB libspdk_blob.a 00:04:22.417 SO libspdk_blob.so.10.1 00:04:22.417 SYMLINK libspdk_blob.so 00:04:22.417 CC lib/blobfs/blobfs.o 00:04:22.417 CC lib/blobfs/tree.o 00:04:22.417 CC lib/lvol/lvol.o 00:04:23.354 LIB libspdk_blobfs.a 00:04:23.354 SO libspdk_blobfs.so.9.0 00:04:23.354 LIB libspdk_bdev.a 00:04:23.354 LIB libspdk_lvol.a 00:04:23.354 SO libspdk_lvol.so.9.1 00:04:23.354 SYMLINK libspdk_blobfs.so 00:04:23.354 SO libspdk_bdev.so.14.0 00:04:23.354 SYMLINK libspdk_lvol.so 00:04:23.354 SYMLINK libspdk_bdev.so 00:04:23.354 CC lib/scsi/dev.o 00:04:23.354 CC lib/scsi/lun.o 00:04:23.354 CC lib/scsi/port.o 00:04:23.354 CC lib/scsi/scsi.o 00:04:23.354 CC lib/nbd/nbd.o 00:04:23.354 CC lib/ublk/ublk.o 00:04:23.354 CC lib/scsi/scsi_bdev.o 00:04:23.354 CC lib/nbd/nbd_rpc.o 00:04:23.354 CC lib/ublk/ublk_rpc.o 00:04:23.354 CC lib/scsi/scsi_pr.o 00:04:23.354 CC lib/nvmf/ctrlr.o 00:04:23.354 CC lib/scsi/scsi_rpc.o 00:04:23.354 CC lib/nvmf/ctrlr_discovery.o 00:04:23.354 CC lib/scsi/task.o 00:04:23.354 CC lib/ftl/ftl_core.o 00:04:23.354 CC lib/nvmf/ctrlr_bdev.o 00:04:23.354 CC lib/nvmf/subsystem.o 00:04:23.354 CC lib/ftl/ftl_layout.o 00:04:23.354 CC lib/ftl/ftl_init.o 00:04:23.354 CC lib/nvmf/nvmf.o 00:04:23.354 CC lib/ftl/ftl_debug.o 00:04:23.354 CC lib/nvmf/nvmf_rpc.o 00:04:23.354 CC lib/nvmf/transport.o 00:04:23.354 CC lib/nvmf/tcp.o 00:04:23.354 CC lib/ftl/ftl_io.o 00:04:23.354 CC lib/nvmf/vfio_user.o 00:04:23.354 CC lib/nvmf/rdma.o 00:04:23.354 CC lib/ftl/ftl_l2p.o 00:04:23.354 CC lib/ftl/ftl_sb.o 00:04:23.354 CC lib/ftl/ftl_nv_cache.o 00:04:23.354 CC lib/ftl/ftl_l2p_flat.o 00:04:23.354 CC lib/ftl/ftl_band.o 00:04:23.354 CC lib/ftl/ftl_band_ops.o 00:04:23.354 CC lib/ftl/ftl_writer.o 00:04:23.354 CC lib/ftl/ftl_rq.o 00:04:23.354 CC lib/ftl/ftl_reloc.o 00:04:23.354 CC lib/ftl/ftl_l2p_cache.o 00:04:23.354 CC lib/ftl/ftl_p2l.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_startup.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_md.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_misc.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_band.o 00:04:23.354 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:04:23.927 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:04:23.927 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:04:23.927 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:04:23.927 CC lib/ftl/utils/ftl_conf.o 00:04:23.927 CC lib/ftl/utils/ftl_md.o 00:04:23.927 CC lib/ftl/utils/ftl_mempool.o 00:04:23.927 CC lib/ftl/utils/ftl_bitmap.o 00:04:23.927 CC lib/ftl/utils/ftl_property.o 00:04:23.927 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:04:23.927 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:04:23.927 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:04:23.927 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:04:23.927 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:04:23.927 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:04:23.927 CC lib/ftl/upgrade/ftl_sb_v3.o 00:04:23.927 CC lib/ftl/upgrade/ftl_sb_v5.o 00:04:23.927 CC lib/ftl/nvc/ftl_nvc_dev.o 00:04:23.927 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:04:23.927 CC lib/ftl/base/ftl_base_dev.o 00:04:23.927 CC lib/ftl/base/ftl_base_bdev.o 00:04:23.927 CC lib/ftl/ftl_trace.o 00:04:24.185 LIB libspdk_nbd.a 00:04:24.185 SO libspdk_nbd.so.6.0 00:04:24.443 LIB libspdk_scsi.a 00:04:24.443 SYMLINK libspdk_nbd.so 00:04:24.443 SO libspdk_scsi.so.8.0 00:04:24.443 LIB libspdk_ublk.a 00:04:24.443 SO libspdk_ublk.so.2.0 00:04:24.443 SYMLINK libspdk_scsi.so 00:04:24.443 SYMLINK libspdk_ublk.so 00:04:24.443 CC lib/vhost/vhost.o 00:04:24.443 CC lib/iscsi/conn.o 00:04:24.443 CC lib/vhost/vhost_rpc.o 00:04:24.443 CC lib/iscsi/init_grp.o 00:04:24.443 CC lib/vhost/vhost_scsi.o 00:04:24.443 CC lib/vhost/vhost_blk.o 00:04:24.443 CC lib/iscsi/iscsi.o 00:04:24.443 CC lib/vhost/rte_vhost_user.o 00:04:24.443 CC lib/iscsi/md5.o 00:04:24.443 CC lib/iscsi/param.o 00:04:24.443 CC lib/iscsi/portal_grp.o 00:04:24.443 CC lib/iscsi/tgt_node.o 00:04:24.443 CC lib/iscsi/iscsi_subsystem.o 00:04:24.443 CC lib/iscsi/iscsi_rpc.o 00:04:24.443 CC lib/iscsi/task.o 00:04:24.701 LIB libspdk_ftl.a 00:04:24.959 SO libspdk_ftl.so.8.0 00:04:25.217 SYMLINK libspdk_ftl.so 00:04:25.783 LIB libspdk_vhost.a 00:04:25.783 SO libspdk_vhost.so.7.1 00:04:25.783 SYMLINK libspdk_vhost.so 00:04:26.043 LIB libspdk_nvmf.a 00:04:26.043 LIB libspdk_iscsi.a 00:04:26.043 SO libspdk_nvmf.so.17.0 00:04:26.043 SO libspdk_iscsi.so.7.0 00:04:26.301 SYMLINK libspdk_nvmf.so 00:04:26.301 SYMLINK libspdk_iscsi.so 00:04:26.301 CC module/env_dpdk/env_dpdk_rpc.o 00:04:26.301 CC module/vfu_device/vfu_virtio.o 00:04:26.301 CC module/vfu_device/vfu_virtio_blk.o 00:04:26.301 CC module/vfu_device/vfu_virtio_scsi.o 00:04:26.301 CC module/vfu_device/vfu_virtio_rpc.o 00:04:26.560 CC module/accel/ioat/accel_ioat.o 00:04:26.560 CC module/scheduler/dynamic/scheduler_dynamic.o 00:04:26.560 CC module/accel/error/accel_error.o 00:04:26.560 CC module/sock/posix/posix.o 00:04:26.560 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:04:26.560 CC module/accel/ioat/accel_ioat_rpc.o 00:04:26.560 CC module/blob/bdev/blob_bdev.o 00:04:26.560 CC module/accel/iaa/accel_iaa.o 00:04:26.560 CC module/accel/error/accel_error_rpc.o 00:04:26.560 CC module/accel/iaa/accel_iaa_rpc.o 00:04:26.560 CC module/scheduler/gscheduler/gscheduler.o 00:04:26.560 CC module/accel/dsa/accel_dsa.o 00:04:26.560 CC module/accel/dsa/accel_dsa_rpc.o 00:04:26.560 LIB libspdk_env_dpdk_rpc.a 00:04:26.560 SO libspdk_env_dpdk_rpc.so.5.0 00:04:26.560 SYMLINK libspdk_env_dpdk_rpc.so 00:04:26.560 LIB libspdk_scheduler_gscheduler.a 00:04:26.560 LIB libspdk_scheduler_dpdk_governor.a 00:04:26.560 SO libspdk_scheduler_gscheduler.so.3.0 00:04:26.560 SO libspdk_scheduler_dpdk_governor.so.3.0 00:04:26.560 LIB libspdk_accel_error.a 00:04:26.560 LIB libspdk_accel_ioat.a 00:04:26.560 LIB libspdk_scheduler_dynamic.a 00:04:26.560 LIB libspdk_accel_iaa.a 00:04:26.560 SO libspdk_accel_error.so.1.0 00:04:26.560 SO libspdk_accel_ioat.so.5.0 00:04:26.818 SYMLINK libspdk_scheduler_gscheduler.so 00:04:26.818 SYMLINK libspdk_scheduler_dpdk_governor.so 00:04:26.818 SO libspdk_scheduler_dynamic.so.3.0 00:04:26.818 SO libspdk_accel_iaa.so.2.0 00:04:26.818 LIB libspdk_accel_dsa.a 00:04:26.818 SYMLINK libspdk_accel_error.so 00:04:26.818 SYMLINK libspdk_accel_ioat.so 00:04:26.818 SO libspdk_accel_dsa.so.4.0 00:04:26.818 SYMLINK libspdk_scheduler_dynamic.so 00:04:26.818 LIB libspdk_blob_bdev.a 00:04:26.818 SYMLINK libspdk_accel_iaa.so 00:04:26.818 SO libspdk_blob_bdev.so.10.1 00:04:26.818 SYMLINK libspdk_accel_dsa.so 00:04:26.818 SYMLINK libspdk_blob_bdev.so 00:04:27.077 CC module/bdev/zone_block/vbdev_zone_block.o 00:04:27.077 CC module/blobfs/bdev/blobfs_bdev.o 00:04:27.077 CC module/bdev/aio/bdev_aio.o 00:04:27.077 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:04:27.077 CC module/bdev/error/vbdev_error.o 00:04:27.077 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:04:27.077 CC module/bdev/passthru/vbdev_passthru.o 00:04:27.077 CC module/bdev/error/vbdev_error_rpc.o 00:04:27.077 CC module/bdev/aio/bdev_aio_rpc.o 00:04:27.077 CC module/bdev/nvme/bdev_nvme.o 00:04:27.077 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:04:27.077 CC module/bdev/delay/vbdev_delay.o 00:04:27.077 CC module/bdev/nvme/bdev_nvme_rpc.o 00:04:27.077 CC module/bdev/lvol/vbdev_lvol.o 00:04:27.077 CC module/bdev/split/vbdev_split.o 00:04:27.077 CC module/bdev/malloc/bdev_malloc.o 00:04:27.077 CC module/bdev/null/bdev_null.o 00:04:27.077 CC module/bdev/null/bdev_null_rpc.o 00:04:27.077 CC module/bdev/nvme/nvme_rpc.o 00:04:27.077 CC module/bdev/delay/vbdev_delay_rpc.o 00:04:27.077 CC module/bdev/gpt/gpt.o 00:04:27.077 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:04:27.077 CC module/bdev/gpt/vbdev_gpt.o 00:04:27.077 CC module/bdev/nvme/bdev_mdns_client.o 00:04:27.077 CC module/bdev/malloc/bdev_malloc_rpc.o 00:04:27.077 CC module/bdev/nvme/vbdev_opal.o 00:04:27.077 CC module/bdev/split/vbdev_split_rpc.o 00:04:27.077 CC module/bdev/raid/bdev_raid.o 00:04:27.077 CC module/bdev/ftl/bdev_ftl.o 00:04:27.077 CC module/bdev/ftl/bdev_ftl_rpc.o 00:04:27.077 CC module/bdev/nvme/vbdev_opal_rpc.o 00:04:27.078 CC module/bdev/raid/bdev_raid_rpc.o 00:04:27.078 CC module/bdev/raid/bdev_raid_sb.o 00:04:27.078 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:04:27.078 CC module/bdev/raid/raid0.o 00:04:27.078 CC module/bdev/virtio/bdev_virtio_scsi.o 00:04:27.078 CC module/bdev/raid/raid1.o 00:04:27.078 CC module/bdev/virtio/bdev_virtio_blk.o 00:04:27.078 CC module/bdev/iscsi/bdev_iscsi.o 00:04:27.078 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:04:27.078 CC module/bdev/virtio/bdev_virtio_rpc.o 00:04:27.078 CC module/bdev/raid/concat.o 00:04:27.078 LIB libspdk_vfu_device.a 00:04:27.078 SO libspdk_vfu_device.so.2.0 00:04:27.335 SYMLINK libspdk_vfu_device.so 00:04:27.335 LIB libspdk_blobfs_bdev.a 00:04:27.335 SO libspdk_blobfs_bdev.so.5.0 00:04:27.335 LIB libspdk_bdev_split.a 00:04:27.335 LIB libspdk_sock_posix.a 00:04:27.335 LIB libspdk_bdev_ftl.a 00:04:27.335 SO libspdk_bdev_split.so.5.0 00:04:27.335 SO libspdk_sock_posix.so.5.0 00:04:27.335 SO libspdk_bdev_ftl.so.5.0 00:04:27.335 LIB libspdk_bdev_error.a 00:04:27.335 SYMLINK libspdk_blobfs_bdev.so 00:04:27.593 SO libspdk_bdev_error.so.5.0 00:04:27.593 LIB libspdk_bdev_null.a 00:04:27.593 SYMLINK libspdk_bdev_split.so 00:04:27.593 SYMLINK libspdk_bdev_ftl.so 00:04:27.593 LIB libspdk_bdev_gpt.a 00:04:27.593 SYMLINK libspdk_sock_posix.so 00:04:27.593 LIB libspdk_bdev_delay.a 00:04:27.593 SO libspdk_bdev_null.so.5.0 00:04:27.593 LIB libspdk_bdev_passthru.a 00:04:27.593 LIB libspdk_bdev_aio.a 00:04:27.593 LIB libspdk_bdev_zone_block.a 00:04:27.593 SYMLINK libspdk_bdev_error.so 00:04:27.593 SO libspdk_bdev_gpt.so.5.0 00:04:27.593 SO libspdk_bdev_delay.so.5.0 00:04:27.593 SO libspdk_bdev_aio.so.5.0 00:04:27.593 SO libspdk_bdev_passthru.so.5.0 00:04:27.593 SO libspdk_bdev_zone_block.so.5.0 00:04:27.593 SYMLINK libspdk_bdev_null.so 00:04:27.593 SYMLINK libspdk_bdev_gpt.so 00:04:27.593 SYMLINK libspdk_bdev_delay.so 00:04:27.593 LIB libspdk_bdev_iscsi.a 00:04:27.593 SYMLINK libspdk_bdev_passthru.so 00:04:27.593 SYMLINK libspdk_bdev_aio.so 00:04:27.593 SYMLINK libspdk_bdev_zone_block.so 00:04:27.593 LIB libspdk_bdev_malloc.a 00:04:27.593 SO libspdk_bdev_iscsi.so.5.0 00:04:27.593 SO libspdk_bdev_malloc.so.5.0 00:04:27.593 SYMLINK libspdk_bdev_iscsi.so 00:04:27.593 SYMLINK libspdk_bdev_malloc.so 00:04:27.851 LIB libspdk_bdev_lvol.a 00:04:27.851 LIB libspdk_bdev_virtio.a 00:04:27.851 SO libspdk_bdev_lvol.so.5.0 00:04:27.851 SO libspdk_bdev_virtio.so.5.0 00:04:27.851 SYMLINK libspdk_bdev_lvol.so 00:04:27.851 SYMLINK libspdk_bdev_virtio.so 00:04:28.109 LIB libspdk_bdev_raid.a 00:04:28.109 SO libspdk_bdev_raid.so.5.0 00:04:28.109 SYMLINK libspdk_bdev_raid.so 00:04:29.489 LIB libspdk_bdev_nvme.a 00:04:29.489 SO libspdk_bdev_nvme.so.6.0 00:04:29.489 SYMLINK libspdk_bdev_nvme.so 00:04:29.747 CC module/event/subsystems/iobuf/iobuf.o 00:04:29.747 CC module/event/subsystems/vmd/vmd.o 00:04:29.747 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:04:29.747 CC module/event/subsystems/vmd/vmd_rpc.o 00:04:29.747 CC module/event/subsystems/scheduler/scheduler.o 00:04:29.747 CC module/event/subsystems/sock/sock.o 00:04:29.747 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:04:29.747 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:04:29.747 LIB libspdk_event_sock.a 00:04:29.747 LIB libspdk_event_vfu_tgt.a 00:04:29.747 LIB libspdk_event_scheduler.a 00:04:29.747 LIB libspdk_event_vhost_blk.a 00:04:29.747 LIB libspdk_event_vmd.a 00:04:29.747 LIB libspdk_event_iobuf.a 00:04:30.005 SO libspdk_event_sock.so.4.0 00:04:30.005 SO libspdk_event_vfu_tgt.so.2.0 00:04:30.005 SO libspdk_event_vhost_blk.so.2.0 00:04:30.005 SO libspdk_event_scheduler.so.3.0 00:04:30.005 SO libspdk_event_vmd.so.5.0 00:04:30.005 SO libspdk_event_iobuf.so.2.0 00:04:30.005 SYMLINK libspdk_event_sock.so 00:04:30.005 SYMLINK libspdk_event_vfu_tgt.so 00:04:30.005 SYMLINK libspdk_event_vhost_blk.so 00:04:30.005 SYMLINK libspdk_event_scheduler.so 00:04:30.005 SYMLINK libspdk_event_vmd.so 00:04:30.005 SYMLINK libspdk_event_iobuf.so 00:04:30.005 CC module/event/subsystems/accel/accel.o 00:04:30.262 LIB libspdk_event_accel.a 00:04:30.262 SO libspdk_event_accel.so.5.0 00:04:30.262 SYMLINK libspdk_event_accel.so 00:04:30.519 CC module/event/subsystems/bdev/bdev.o 00:04:30.519 LIB libspdk_event_bdev.a 00:04:30.519 SO libspdk_event_bdev.so.5.0 00:04:30.777 SYMLINK libspdk_event_bdev.so 00:04:30.777 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:04:30.777 CC module/event/subsystems/nbd/nbd.o 00:04:30.777 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:04:30.777 CC module/event/subsystems/scsi/scsi.o 00:04:30.777 CC module/event/subsystems/ublk/ublk.o 00:04:30.777 LIB libspdk_event_nbd.a 00:04:30.777 LIB libspdk_event_ublk.a 00:04:31.035 LIB libspdk_event_scsi.a 00:04:31.035 SO libspdk_event_nbd.so.5.0 00:04:31.035 SO libspdk_event_ublk.so.2.0 00:04:31.035 SO libspdk_event_scsi.so.5.0 00:04:31.035 SYMLINK libspdk_event_nbd.so 00:04:31.035 SYMLINK libspdk_event_ublk.so 00:04:31.035 SYMLINK libspdk_event_scsi.so 00:04:31.035 LIB libspdk_event_nvmf.a 00:04:31.035 SO libspdk_event_nvmf.so.5.0 00:04:31.035 SYMLINK libspdk_event_nvmf.so 00:04:31.035 CC module/event/subsystems/iscsi/iscsi.o 00:04:31.035 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:04:31.294 LIB libspdk_event_vhost_scsi.a 00:04:31.294 LIB libspdk_event_iscsi.a 00:04:31.294 SO libspdk_event_vhost_scsi.so.2.0 00:04:31.294 SO libspdk_event_iscsi.so.5.0 00:04:31.294 SYMLINK libspdk_event_vhost_scsi.so 00:04:31.294 SYMLINK libspdk_event_iscsi.so 00:04:31.294 SO libspdk.so.5.0 00:04:31.294 SYMLINK libspdk.so 00:04:31.559 CC app/spdk_lspci/spdk_lspci.o 00:04:31.559 CXX app/trace/trace.o 00:04:31.559 CC app/spdk_nvme_identify/identify.o 00:04:31.559 CC app/trace_record/trace_record.o 00:04:31.559 CC app/spdk_nvme_discover/discovery_aer.o 00:04:31.559 TEST_HEADER include/spdk/accel.h 00:04:31.559 CC app/spdk_top/spdk_top.o 00:04:31.559 TEST_HEADER include/spdk/accel_module.h 00:04:31.559 TEST_HEADER include/spdk/assert.h 00:04:31.559 TEST_HEADER include/spdk/barrier.h 00:04:31.559 CC app/spdk_nvme_perf/perf.o 00:04:31.559 TEST_HEADER include/spdk/base64.h 00:04:31.559 CC test/rpc_client/rpc_client_test.o 00:04:31.559 TEST_HEADER include/spdk/bdev.h 00:04:31.559 TEST_HEADER include/spdk/bdev_module.h 00:04:31.560 TEST_HEADER include/spdk/bdev_zone.h 00:04:31.560 TEST_HEADER include/spdk/bit_array.h 00:04:31.560 TEST_HEADER include/spdk/bit_pool.h 00:04:31.560 TEST_HEADER include/spdk/blob_bdev.h 00:04:31.560 TEST_HEADER include/spdk/blobfs_bdev.h 00:04:31.560 TEST_HEADER include/spdk/blobfs.h 00:04:31.560 TEST_HEADER include/spdk/blob.h 00:04:31.560 TEST_HEADER include/spdk/conf.h 00:04:31.560 CC app/spdk_dd/spdk_dd.o 00:04:31.560 TEST_HEADER include/spdk/config.h 00:04:31.560 TEST_HEADER include/spdk/cpuset.h 00:04:31.560 TEST_HEADER include/spdk/crc16.h 00:04:31.560 CC examples/interrupt_tgt/interrupt_tgt.o 00:04:31.560 TEST_HEADER include/spdk/crc32.h 00:04:31.560 TEST_HEADER include/spdk/crc64.h 00:04:31.560 TEST_HEADER include/spdk/dif.h 00:04:31.560 TEST_HEADER include/spdk/dma.h 00:04:31.560 CC app/iscsi_tgt/iscsi_tgt.o 00:04:31.560 CC app/nvmf_tgt/nvmf_main.o 00:04:31.560 TEST_HEADER include/spdk/endian.h 00:04:31.560 TEST_HEADER include/spdk/env_dpdk.h 00:04:31.560 TEST_HEADER include/spdk/env.h 00:04:31.560 CC app/vhost/vhost.o 00:04:31.560 TEST_HEADER include/spdk/event.h 00:04:31.560 CC examples/ioat/perf/perf.o 00:04:31.560 CC examples/util/zipf/zipf.o 00:04:31.560 TEST_HEADER include/spdk/fd_group.h 00:04:31.560 CC examples/sock/hello_world/hello_sock.o 00:04:31.560 CC examples/accel/perf/accel_perf.o 00:04:31.560 CC examples/idxd/perf/perf.o 00:04:31.560 CC examples/ioat/verify/verify.o 00:04:31.560 CC examples/vmd/lsvmd/lsvmd.o 00:04:31.560 CC app/fio/nvme/fio_plugin.o 00:04:31.560 TEST_HEADER include/spdk/fd.h 00:04:31.560 CC examples/vmd/led/led.o 00:04:31.560 TEST_HEADER include/spdk/file.h 00:04:31.560 CC examples/nvme/reconnect/reconnect.o 00:04:31.560 CC examples/nvme/nvme_manage/nvme_manage.o 00:04:31.560 CC examples/nvme/arbitration/arbitration.o 00:04:31.560 TEST_HEADER include/spdk/ftl.h 00:04:31.560 CC test/app/histogram_perf/histogram_perf.o 00:04:31.560 CC examples/nvme/hello_world/hello_world.o 00:04:31.818 TEST_HEADER include/spdk/gpt_spec.h 00:04:31.818 CC test/nvme/aer/aer.o 00:04:31.818 TEST_HEADER include/spdk/hexlify.h 00:04:31.818 CC test/thread/poller_perf/poller_perf.o 00:04:31.818 TEST_HEADER include/spdk/histogram_data.h 00:04:31.818 TEST_HEADER include/spdk/idxd.h 00:04:31.818 CC examples/nvme/hotplug/hotplug.o 00:04:31.818 CC test/event/event_perf/event_perf.o 00:04:31.818 TEST_HEADER include/spdk/idxd_spec.h 00:04:31.818 TEST_HEADER include/spdk/init.h 00:04:31.818 CC app/spdk_tgt/spdk_tgt.o 00:04:31.818 TEST_HEADER include/spdk/ioat.h 00:04:31.818 TEST_HEADER include/spdk/ioat_spec.h 00:04:31.818 TEST_HEADER include/spdk/iscsi_spec.h 00:04:31.818 TEST_HEADER include/spdk/json.h 00:04:31.819 TEST_HEADER include/spdk/jsonrpc.h 00:04:31.819 TEST_HEADER include/spdk/likely.h 00:04:31.819 CC examples/blob/cli/blobcli.o 00:04:31.819 CC examples/bdev/hello_world/hello_bdev.o 00:04:31.819 CC examples/blob/hello_world/hello_blob.o 00:04:31.819 TEST_HEADER include/spdk/log.h 00:04:31.819 TEST_HEADER include/spdk/lvol.h 00:04:31.819 TEST_HEADER include/spdk/memory.h 00:04:31.819 CC examples/bdev/bdevperf/bdevperf.o 00:04:31.819 CC test/blobfs/mkfs/mkfs.o 00:04:31.819 CC app/fio/bdev/fio_plugin.o 00:04:31.819 TEST_HEADER include/spdk/mmio.h 00:04:31.819 TEST_HEADER include/spdk/nbd.h 00:04:31.819 CC test/bdev/bdevio/bdevio.o 00:04:31.819 TEST_HEADER include/spdk/notify.h 00:04:31.819 CC examples/thread/thread/thread_ex.o 00:04:31.819 CC examples/nvmf/nvmf/nvmf.o 00:04:31.819 TEST_HEADER include/spdk/nvme.h 00:04:31.819 CC test/app/bdev_svc/bdev_svc.o 00:04:31.819 CC test/dma/test_dma/test_dma.o 00:04:31.819 TEST_HEADER include/spdk/nvme_intel.h 00:04:31.819 CC test/accel/dif/dif.o 00:04:31.819 TEST_HEADER include/spdk/nvme_ocssd.h 00:04:31.819 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:04:31.819 TEST_HEADER include/spdk/nvme_spec.h 00:04:31.819 TEST_HEADER include/spdk/nvme_zns.h 00:04:31.819 CC test/env/mem_callbacks/mem_callbacks.o 00:04:31.819 TEST_HEADER include/spdk/nvmf_cmd.h 00:04:31.819 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:04:31.819 TEST_HEADER include/spdk/nvmf.h 00:04:31.819 TEST_HEADER include/spdk/nvmf_spec.h 00:04:31.819 TEST_HEADER include/spdk/nvmf_transport.h 00:04:31.819 TEST_HEADER include/spdk/opal.h 00:04:31.819 TEST_HEADER include/spdk/opal_spec.h 00:04:31.819 TEST_HEADER include/spdk/pci_ids.h 00:04:31.819 CC test/lvol/esnap/esnap.o 00:04:31.819 TEST_HEADER include/spdk/pipe.h 00:04:31.819 TEST_HEADER include/spdk/queue.h 00:04:31.819 TEST_HEADER include/spdk/reduce.h 00:04:31.819 TEST_HEADER include/spdk/rpc.h 00:04:31.819 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:04:31.819 TEST_HEADER include/spdk/scheduler.h 00:04:31.819 TEST_HEADER include/spdk/scsi.h 00:04:31.819 TEST_HEADER include/spdk/scsi_spec.h 00:04:31.819 TEST_HEADER include/spdk/sock.h 00:04:31.819 TEST_HEADER include/spdk/stdinc.h 00:04:31.819 TEST_HEADER include/spdk/string.h 00:04:31.819 TEST_HEADER include/spdk/thread.h 00:04:31.819 LINK spdk_lspci 00:04:31.819 TEST_HEADER include/spdk/trace.h 00:04:31.819 TEST_HEADER include/spdk/trace_parser.h 00:04:31.819 TEST_HEADER include/spdk/tree.h 00:04:31.819 TEST_HEADER include/spdk/ublk.h 00:04:31.819 TEST_HEADER include/spdk/util.h 00:04:31.819 TEST_HEADER include/spdk/uuid.h 00:04:31.819 TEST_HEADER include/spdk/version.h 00:04:31.819 TEST_HEADER include/spdk/vfio_user_pci.h 00:04:31.819 TEST_HEADER include/spdk/vfio_user_spec.h 00:04:31.819 TEST_HEADER include/spdk/vhost.h 00:04:31.819 TEST_HEADER include/spdk/vmd.h 00:04:31.819 TEST_HEADER include/spdk/xor.h 00:04:31.819 TEST_HEADER include/spdk/zipf.h 00:04:31.819 CXX test/cpp_headers/accel.o 00:04:32.082 LINK lsvmd 00:04:32.082 LINK rpc_client_test 00:04:32.082 LINK spdk_nvme_discover 00:04:32.082 LINK histogram_perf 00:04:32.082 LINK zipf 00:04:32.082 LINK poller_perf 00:04:32.082 LINK led 00:04:32.082 LINK interrupt_tgt 00:04:32.082 LINK event_perf 00:04:32.082 LINK nvmf_tgt 00:04:32.082 LINK vhost 00:04:32.082 LINK spdk_trace_record 00:04:32.082 LINK iscsi_tgt 00:04:32.082 LINK ioat_perf 00:04:32.082 LINK verify 00:04:32.082 LINK bdev_svc 00:04:32.082 LINK spdk_tgt 00:04:32.082 LINK hello_world 00:04:32.082 LINK mkfs 00:04:32.082 LINK hello_sock 00:04:32.082 LINK mem_callbacks 00:04:32.082 LINK hotplug 00:04:32.082 LINK hello_blob 00:04:32.348 LINK hello_bdev 00:04:32.348 CXX test/cpp_headers/accel_module.o 00:04:32.348 CC test/env/vtophys/vtophys.o 00:04:32.348 LINK aer 00:04:32.348 LINK thread 00:04:32.348 LINK arbitration 00:04:32.348 LINK idxd_perf 00:04:32.348 LINK reconnect 00:04:32.348 LINK spdk_dd 00:04:32.348 LINK nvmf 00:04:32.348 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:04:32.348 CC test/app/jsoncat/jsoncat.o 00:04:32.348 CC examples/nvme/cmb_copy/cmb_copy.o 00:04:32.348 CXX test/cpp_headers/assert.o 00:04:32.348 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:04:32.348 LINK spdk_trace 00:04:32.348 CC test/app/stub/stub.o 00:04:32.348 CC test/event/reactor/reactor.o 00:04:32.348 CC test/nvme/reset/reset.o 00:04:32.348 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:04:32.348 CXX test/cpp_headers/barrier.o 00:04:32.348 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:04:32.611 LINK dif 00:04:32.611 CC test/nvme/sgl/sgl.o 00:04:32.611 CXX test/cpp_headers/base64.o 00:04:32.611 LINK test_dma 00:04:32.611 LINK bdevio 00:04:32.611 CC examples/nvme/abort/abort.o 00:04:32.611 CC test/env/memory/memory_ut.o 00:04:32.611 CXX test/cpp_headers/bdev.o 00:04:32.611 CXX test/cpp_headers/bdev_module.o 00:04:32.611 LINK vtophys 00:04:32.611 CC test/nvme/e2edp/nvme_dp.o 00:04:32.611 CC test/event/reactor_perf/reactor_perf.o 00:04:32.611 LINK accel_perf 00:04:32.611 CC test/env/pci/pci_ut.o 00:04:32.611 CXX test/cpp_headers/bdev_zone.o 00:04:32.611 LINK nvme_fuzz 00:04:32.611 CXX test/cpp_headers/bit_array.o 00:04:32.611 CC test/nvme/overhead/overhead.o 00:04:32.611 LINK nvme_manage 00:04:32.611 CXX test/cpp_headers/bit_pool.o 00:04:32.611 LINK jsoncat 00:04:32.611 CXX test/cpp_headers/blob_bdev.o 00:04:32.611 CC test/nvme/err_injection/err_injection.o 00:04:32.611 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:04:32.611 CC test/event/app_repeat/app_repeat.o 00:04:32.611 LINK blobcli 00:04:32.611 LINK reactor 00:04:32.611 LINK spdk_nvme 00:04:32.874 LINK spdk_bdev 00:04:32.874 CXX test/cpp_headers/blobfs_bdev.o 00:04:32.874 LINK cmb_copy 00:04:32.874 LINK stub 00:04:32.874 CXX test/cpp_headers/blobfs.o 00:04:32.874 CC test/nvme/startup/startup.o 00:04:32.874 LINK env_dpdk_post_init 00:04:32.874 CC test/nvme/reserve/reserve.o 00:04:32.874 CC test/event/scheduler/scheduler.o 00:04:32.874 CC test/nvme/boot_partition/boot_partition.o 00:04:32.874 CC test/nvme/connect_stress/connect_stress.o 00:04:32.874 CC test/nvme/simple_copy/simple_copy.o 00:04:32.874 LINK reactor_perf 00:04:32.874 CXX test/cpp_headers/blob.o 00:04:32.874 CXX test/cpp_headers/conf.o 00:04:32.874 CXX test/cpp_headers/config.o 00:04:32.874 LINK reset 00:04:32.874 CC test/nvme/compliance/nvme_compliance.o 00:04:32.874 CXX test/cpp_headers/cpuset.o 00:04:32.874 CXX test/cpp_headers/crc16.o 00:04:32.874 CC test/nvme/fused_ordering/fused_ordering.o 00:04:32.874 CXX test/cpp_headers/crc32.o 00:04:32.874 CXX test/cpp_headers/crc64.o 00:04:32.874 CXX test/cpp_headers/dif.o 00:04:32.874 CXX test/cpp_headers/dma.o 00:04:32.874 CC test/nvme/doorbell_aers/doorbell_aers.o 00:04:32.874 LINK app_repeat 00:04:33.146 CXX test/cpp_headers/endian.o 00:04:33.146 CXX test/cpp_headers/env_dpdk.o 00:04:33.146 CC test/nvme/fdp/fdp.o 00:04:33.146 CXX test/cpp_headers/env.o 00:04:33.146 CXX test/cpp_headers/event.o 00:04:33.146 LINK sgl 00:04:33.146 LINK pmr_persistence 00:04:33.146 CC test/nvme/cuse/cuse.o 00:04:33.146 LINK err_injection 00:04:33.146 CXX test/cpp_headers/fd_group.o 00:04:33.146 LINK nvme_dp 00:04:33.146 CXX test/cpp_headers/fd.o 00:04:33.146 CXX test/cpp_headers/file.o 00:04:33.146 CXX test/cpp_headers/ftl.o 00:04:33.146 CXX test/cpp_headers/gpt_spec.o 00:04:33.146 LINK startup 00:04:33.146 CXX test/cpp_headers/hexlify.o 00:04:33.146 CXX test/cpp_headers/histogram_data.o 00:04:33.146 CXX test/cpp_headers/idxd.o 00:04:33.146 LINK overhead 00:04:33.146 LINK spdk_nvme_identify 00:04:33.146 LINK spdk_nvme_perf 00:04:33.146 LINK boot_partition 00:04:33.146 LINK reserve 00:04:33.146 LINK vhost_fuzz 00:04:33.146 LINK bdevperf 00:04:33.146 CXX test/cpp_headers/idxd_spec.o 00:04:33.146 LINK connect_stress 00:04:33.146 LINK scheduler 00:04:33.146 LINK abort 00:04:33.146 LINK spdk_top 00:04:33.409 CXX test/cpp_headers/init.o 00:04:33.409 CXX test/cpp_headers/ioat.o 00:04:33.409 CXX test/cpp_headers/ioat_spec.o 00:04:33.409 LINK pci_ut 00:04:33.409 CXX test/cpp_headers/iscsi_spec.o 00:04:33.409 CXX test/cpp_headers/json.o 00:04:33.409 LINK simple_copy 00:04:33.409 CXX test/cpp_headers/jsonrpc.o 00:04:33.409 CXX test/cpp_headers/likely.o 00:04:33.409 CXX test/cpp_headers/log.o 00:04:33.409 LINK fused_ordering 00:04:33.409 CXX test/cpp_headers/lvol.o 00:04:33.409 CXX test/cpp_headers/memory.o 00:04:33.409 CXX test/cpp_headers/mmio.o 00:04:33.409 LINK doorbell_aers 00:04:33.409 CXX test/cpp_headers/nbd.o 00:04:33.409 CXX test/cpp_headers/notify.o 00:04:33.409 CXX test/cpp_headers/nvme.o 00:04:33.409 CXX test/cpp_headers/nvme_intel.o 00:04:33.409 CXX test/cpp_headers/nvme_ocssd.o 00:04:33.409 CXX test/cpp_headers/nvme_ocssd_spec.o 00:04:33.409 CXX test/cpp_headers/nvme_spec.o 00:04:33.409 CXX test/cpp_headers/nvme_zns.o 00:04:33.409 CXX test/cpp_headers/nvmf_cmd.o 00:04:33.409 CXX test/cpp_headers/nvmf_fc_spec.o 00:04:33.409 CXX test/cpp_headers/nvmf.o 00:04:33.409 LINK memory_ut 00:04:33.409 CXX test/cpp_headers/nvmf_spec.o 00:04:33.409 CXX test/cpp_headers/nvmf_transport.o 00:04:33.409 CXX test/cpp_headers/opal.o 00:04:33.409 CXX test/cpp_headers/opal_spec.o 00:04:33.671 CXX test/cpp_headers/pci_ids.o 00:04:33.671 CXX test/cpp_headers/pipe.o 00:04:33.671 CXX test/cpp_headers/queue.o 00:04:33.671 CXX test/cpp_headers/reduce.o 00:04:33.671 CXX test/cpp_headers/rpc.o 00:04:33.671 CXX test/cpp_headers/scheduler.o 00:04:33.671 CXX test/cpp_headers/scsi.o 00:04:33.671 CXX test/cpp_headers/scsi_spec.o 00:04:33.671 CXX test/cpp_headers/sock.o 00:04:33.671 CXX test/cpp_headers/stdinc.o 00:04:33.671 CXX test/cpp_headers/string.o 00:04:33.671 CXX test/cpp_headers/thread.o 00:04:33.671 LINK nvme_compliance 00:04:33.671 CXX test/cpp_headers/trace.o 00:04:33.671 CXX test/cpp_headers/trace_parser.o 00:04:33.671 CXX test/cpp_headers/tree.o 00:04:33.671 LINK fdp 00:04:33.671 CXX test/cpp_headers/ublk.o 00:04:33.671 CXX test/cpp_headers/util.o 00:04:33.671 CXX test/cpp_headers/uuid.o 00:04:33.671 CXX test/cpp_headers/version.o 00:04:33.671 CXX test/cpp_headers/vfio_user_pci.o 00:04:33.671 CXX test/cpp_headers/vfio_user_spec.o 00:04:33.671 CXX test/cpp_headers/vhost.o 00:04:33.671 CXX test/cpp_headers/vmd.o 00:04:33.671 CXX test/cpp_headers/xor.o 00:04:33.671 CXX test/cpp_headers/zipf.o 00:04:34.604 LINK cuse 00:04:34.863 LINK iscsi_fuzz 00:04:37.392 LINK esnap 00:04:37.392 00:04:37.392 real 0m37.765s 00:04:37.392 user 7m13.952s 00:04:37.392 sys 1m38.463s 00:04:37.392 16:29:02 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:04:37.392 16:29:02 -- common/autotest_common.sh@10 -- $ set +x 00:04:37.392 ************************************ 00:04:37.392 END TEST make 00:04:37.392 ************************************ 00:04:37.650 16:29:02 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:37.650 16:29:02 -- nvmf/common.sh@7 -- # uname -s 00:04:37.650 16:29:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:37.650 16:29:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:37.650 16:29:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:37.650 16:29:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:37.650 16:29:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:37.650 16:29:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:37.650 16:29:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:37.650 16:29:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:37.650 16:29:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:37.650 16:29:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:37.650 16:29:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:37.650 16:29:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:37.650 16:29:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:37.650 16:29:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:37.650 16:29:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:04:37.650 16:29:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:37.650 16:29:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:37.650 16:29:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:37.650 16:29:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:37.650 16:29:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.650 16:29:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.650 16:29:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.650 16:29:02 -- paths/export.sh@5 -- # export PATH 00:04:37.650 16:29:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.650 16:29:02 -- nvmf/common.sh@46 -- # : 0 00:04:37.650 16:29:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:37.650 16:29:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:37.650 16:29:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:37.650 16:29:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:37.650 16:29:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:37.650 16:29:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:37.650 16:29:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:37.650 16:29:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:37.650 16:29:02 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:04:37.650 16:29:02 -- spdk/autotest.sh@32 -- # uname -s 00:04:37.650 16:29:02 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:04:37.650 16:29:02 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:04:37.650 16:29:02 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:37.650 16:29:02 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:04:37.650 16:29:02 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:37.650 16:29:02 -- spdk/autotest.sh@44 -- # modprobe nbd 00:04:37.650 16:29:02 -- spdk/autotest.sh@46 -- # type -P udevadm 00:04:37.650 16:29:02 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:04:37.650 16:29:02 -- spdk/autotest.sh@48 -- # udevadm_pid=1044952 00:04:37.650 16:29:02 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:04:37.650 16:29:02 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:37.650 16:29:02 -- spdk/autotest.sh@54 -- # echo 1044954 00:04:37.650 16:29:02 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:37.650 16:29:02 -- spdk/autotest.sh@56 -- # echo 1044955 00:04:37.650 16:29:02 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:04:37.650 16:29:02 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:37.650 16:29:02 -- spdk/autotest.sh@60 -- # echo 1044956 00:04:37.650 16:29:02 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:37.650 16:29:02 -- spdk/autotest.sh@62 -- # echo 1044957 00:04:37.650 16:29:02 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:04:37.650 16:29:02 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:37.650 16:29:02 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:04:37.650 16:29:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:37.650 16:29:02 -- common/autotest_common.sh@10 -- # set +x 00:04:37.650 16:29:02 -- spdk/autotest.sh@70 -- # create_test_list 00:04:37.650 16:29:02 -- common/autotest_common.sh@736 -- # xtrace_disable 00:04:37.650 16:29:02 -- common/autotest_common.sh@10 -- # set +x 00:04:37.651 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:04:37.651 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:04:37.651 16:29:03 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:04:37.651 16:29:03 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:37.651 16:29:03 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:37.651 16:29:03 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:04:37.651 16:29:03 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:37.651 16:29:03 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:04:37.651 16:29:03 -- common/autotest_common.sh@1440 -- # uname 00:04:37.651 16:29:03 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:04:37.651 16:29:03 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:04:37.651 16:29:03 -- common/autotest_common.sh@1460 -- # uname 00:04:37.651 16:29:03 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:04:37.651 16:29:03 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:04:37.651 16:29:03 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:04:37.651 16:29:03 -- spdk/autotest.sh@83 -- # hash lcov 00:04:37.651 16:29:03 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:04:37.651 16:29:03 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:04:37.651 --rc lcov_branch_coverage=1 00:04:37.651 --rc lcov_function_coverage=1 00:04:37.651 --rc genhtml_branch_coverage=1 00:04:37.651 --rc genhtml_function_coverage=1 00:04:37.651 --rc genhtml_legend=1 00:04:37.651 --rc geninfo_all_blocks=1 00:04:37.651 ' 00:04:37.651 16:29:03 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:04:37.651 --rc lcov_branch_coverage=1 00:04:37.651 --rc lcov_function_coverage=1 00:04:37.651 --rc genhtml_branch_coverage=1 00:04:37.651 --rc genhtml_function_coverage=1 00:04:37.651 --rc genhtml_legend=1 00:04:37.651 --rc geninfo_all_blocks=1 00:04:37.651 ' 00:04:37.651 16:29:03 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:04:37.651 --rc lcov_branch_coverage=1 00:04:37.651 --rc lcov_function_coverage=1 00:04:37.651 --rc genhtml_branch_coverage=1 00:04:37.651 --rc genhtml_function_coverage=1 00:04:37.651 --rc genhtml_legend=1 00:04:37.651 --rc geninfo_all_blocks=1 00:04:37.651 --no-external' 00:04:37.651 16:29:03 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:04:37.651 --rc lcov_branch_coverage=1 00:04:37.651 --rc lcov_function_coverage=1 00:04:37.651 --rc genhtml_branch_coverage=1 00:04:37.651 --rc genhtml_function_coverage=1 00:04:37.651 --rc genhtml_legend=1 00:04:37.651 --rc geninfo_all_blocks=1 00:04:37.651 --no-external' 00:04:37.651 16:29:03 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:04:37.651 lcov: LCOV version 1.15 00:04:37.651 16:29:03 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:04:39.557 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:04:39.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:04:39.558 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:04:39.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:04:39.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:04:39.559 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:04:39.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:04:39.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:04:39.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:04:39.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:04:39.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:04:39.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:04:39.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:04:39.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:04:39.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:04:39.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:04:57.927 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:57.927 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:57.927 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:57.927 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:57.927 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:57.927 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:05:12.817 16:29:36 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:05:12.817 16:29:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:12.817 16:29:36 -- common/autotest_common.sh@10 -- # set +x 00:05:12.817 16:29:36 -- spdk/autotest.sh@102 -- # rm -f 00:05:12.817 16:29:36 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:12.817 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:05:12.817 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:05:12.817 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:05:12.817 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:05:12.817 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:05:12.817 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:05:12.817 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:05:12.817 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:05:12.817 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:05:12.817 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:05:12.817 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:05:12.817 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:05:13.075 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:05:13.075 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:05:13.075 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:05:13.075 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:05:13.075 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:05:13.075 16:29:38 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:05:13.075 16:29:38 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:05:13.075 16:29:38 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:05:13.075 16:29:38 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:05:13.075 16:29:38 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:05:13.075 16:29:38 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:05:13.075 16:29:38 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:05:13.075 16:29:38 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:13.075 16:29:38 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:05:13.075 16:29:38 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:05:13.075 16:29:38 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:05:13.075 16:29:38 -- spdk/autotest.sh@121 -- # grep -v p 00:05:13.075 16:29:38 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:05:13.075 16:29:38 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:05:13.075 16:29:38 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:05:13.075 16:29:38 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:05:13.075 16:29:38 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:05:13.075 No valid GPT data, bailing 00:05:13.075 16:29:38 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:13.075 16:29:38 -- scripts/common.sh@393 -- # pt= 00:05:13.075 16:29:38 -- scripts/common.sh@394 -- # return 1 00:05:13.075 16:29:38 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:05:13.075 1+0 records in 00:05:13.075 1+0 records out 00:05:13.075 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00260743 s, 402 MB/s 00:05:13.075 16:29:38 -- spdk/autotest.sh@129 -- # sync 00:05:13.075 16:29:38 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:05:13.075 16:29:38 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:05:13.075 16:29:38 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:05:14.972 16:29:40 -- spdk/autotest.sh@135 -- # uname -s 00:05:14.972 16:29:40 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:05:14.972 16:29:40 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:05:14.973 16:29:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:14.973 16:29:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.973 16:29:40 -- common/autotest_common.sh@10 -- # set +x 00:05:14.973 ************************************ 00:05:14.973 START TEST setup.sh 00:05:14.973 ************************************ 00:05:14.973 16:29:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:05:15.230 * Looking for test storage... 00:05:15.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:15.230 16:29:40 -- setup/test-setup.sh@10 -- # uname -s 00:05:15.230 16:29:40 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:05:15.230 16:29:40 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:05:15.230 16:29:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.230 16:29:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.230 16:29:40 -- common/autotest_common.sh@10 -- # set +x 00:05:15.230 ************************************ 00:05:15.230 START TEST acl 00:05:15.230 ************************************ 00:05:15.230 16:29:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:05:15.230 * Looking for test storage... 00:05:15.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:15.230 16:29:40 -- setup/acl.sh@10 -- # get_zoned_devs 00:05:15.230 16:29:40 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:05:15.230 16:29:40 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:05:15.230 16:29:40 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:05:15.230 16:29:40 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:05:15.230 16:29:40 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:05:15.230 16:29:40 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:05:15.230 16:29:40 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:15.230 16:29:40 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:05:15.230 16:29:40 -- setup/acl.sh@12 -- # devs=() 00:05:15.230 16:29:40 -- setup/acl.sh@12 -- # declare -a devs 00:05:15.230 16:29:40 -- setup/acl.sh@13 -- # drivers=() 00:05:15.230 16:29:40 -- setup/acl.sh@13 -- # declare -A drivers 00:05:15.230 16:29:40 -- setup/acl.sh@51 -- # setup reset 00:05:15.230 16:29:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:15.230 16:29:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:17.169 16:29:42 -- setup/acl.sh@52 -- # collect_setup_devs 00:05:17.169 16:29:42 -- setup/acl.sh@16 -- # local dev driver 00:05:17.169 16:29:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:17.169 16:29:42 -- setup/acl.sh@15 -- # setup output status 00:05:17.169 16:29:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:17.169 16:29:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:17.769 Hugepages 00:05:17.769 node hugesize free / total 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # continue 00:05:17.769 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # continue 00:05:17.769 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # continue 00:05:17.769 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:17.769 00:05:17.769 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:05:17.769 16:29:43 -- setup/acl.sh@19 -- # continue 00:05:17.769 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.029 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.029 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.029 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.030 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.030 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:05:18.030 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.030 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.030 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.030 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:05:18.030 16:29:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:05:18.030 16:29:43 -- setup/acl.sh@20 -- # continue 00:05:18.030 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.030 16:29:43 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:05:18.030 16:29:43 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:05:18.030 16:29:43 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:18.030 16:29:43 -- setup/acl.sh@22 -- # devs+=("$dev") 00:05:18.030 16:29:43 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:05:18.030 16:29:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:05:18.030 16:29:43 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:05:18.030 16:29:43 -- setup/acl.sh@54 -- # run_test denied denied 00:05:18.030 16:29:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:18.030 16:29:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:18.030 16:29:43 -- common/autotest_common.sh@10 -- # set +x 00:05:18.030 ************************************ 00:05:18.030 START TEST denied 00:05:18.030 ************************************ 00:05:18.030 16:29:43 -- common/autotest_common.sh@1104 -- # denied 00:05:18.030 16:29:43 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:05:18.030 16:29:43 -- setup/acl.sh@38 -- # setup output config 00:05:18.030 16:29:43 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:05:18.030 16:29:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:18.030 16:29:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:19.935 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:05:19.935 16:29:45 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:05:19.935 16:29:45 -- setup/acl.sh@28 -- # local dev driver 00:05:19.935 16:29:45 -- setup/acl.sh@30 -- # for dev in "$@" 00:05:19.935 16:29:45 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:05:19.935 16:29:45 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:05:19.935 16:29:45 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:05:19.935 16:29:45 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:05:19.935 16:29:45 -- setup/acl.sh@41 -- # setup reset 00:05:19.935 16:29:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:19.935 16:29:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:22.468 00:05:22.468 real 0m4.172s 00:05:22.468 user 0m1.195s 00:05:22.468 sys 0m2.050s 00:05:22.468 16:29:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.468 16:29:47 -- common/autotest_common.sh@10 -- # set +x 00:05:22.468 ************************************ 00:05:22.468 END TEST denied 00:05:22.468 ************************************ 00:05:22.468 16:29:47 -- setup/acl.sh@55 -- # run_test allowed allowed 00:05:22.468 16:29:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:22.468 16:29:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.468 16:29:47 -- common/autotest_common.sh@10 -- # set +x 00:05:22.468 ************************************ 00:05:22.468 START TEST allowed 00:05:22.468 ************************************ 00:05:22.468 16:29:47 -- common/autotest_common.sh@1104 -- # allowed 00:05:22.468 16:29:47 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:05:22.468 16:29:47 -- setup/acl.sh@45 -- # setup output config 00:05:22.468 16:29:47 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:05:22.468 16:29:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:22.468 16:29:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:24.999 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:24.999 16:29:50 -- setup/acl.sh@47 -- # verify 00:05:24.999 16:29:50 -- setup/acl.sh@28 -- # local dev driver 00:05:24.999 16:29:50 -- setup/acl.sh@48 -- # setup reset 00:05:24.999 16:29:50 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:24.999 16:29:50 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:26.379 00:05:26.379 real 0m4.120s 00:05:26.379 user 0m1.044s 00:05:26.379 sys 0m1.945s 00:05:26.379 16:29:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:26.379 16:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.379 ************************************ 00:05:26.379 END TEST allowed 00:05:26.379 ************************************ 00:05:26.379 00:05:26.379 real 0m11.206s 00:05:26.379 user 0m3.336s 00:05:26.379 sys 0m5.905s 00:05:26.379 16:29:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:26.379 16:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.379 ************************************ 00:05:26.379 END TEST acl 00:05:26.379 ************************************ 00:05:26.379 16:29:51 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:05:26.379 16:29:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:26.379 16:29:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:26.379 16:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.379 ************************************ 00:05:26.379 START TEST hugepages 00:05:26.379 ************************************ 00:05:26.379 16:29:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:05:26.379 * Looking for test storage... 00:05:26.379 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:26.379 16:29:51 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:05:26.379 16:29:51 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:05:26.379 16:29:51 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:05:26.379 16:29:51 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:05:26.379 16:29:51 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:05:26.379 16:29:51 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:05:26.379 16:29:51 -- setup/common.sh@17 -- # local get=Hugepagesize 00:05:26.379 16:29:51 -- setup/common.sh@18 -- # local node= 00:05:26.379 16:29:51 -- setup/common.sh@19 -- # local var val 00:05:26.379 16:29:51 -- setup/common.sh@20 -- # local mem_f mem 00:05:26.379 16:29:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:26.379 16:29:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:26.379 16:29:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:26.379 16:29:51 -- setup/common.sh@28 -- # mapfile -t mem 00:05:26.379 16:29:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41961804 kB' 'MemAvailable: 45709104 kB' 'Buffers: 2708 kB' 'Cached: 11975348 kB' 'SwapCached: 0 kB' 'Active: 8664984 kB' 'Inactive: 3752644 kB' 'Active(anon): 8272872 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443204 kB' 'Mapped: 189564 kB' 'Shmem: 7833300 kB' 'KReclaimable: 192736 kB' 'Slab: 665880 kB' 'SReclaimable: 192736 kB' 'SUnreclaim: 473144 kB' 'KernelStack: 12752 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 9353552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.379 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.379 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.380 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.380 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # continue 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # IFS=': ' 00:05:26.381 16:29:51 -- setup/common.sh@31 -- # read -r var val _ 00:05:26.381 16:29:51 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:26.381 16:29:51 -- setup/common.sh@33 -- # echo 2048 00:05:26.381 16:29:51 -- setup/common.sh@33 -- # return 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:05:26.381 16:29:51 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:05:26.381 16:29:51 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:05:26.381 16:29:51 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:05:26.381 16:29:51 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:05:26.381 16:29:51 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:05:26.381 16:29:51 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:05:26.381 16:29:51 -- setup/hugepages.sh@207 -- # get_nodes 00:05:26.381 16:29:51 -- setup/hugepages.sh@27 -- # local node 00:05:26.381 16:29:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:26.381 16:29:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:05:26.381 16:29:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:26.381 16:29:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:26.381 16:29:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:26.381 16:29:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:26.381 16:29:51 -- setup/hugepages.sh@208 -- # clear_hp 00:05:26.381 16:29:51 -- setup/hugepages.sh@37 -- # local node hp 00:05:26.381 16:29:51 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:26.381 16:29:51 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:26.381 16:29:51 -- setup/hugepages.sh@41 -- # echo 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:26.381 16:29:51 -- setup/hugepages.sh@41 -- # echo 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:26.381 16:29:51 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:26.381 16:29:51 -- setup/hugepages.sh@41 -- # echo 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:26.381 16:29:51 -- setup/hugepages.sh@41 -- # echo 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:26.381 16:29:51 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:26.381 16:29:51 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:05:26.381 16:29:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:26.381 16:29:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:26.381 16:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.381 ************************************ 00:05:26.381 START TEST default_setup 00:05:26.381 ************************************ 00:05:26.381 16:29:51 -- common/autotest_common.sh@1104 -- # default_setup 00:05:26.381 16:29:51 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:26.381 16:29:51 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:05:26.381 16:29:51 -- setup/hugepages.sh@51 -- # shift 00:05:26.381 16:29:51 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:05:26.381 16:29:51 -- setup/hugepages.sh@52 -- # local node_ids 00:05:26.381 16:29:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:26.381 16:29:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:26.381 16:29:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:05:26.381 16:29:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:26.381 16:29:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:26.381 16:29:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:26.381 16:29:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:26.381 16:29:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:26.381 16:29:51 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:05:26.381 16:29:51 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:26.381 16:29:51 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:05:26.381 16:29:51 -- setup/hugepages.sh@73 -- # return 0 00:05:26.381 16:29:51 -- setup/hugepages.sh@137 -- # setup output 00:05:26.381 16:29:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:26.381 16:29:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:27.760 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:27.760 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:27.760 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:28.700 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:28.700 16:29:54 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:05:28.700 16:29:54 -- setup/hugepages.sh@89 -- # local node 00:05:28.700 16:29:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:28.700 16:29:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:28.700 16:29:54 -- setup/hugepages.sh@92 -- # local surp 00:05:28.700 16:29:54 -- setup/hugepages.sh@93 -- # local resv 00:05:28.700 16:29:54 -- setup/hugepages.sh@94 -- # local anon 00:05:28.700 16:29:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:28.700 16:29:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:28.700 16:29:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:28.700 16:29:54 -- setup/common.sh@18 -- # local node= 00:05:28.700 16:29:54 -- setup/common.sh@19 -- # local var val 00:05:28.700 16:29:54 -- setup/common.sh@20 -- # local mem_f mem 00:05:28.700 16:29:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:28.700 16:29:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:28.700 16:29:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:28.700 16:29:54 -- setup/common.sh@28 -- # mapfile -t mem 00:05:28.700 16:29:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44076244 kB' 'MemAvailable: 47823464 kB' 'Buffers: 2708 kB' 'Cached: 11975708 kB' 'SwapCached: 0 kB' 'Active: 8682424 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290312 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459828 kB' 'Mapped: 189672 kB' 'Shmem: 7833660 kB' 'KReclaimable: 192576 kB' 'Slab: 665488 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 472912 kB' 'KernelStack: 12704 kB' 'PageTables: 7372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.700 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.700 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.962 16:29:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:28.962 16:29:54 -- setup/common.sh@33 -- # echo 0 00:05:28.962 16:29:54 -- setup/common.sh@33 -- # return 0 00:05:28.962 16:29:54 -- setup/hugepages.sh@97 -- # anon=0 00:05:28.962 16:29:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:28.962 16:29:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:28.962 16:29:54 -- setup/common.sh@18 -- # local node= 00:05:28.962 16:29:54 -- setup/common.sh@19 -- # local var val 00:05:28.962 16:29:54 -- setup/common.sh@20 -- # local mem_f mem 00:05:28.962 16:29:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:28.962 16:29:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:28.962 16:29:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:28.962 16:29:54 -- setup/common.sh@28 -- # mapfile -t mem 00:05:28.962 16:29:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.962 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44075972 kB' 'MemAvailable: 47823192 kB' 'Buffers: 2708 kB' 'Cached: 11975712 kB' 'SwapCached: 0 kB' 'Active: 8682472 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290360 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459952 kB' 'Mapped: 189724 kB' 'Shmem: 7833664 kB' 'KReclaimable: 192576 kB' 'Slab: 665492 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 472916 kB' 'KernelStack: 12768 kB' 'PageTables: 7860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.963 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.963 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.964 16:29:54 -- setup/common.sh@33 -- # echo 0 00:05:28.964 16:29:54 -- setup/common.sh@33 -- # return 0 00:05:28.964 16:29:54 -- setup/hugepages.sh@99 -- # surp=0 00:05:28.964 16:29:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:28.964 16:29:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:28.964 16:29:54 -- setup/common.sh@18 -- # local node= 00:05:28.964 16:29:54 -- setup/common.sh@19 -- # local var val 00:05:28.964 16:29:54 -- setup/common.sh@20 -- # local mem_f mem 00:05:28.964 16:29:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:28.964 16:29:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:28.964 16:29:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:28.964 16:29:54 -- setup/common.sh@28 -- # mapfile -t mem 00:05:28.964 16:29:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44076140 kB' 'MemAvailable: 47823360 kB' 'Buffers: 2708 kB' 'Cached: 11975724 kB' 'SwapCached: 0 kB' 'Active: 8682384 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290272 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459788 kB' 'Mapped: 189648 kB' 'Shmem: 7833676 kB' 'KReclaimable: 192576 kB' 'Slab: 665540 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 472964 kB' 'KernelStack: 12784 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.964 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.964 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:28.965 16:29:54 -- setup/common.sh@33 -- # echo 0 00:05:28.965 16:29:54 -- setup/common.sh@33 -- # return 0 00:05:28.965 16:29:54 -- setup/hugepages.sh@100 -- # resv=0 00:05:28.965 16:29:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:28.965 nr_hugepages=1024 00:05:28.965 16:29:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:28.965 resv_hugepages=0 00:05:28.965 16:29:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:28.965 surplus_hugepages=0 00:05:28.965 16:29:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:28.965 anon_hugepages=0 00:05:28.965 16:29:54 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:28.965 16:29:54 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:28.965 16:29:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:28.965 16:29:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:28.965 16:29:54 -- setup/common.sh@18 -- # local node= 00:05:28.965 16:29:54 -- setup/common.sh@19 -- # local var val 00:05:28.965 16:29:54 -- setup/common.sh@20 -- # local mem_f mem 00:05:28.965 16:29:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:28.965 16:29:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:28.965 16:29:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:28.965 16:29:54 -- setup/common.sh@28 -- # mapfile -t mem 00:05:28.965 16:29:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44076140 kB' 'MemAvailable: 47823360 kB' 'Buffers: 2708 kB' 'Cached: 11975740 kB' 'SwapCached: 0 kB' 'Active: 8682428 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290316 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459788 kB' 'Mapped: 189648 kB' 'Shmem: 7833692 kB' 'KReclaimable: 192576 kB' 'Slab: 665540 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 472964 kB' 'KernelStack: 12784 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374224 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.965 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.965 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.966 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.966 16:29:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:28.967 16:29:54 -- setup/common.sh@33 -- # echo 1024 00:05:28.967 16:29:54 -- setup/common.sh@33 -- # return 0 00:05:28.967 16:29:54 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:28.967 16:29:54 -- setup/hugepages.sh@112 -- # get_nodes 00:05:28.967 16:29:54 -- setup/hugepages.sh@27 -- # local node 00:05:28.967 16:29:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:28.967 16:29:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:28.967 16:29:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:28.967 16:29:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:28.967 16:29:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:28.967 16:29:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:28.967 16:29:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:28.967 16:29:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:28.967 16:29:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:28.967 16:29:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:28.967 16:29:54 -- setup/common.sh@18 -- # local node=0 00:05:28.967 16:29:54 -- setup/common.sh@19 -- # local var val 00:05:28.967 16:29:54 -- setup/common.sh@20 -- # local mem_f mem 00:05:28.967 16:29:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:28.967 16:29:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:28.967 16:29:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:28.967 16:29:54 -- setup/common.sh@28 -- # mapfile -t mem 00:05:28.967 16:29:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19006232 kB' 'MemUsed: 13868692 kB' 'SwapCached: 0 kB' 'Active: 6864268 kB' 'Inactive: 3635704 kB' 'Active(anon): 6674328 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150004 kB' 'Mapped: 112592 kB' 'AnonPages: 353096 kB' 'Shmem: 6324360 kB' 'KernelStack: 7960 kB' 'PageTables: 5140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112952 kB' 'Slab: 412076 kB' 'SReclaimable: 112952 kB' 'SUnreclaim: 299124 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.967 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.967 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # continue 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # IFS=': ' 00:05:28.968 16:29:54 -- setup/common.sh@31 -- # read -r var val _ 00:05:28.968 16:29:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:28.968 16:29:54 -- setup/common.sh@33 -- # echo 0 00:05:28.968 16:29:54 -- setup/common.sh@33 -- # return 0 00:05:28.968 16:29:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:28.968 16:29:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:28.968 16:29:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:28.968 16:29:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:28.968 16:29:54 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:28.968 node0=1024 expecting 1024 00:05:28.968 16:29:54 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:28.968 00:05:28.968 real 0m2.455s 00:05:28.968 user 0m0.666s 00:05:28.968 sys 0m0.921s 00:05:28.968 16:29:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.968 16:29:54 -- common/autotest_common.sh@10 -- # set +x 00:05:28.968 ************************************ 00:05:28.968 END TEST default_setup 00:05:28.968 ************************************ 00:05:28.968 16:29:54 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:05:28.968 16:29:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:28.968 16:29:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.968 16:29:54 -- common/autotest_common.sh@10 -- # set +x 00:05:28.968 ************************************ 00:05:28.968 START TEST per_node_1G_alloc 00:05:28.968 ************************************ 00:05:28.968 16:29:54 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:05:28.968 16:29:54 -- setup/hugepages.sh@143 -- # local IFS=, 00:05:28.968 16:29:54 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:05:28.968 16:29:54 -- setup/hugepages.sh@49 -- # local size=1048576 00:05:28.968 16:29:54 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:05:28.968 16:29:54 -- setup/hugepages.sh@51 -- # shift 00:05:28.968 16:29:54 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:05:28.968 16:29:54 -- setup/hugepages.sh@52 -- # local node_ids 00:05:28.968 16:29:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:28.968 16:29:54 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:05:28.968 16:29:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:05:28.968 16:29:54 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:05:28.968 16:29:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:28.968 16:29:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:05:28.968 16:29:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:28.968 16:29:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:28.968 16:29:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:28.968 16:29:54 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:05:28.968 16:29:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:28.968 16:29:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:05:28.968 16:29:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:28.968 16:29:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:05:28.968 16:29:54 -- setup/hugepages.sh@73 -- # return 0 00:05:28.968 16:29:54 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:05:28.968 16:29:54 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:05:28.968 16:29:54 -- setup/hugepages.sh@146 -- # setup output 00:05:28.968 16:29:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:28.968 16:29:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:30.349 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:30.349 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:30.349 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:30.349 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:30.349 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:30.349 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:30.349 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:30.349 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:30.349 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:30.349 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:30.349 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:30.349 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:30.349 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:30.349 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:30.349 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:30.349 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:30.349 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:30.349 16:29:55 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:05:30.349 16:29:55 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:05:30.349 16:29:55 -- setup/hugepages.sh@89 -- # local node 00:05:30.349 16:29:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:30.349 16:29:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:30.349 16:29:55 -- setup/hugepages.sh@92 -- # local surp 00:05:30.349 16:29:55 -- setup/hugepages.sh@93 -- # local resv 00:05:30.349 16:29:55 -- setup/hugepages.sh@94 -- # local anon 00:05:30.349 16:29:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:30.349 16:29:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:30.349 16:29:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:30.349 16:29:55 -- setup/common.sh@18 -- # local node= 00:05:30.349 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.349 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.349 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.349 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:30.349 16:29:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:30.349 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.349 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44060444 kB' 'MemAvailable: 47807664 kB' 'Buffers: 2708 kB' 'Cached: 11975800 kB' 'SwapCached: 0 kB' 'Active: 8683284 kB' 'Inactive: 3752644 kB' 'Active(anon): 8291172 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460764 kB' 'Mapped: 189660 kB' 'Shmem: 7833752 kB' 'KReclaimable: 192576 kB' 'Slab: 665672 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 473096 kB' 'KernelStack: 12848 kB' 'PageTables: 7988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.349 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.349 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:30.350 16:29:55 -- setup/common.sh@33 -- # echo 0 00:05:30.350 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.350 16:29:55 -- setup/hugepages.sh@97 -- # anon=0 00:05:30.350 16:29:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:30.350 16:29:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:30.350 16:29:55 -- setup/common.sh@18 -- # local node= 00:05:30.350 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.350 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.350 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.350 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:30.350 16:29:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:30.350 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.350 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44065552 kB' 'MemAvailable: 47812772 kB' 'Buffers: 2708 kB' 'Cached: 11975804 kB' 'SwapCached: 0 kB' 'Active: 8682536 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290424 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460020 kB' 'Mapped: 189652 kB' 'Shmem: 7833756 kB' 'KReclaimable: 192576 kB' 'Slab: 665740 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 473164 kB' 'KernelStack: 12832 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374420 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.350 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.350 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.351 16:29:55 -- setup/common.sh@33 -- # echo 0 00:05:30.351 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.351 16:29:55 -- setup/hugepages.sh@99 -- # surp=0 00:05:30.351 16:29:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:30.351 16:29:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:30.351 16:29:55 -- setup/common.sh@18 -- # local node= 00:05:30.351 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.351 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.351 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.351 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:30.351 16:29:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:30.351 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.351 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.351 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.351 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44066424 kB' 'MemAvailable: 47813644 kB' 'Buffers: 2708 kB' 'Cached: 11975804 kB' 'SwapCached: 0 kB' 'Active: 8682600 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290488 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460080 kB' 'Mapped: 189652 kB' 'Shmem: 7833756 kB' 'KReclaimable: 192576 kB' 'Slab: 665740 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 473164 kB' 'KernelStack: 12848 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374436 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.352 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.352 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.353 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.353 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:30.353 16:29:55 -- setup/common.sh@33 -- # echo 0 00:05:30.353 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.353 16:29:55 -- setup/hugepages.sh@100 -- # resv=0 00:05:30.353 16:29:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:30.353 nr_hugepages=1024 00:05:30.353 16:29:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:30.353 resv_hugepages=0 00:05:30.353 16:29:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:30.353 surplus_hugepages=0 00:05:30.353 16:29:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:30.353 anon_hugepages=0 00:05:30.353 16:29:55 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:30.353 16:29:55 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:30.353 16:29:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:30.353 16:29:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:30.353 16:29:55 -- setup/common.sh@18 -- # local node= 00:05:30.353 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.616 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.616 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.616 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:30.616 16:29:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:30.616 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.616 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.616 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.616 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44067224 kB' 'MemAvailable: 47814444 kB' 'Buffers: 2708 kB' 'Cached: 11975828 kB' 'SwapCached: 0 kB' 'Active: 8682492 kB' 'Inactive: 3752644 kB' 'Active(anon): 8290380 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459952 kB' 'Mapped: 189652 kB' 'Shmem: 7833780 kB' 'KReclaimable: 192576 kB' 'Slab: 665740 kB' 'SReclaimable: 192576 kB' 'SUnreclaim: 473164 kB' 'KernelStack: 12816 kB' 'PageTables: 7792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9374448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.617 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.617 16:29:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:30.618 16:29:55 -- setup/common.sh@33 -- # echo 1024 00:05:30.618 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.618 16:29:55 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:30.618 16:29:55 -- setup/hugepages.sh@112 -- # get_nodes 00:05:30.618 16:29:55 -- setup/hugepages.sh@27 -- # local node 00:05:30.618 16:29:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:30.618 16:29:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:30.618 16:29:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:30.618 16:29:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:30.618 16:29:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:30.618 16:29:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:30.618 16:29:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:30.618 16:29:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:30.618 16:29:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:30.618 16:29:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:30.618 16:29:55 -- setup/common.sh@18 -- # local node=0 00:05:30.618 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.618 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.618 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.618 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:30.618 16:29:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:30.618 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.618 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20052840 kB' 'MemUsed: 12822084 kB' 'SwapCached: 0 kB' 'Active: 6864184 kB' 'Inactive: 3635704 kB' 'Active(anon): 6674244 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150012 kB' 'Mapped: 112596 kB' 'AnonPages: 353080 kB' 'Shmem: 6324368 kB' 'KernelStack: 7976 kB' 'PageTables: 5132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112952 kB' 'Slab: 412128 kB' 'SReclaimable: 112952 kB' 'SUnreclaim: 299176 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.618 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.618 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@33 -- # echo 0 00:05:30.619 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.619 16:29:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:30.619 16:29:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:30.619 16:29:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:30.619 16:29:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:30.619 16:29:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:30.619 16:29:55 -- setup/common.sh@18 -- # local node=1 00:05:30.619 16:29:55 -- setup/common.sh@19 -- # local var val 00:05:30.619 16:29:55 -- setup/common.sh@20 -- # local mem_f mem 00:05:30.619 16:29:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:30.619 16:29:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:30.619 16:29:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:30.619 16:29:55 -- setup/common.sh@28 -- # mapfile -t mem 00:05:30.619 16:29:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24018200 kB' 'MemUsed: 3642548 kB' 'SwapCached: 0 kB' 'Active: 1818364 kB' 'Inactive: 116940 kB' 'Active(anon): 1616192 kB' 'Inactive(anon): 0 kB' 'Active(file): 202172 kB' 'Inactive(file): 116940 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1828552 kB' 'Mapped: 77056 kB' 'AnonPages: 106844 kB' 'Shmem: 1509440 kB' 'KernelStack: 4840 kB' 'PageTables: 2652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 79624 kB' 'Slab: 253612 kB' 'SReclaimable: 79624 kB' 'SUnreclaim: 173988 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.619 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.619 16:29:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # continue 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # IFS=': ' 00:05:30.620 16:29:55 -- setup/common.sh@31 -- # read -r var val _ 00:05:30.620 16:29:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:30.620 16:29:55 -- setup/common.sh@33 -- # echo 0 00:05:30.620 16:29:55 -- setup/common.sh@33 -- # return 0 00:05:30.620 16:29:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:30.620 16:29:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:30.620 16:29:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:30.620 16:29:55 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:30.620 node0=512 expecting 512 00:05:30.620 16:29:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:30.620 16:29:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:30.620 16:29:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:30.620 16:29:55 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:05:30.620 node1=512 expecting 512 00:05:30.620 16:29:55 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:05:30.620 00:05:30.620 real 0m1.571s 00:05:30.620 user 0m0.687s 00:05:30.620 sys 0m0.851s 00:05:30.620 16:29:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:30.620 16:29:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.620 ************************************ 00:05:30.620 END TEST per_node_1G_alloc 00:05:30.620 ************************************ 00:05:30.620 16:29:55 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:05:30.620 16:29:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:30.620 16:29:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:30.620 16:29:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.620 ************************************ 00:05:30.620 START TEST even_2G_alloc 00:05:30.620 ************************************ 00:05:30.620 16:29:55 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:05:30.620 16:29:55 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:05:30.620 16:29:55 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:30.620 16:29:55 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:30.620 16:29:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:30.620 16:29:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:30.620 16:29:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:30.620 16:29:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:30.620 16:29:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:30.620 16:29:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:30.620 16:29:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:30.620 16:29:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:30.620 16:29:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:30.620 16:29:55 -- setup/hugepages.sh@83 -- # : 512 00:05:30.620 16:29:55 -- setup/hugepages.sh@84 -- # : 1 00:05:30.621 16:29:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:30.621 16:29:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:30.621 16:29:55 -- setup/hugepages.sh@83 -- # : 0 00:05:30.621 16:29:55 -- setup/hugepages.sh@84 -- # : 0 00:05:30.621 16:29:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:30.621 16:29:55 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:05:30.621 16:29:55 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:05:30.621 16:29:55 -- setup/hugepages.sh@153 -- # setup output 00:05:30.621 16:29:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:30.621 16:29:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:32.001 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:32.001 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:32.001 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:32.001 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:32.001 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:32.001 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:32.001 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:32.001 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:32.001 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:32.001 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:32.001 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:32.001 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:32.001 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:32.001 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:32.001 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:32.001 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:32.001 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:32.001 16:29:57 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:05:32.001 16:29:57 -- setup/hugepages.sh@89 -- # local node 00:05:32.001 16:29:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:32.001 16:29:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:32.001 16:29:57 -- setup/hugepages.sh@92 -- # local surp 00:05:32.001 16:29:57 -- setup/hugepages.sh@93 -- # local resv 00:05:32.001 16:29:57 -- setup/hugepages.sh@94 -- # local anon 00:05:32.001 16:29:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:32.001 16:29:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:32.001 16:29:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:32.001 16:29:57 -- setup/common.sh@18 -- # local node= 00:05:32.001 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.001 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.001 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.001 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:32.001 16:29:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:32.001 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.001 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44067608 kB' 'MemAvailable: 47814812 kB' 'Buffers: 2708 kB' 'Cached: 11975888 kB' 'SwapCached: 0 kB' 'Active: 8680244 kB' 'Inactive: 3752644 kB' 'Active(anon): 8288132 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457492 kB' 'Mapped: 188736 kB' 'Shmem: 7833840 kB' 'KReclaimable: 192544 kB' 'Slab: 665400 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 472856 kB' 'KernelStack: 12768 kB' 'PageTables: 7480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9359072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.001 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.001 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:32.002 16:29:57 -- setup/common.sh@33 -- # echo 0 00:05:32.002 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.002 16:29:57 -- setup/hugepages.sh@97 -- # anon=0 00:05:32.002 16:29:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:32.002 16:29:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:32.002 16:29:57 -- setup/common.sh@18 -- # local node= 00:05:32.002 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.002 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.002 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.002 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:32.002 16:29:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:32.002 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.002 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44068668 kB' 'MemAvailable: 47815872 kB' 'Buffers: 2708 kB' 'Cached: 11975892 kB' 'SwapCached: 0 kB' 'Active: 8680092 kB' 'Inactive: 3752644 kB' 'Active(anon): 8287980 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457316 kB' 'Mapped: 188688 kB' 'Shmem: 7833844 kB' 'KReclaimable: 192544 kB' 'Slab: 665388 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 472844 kB' 'KernelStack: 12768 kB' 'PageTables: 7484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9359084 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.002 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.002 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.003 16:29:57 -- setup/common.sh@33 -- # echo 0 00:05:32.003 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.003 16:29:57 -- setup/hugepages.sh@99 -- # surp=0 00:05:32.003 16:29:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:32.003 16:29:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:32.003 16:29:57 -- setup/common.sh@18 -- # local node= 00:05:32.003 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.003 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.003 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.003 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:32.003 16:29:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:32.003 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.003 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44069068 kB' 'MemAvailable: 47816272 kB' 'Buffers: 2708 kB' 'Cached: 11975904 kB' 'SwapCached: 0 kB' 'Active: 8680064 kB' 'Inactive: 3752644 kB' 'Active(anon): 8287952 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457292 kB' 'Mapped: 188688 kB' 'Shmem: 7833856 kB' 'KReclaimable: 192544 kB' 'Slab: 665420 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 472876 kB' 'KernelStack: 12768 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9359100 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.003 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.003 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.004 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.004 16:29:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:32.005 16:29:57 -- setup/common.sh@33 -- # echo 0 00:05:32.005 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.005 16:29:57 -- setup/hugepages.sh@100 -- # resv=0 00:05:32.005 16:29:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:32.005 nr_hugepages=1024 00:05:32.005 16:29:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:32.005 resv_hugepages=0 00:05:32.005 16:29:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:32.005 surplus_hugepages=0 00:05:32.005 16:29:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:32.005 anon_hugepages=0 00:05:32.005 16:29:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:32.005 16:29:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:32.005 16:29:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:32.005 16:29:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:32.005 16:29:57 -- setup/common.sh@18 -- # local node= 00:05:32.005 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.005 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.005 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.005 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:32.005 16:29:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:32.005 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.005 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44069068 kB' 'MemAvailable: 47816272 kB' 'Buffers: 2708 kB' 'Cached: 11975916 kB' 'SwapCached: 0 kB' 'Active: 8680096 kB' 'Inactive: 3752644 kB' 'Active(anon): 8287984 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457296 kB' 'Mapped: 188688 kB' 'Shmem: 7833868 kB' 'KReclaimable: 192544 kB' 'Slab: 665420 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 472876 kB' 'KernelStack: 12768 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9359112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.005 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.005 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:32.006 16:29:57 -- setup/common.sh@33 -- # echo 1024 00:05:32.006 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.006 16:29:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:32.006 16:29:57 -- setup/hugepages.sh@112 -- # get_nodes 00:05:32.006 16:29:57 -- setup/hugepages.sh@27 -- # local node 00:05:32.006 16:29:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:32.006 16:29:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:32.006 16:29:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:32.006 16:29:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:32.006 16:29:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:32.006 16:29:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:32.006 16:29:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:32.006 16:29:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:32.006 16:29:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:32.006 16:29:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:32.006 16:29:57 -- setup/common.sh@18 -- # local node=0 00:05:32.006 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.006 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.006 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.006 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:32.006 16:29:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:32.006 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.006 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20052548 kB' 'MemUsed: 12822376 kB' 'SwapCached: 0 kB' 'Active: 6862064 kB' 'Inactive: 3635704 kB' 'Active(anon): 6672124 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150020 kB' 'Mapped: 111868 kB' 'AnonPages: 350860 kB' 'Shmem: 6324376 kB' 'KernelStack: 7912 kB' 'PageTables: 4800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112936 kB' 'Slab: 412032 kB' 'SReclaimable: 112936 kB' 'SUnreclaim: 299096 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.006 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.006 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@33 -- # echo 0 00:05:32.007 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.007 16:29:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:32.007 16:29:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:32.007 16:29:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:32.007 16:29:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:32.007 16:29:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:32.007 16:29:57 -- setup/common.sh@18 -- # local node=1 00:05:32.007 16:29:57 -- setup/common.sh@19 -- # local var val 00:05:32.007 16:29:57 -- setup/common.sh@20 -- # local mem_f mem 00:05:32.007 16:29:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:32.007 16:29:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:32.007 16:29:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:32.007 16:29:57 -- setup/common.sh@28 -- # mapfile -t mem 00:05:32.007 16:29:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24016268 kB' 'MemUsed: 3644480 kB' 'SwapCached: 0 kB' 'Active: 1818036 kB' 'Inactive: 116940 kB' 'Active(anon): 1615864 kB' 'Inactive(anon): 0 kB' 'Active(file): 202172 kB' 'Inactive(file): 116940 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1828632 kB' 'Mapped: 76820 kB' 'AnonPages: 106432 kB' 'Shmem: 1509520 kB' 'KernelStack: 4856 kB' 'PageTables: 2696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 79608 kB' 'Slab: 253388 kB' 'SReclaimable: 79608 kB' 'SUnreclaim: 173780 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.007 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.007 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # continue 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # IFS=': ' 00:05:32.008 16:29:57 -- setup/common.sh@31 -- # read -r var val _ 00:05:32.008 16:29:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:32.008 16:29:57 -- setup/common.sh@33 -- # echo 0 00:05:32.008 16:29:57 -- setup/common.sh@33 -- # return 0 00:05:32.008 16:29:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:32.008 16:29:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:32.008 16:29:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:32.008 16:29:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:32.008 16:29:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:32.008 node0=512 expecting 512 00:05:32.008 16:29:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:32.008 16:29:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:32.008 16:29:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:32.008 16:29:57 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:05:32.008 node1=512 expecting 512 00:05:32.008 16:29:57 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:05:32.008 00:05:32.008 real 0m1.541s 00:05:32.008 user 0m0.634s 00:05:32.008 sys 0m0.865s 00:05:32.008 16:29:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:32.008 16:29:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.008 ************************************ 00:05:32.008 END TEST even_2G_alloc 00:05:32.008 ************************************ 00:05:32.267 16:29:57 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:05:32.267 16:29:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:32.267 16:29:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:32.267 16:29:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.267 ************************************ 00:05:32.267 START TEST odd_alloc 00:05:32.267 ************************************ 00:05:32.267 16:29:57 -- common/autotest_common.sh@1104 -- # odd_alloc 00:05:32.267 16:29:57 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:05:32.267 16:29:57 -- setup/hugepages.sh@49 -- # local size=2098176 00:05:32.267 16:29:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:05:32.267 16:29:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:32.267 16:29:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:32.267 16:29:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:32.267 16:29:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:05:32.267 16:29:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:32.267 16:29:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:32.267 16:29:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:32.267 16:29:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:32.267 16:29:57 -- setup/hugepages.sh@83 -- # : 513 00:05:32.267 16:29:57 -- setup/hugepages.sh@84 -- # : 1 00:05:32.267 16:29:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:05:32.267 16:29:57 -- setup/hugepages.sh@83 -- # : 0 00:05:32.267 16:29:57 -- setup/hugepages.sh@84 -- # : 0 00:05:32.267 16:29:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:32.267 16:29:57 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:05:32.267 16:29:57 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:05:32.267 16:29:57 -- setup/hugepages.sh@160 -- # setup output 00:05:32.267 16:29:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:32.267 16:29:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:33.649 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:33.649 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:33.649 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:33.649 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:33.649 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:33.649 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:33.649 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:33.649 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:33.649 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:33.649 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:33.649 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:33.649 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:33.649 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:33.649 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:33.649 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:33.649 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:33.649 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:33.649 16:29:58 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:05:33.649 16:29:58 -- setup/hugepages.sh@89 -- # local node 00:05:33.649 16:29:58 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:33.649 16:29:58 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:33.649 16:29:58 -- setup/hugepages.sh@92 -- # local surp 00:05:33.649 16:29:58 -- setup/hugepages.sh@93 -- # local resv 00:05:33.649 16:29:58 -- setup/hugepages.sh@94 -- # local anon 00:05:33.649 16:29:58 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:33.649 16:29:58 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:33.649 16:29:58 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:33.649 16:29:58 -- setup/common.sh@18 -- # local node= 00:05:33.649 16:29:58 -- setup/common.sh@19 -- # local var val 00:05:33.649 16:29:58 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.649 16:29:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.649 16:29:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:33.649 16:29:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:33.649 16:29:58 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.649 16:29:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44061056 kB' 'MemAvailable: 47808260 kB' 'Buffers: 2708 kB' 'Cached: 11975988 kB' 'SwapCached: 0 kB' 'Active: 8681048 kB' 'Inactive: 3752644 kB' 'Active(anon): 8288936 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458200 kB' 'Mapped: 188744 kB' 'Shmem: 7833940 kB' 'KReclaimable: 192544 kB' 'Slab: 665632 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 473088 kB' 'KernelStack: 12752 kB' 'PageTables: 7476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9359304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.649 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.649 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:33.650 16:29:58 -- setup/common.sh@33 -- # echo 0 00:05:33.650 16:29:58 -- setup/common.sh@33 -- # return 0 00:05:33.650 16:29:58 -- setup/hugepages.sh@97 -- # anon=0 00:05:33.650 16:29:58 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:33.650 16:29:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:33.650 16:29:58 -- setup/common.sh@18 -- # local node= 00:05:33.650 16:29:58 -- setup/common.sh@19 -- # local var val 00:05:33.650 16:29:58 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.650 16:29:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.650 16:29:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:33.650 16:29:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:33.650 16:29:58 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.650 16:29:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44067460 kB' 'MemAvailable: 47814664 kB' 'Buffers: 2708 kB' 'Cached: 11975992 kB' 'SwapCached: 0 kB' 'Active: 8680908 kB' 'Inactive: 3752644 kB' 'Active(anon): 8288796 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458084 kB' 'Mapped: 188748 kB' 'Shmem: 7833944 kB' 'KReclaimable: 192544 kB' 'Slab: 665608 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 473064 kB' 'KernelStack: 12736 kB' 'PageTables: 7376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9359316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.650 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.650 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.651 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.651 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.652 16:29:58 -- setup/common.sh@33 -- # echo 0 00:05:33.652 16:29:58 -- setup/common.sh@33 -- # return 0 00:05:33.652 16:29:58 -- setup/hugepages.sh@99 -- # surp=0 00:05:33.652 16:29:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:33.652 16:29:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:33.652 16:29:58 -- setup/common.sh@18 -- # local node= 00:05:33.652 16:29:58 -- setup/common.sh@19 -- # local var val 00:05:33.652 16:29:58 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.652 16:29:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.652 16:29:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:33.652 16:29:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:33.652 16:29:58 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.652 16:29:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44068696 kB' 'MemAvailable: 47815900 kB' 'Buffers: 2708 kB' 'Cached: 11976004 kB' 'SwapCached: 0 kB' 'Active: 8680920 kB' 'Inactive: 3752644 kB' 'Active(anon): 8288808 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458064 kB' 'Mapped: 188688 kB' 'Shmem: 7833956 kB' 'KReclaimable: 192544 kB' 'Slab: 665692 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 473148 kB' 'KernelStack: 12784 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9359332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.652 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.652 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:58 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:33.653 16:29:58 -- setup/common.sh@33 -- # echo 0 00:05:33.653 16:29:58 -- setup/common.sh@33 -- # return 0 00:05:33.653 16:29:58 -- setup/hugepages.sh@100 -- # resv=0 00:05:33.653 16:29:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:05:33.653 nr_hugepages=1025 00:05:33.653 16:29:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:33.653 resv_hugepages=0 00:05:33.653 16:29:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:33.653 surplus_hugepages=0 00:05:33.653 16:29:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:33.653 anon_hugepages=0 00:05:33.653 16:29:58 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:33.653 16:29:58 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:05:33.653 16:29:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:33.653 16:29:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:33.653 16:29:58 -- setup/common.sh@18 -- # local node= 00:05:33.653 16:29:58 -- setup/common.sh@19 -- # local var val 00:05:33.653 16:29:58 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.653 16:29:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.653 16:29:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:33.653 16:29:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:33.653 16:29:58 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.653 16:29:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44068696 kB' 'MemAvailable: 47815900 kB' 'Buffers: 2708 kB' 'Cached: 11976004 kB' 'SwapCached: 0 kB' 'Active: 8680648 kB' 'Inactive: 3752644 kB' 'Active(anon): 8288536 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457792 kB' 'Mapped: 188688 kB' 'Shmem: 7833956 kB' 'KReclaimable: 192544 kB' 'Slab: 665692 kB' 'SReclaimable: 192544 kB' 'SUnreclaim: 473148 kB' 'KernelStack: 12784 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9359348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.653 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.653 16:29:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.654 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.654 16:29:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:33.655 16:29:59 -- setup/common.sh@33 -- # echo 1025 00:05:33.655 16:29:59 -- setup/common.sh@33 -- # return 0 00:05:33.655 16:29:59 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:33.655 16:29:59 -- setup/hugepages.sh@112 -- # get_nodes 00:05:33.655 16:29:59 -- setup/hugepages.sh@27 -- # local node 00:05:33.655 16:29:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:33.655 16:29:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:33.655 16:29:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:33.655 16:29:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:05:33.655 16:29:59 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:33.655 16:29:59 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:33.655 16:29:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:33.655 16:29:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:33.655 16:29:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:33.655 16:29:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:33.655 16:29:59 -- setup/common.sh@18 -- # local node=0 00:05:33.655 16:29:59 -- setup/common.sh@19 -- # local var val 00:05:33.655 16:29:59 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.655 16:29:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.655 16:29:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:33.655 16:29:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:33.655 16:29:59 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.655 16:29:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20067884 kB' 'MemUsed: 12807040 kB' 'SwapCached: 0 kB' 'Active: 6862704 kB' 'Inactive: 3635704 kB' 'Active(anon): 6672764 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150036 kB' 'Mapped: 111868 kB' 'AnonPages: 351476 kB' 'Shmem: 6324392 kB' 'KernelStack: 7896 kB' 'PageTables: 4760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112936 kB' 'Slab: 412144 kB' 'SReclaimable: 112936 kB' 'SUnreclaim: 299208 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.655 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.655 16:29:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@33 -- # echo 0 00:05:33.656 16:29:59 -- setup/common.sh@33 -- # return 0 00:05:33.656 16:29:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:33.656 16:29:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:33.656 16:29:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:33.656 16:29:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:33.656 16:29:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:33.656 16:29:59 -- setup/common.sh@18 -- # local node=1 00:05:33.656 16:29:59 -- setup/common.sh@19 -- # local var val 00:05:33.656 16:29:59 -- setup/common.sh@20 -- # local mem_f mem 00:05:33.656 16:29:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:33.656 16:29:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:33.656 16:29:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:33.656 16:29:59 -- setup/common.sh@28 -- # mapfile -t mem 00:05:33.656 16:29:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 24005660 kB' 'MemUsed: 3655088 kB' 'SwapCached: 0 kB' 'Active: 1819324 kB' 'Inactive: 116940 kB' 'Active(anon): 1617152 kB' 'Inactive(anon): 0 kB' 'Active(file): 202172 kB' 'Inactive(file): 116940 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1828720 kB' 'Mapped: 76820 kB' 'AnonPages: 107656 kB' 'Shmem: 1509608 kB' 'KernelStack: 4856 kB' 'PageTables: 2644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 79608 kB' 'Slab: 253540 kB' 'SReclaimable: 79608 kB' 'SUnreclaim: 173932 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.656 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.656 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # continue 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # IFS=': ' 00:05:33.657 16:29:59 -- setup/common.sh@31 -- # read -r var val _ 00:05:33.657 16:29:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:33.657 16:29:59 -- setup/common.sh@33 -- # echo 0 00:05:33.657 16:29:59 -- setup/common.sh@33 -- # return 0 00:05:33.657 16:29:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:33.657 16:29:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:33.657 16:29:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:33.657 16:29:59 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:05:33.657 node0=512 expecting 513 00:05:33.657 16:29:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:33.657 16:29:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:33.657 16:29:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:33.657 16:29:59 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:05:33.657 node1=513 expecting 512 00:05:33.657 16:29:59 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:05:33.657 00:05:33.657 real 0m1.563s 00:05:33.657 user 0m0.625s 00:05:33.657 sys 0m0.902s 00:05:33.657 16:29:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:33.657 16:29:59 -- common/autotest_common.sh@10 -- # set +x 00:05:33.657 ************************************ 00:05:33.657 END TEST odd_alloc 00:05:33.657 ************************************ 00:05:33.657 16:29:59 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:05:33.657 16:29:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:33.657 16:29:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:33.657 16:29:59 -- common/autotest_common.sh@10 -- # set +x 00:05:33.657 ************************************ 00:05:33.657 START TEST custom_alloc 00:05:33.657 ************************************ 00:05:33.657 16:29:59 -- common/autotest_common.sh@1104 -- # custom_alloc 00:05:33.657 16:29:59 -- setup/hugepages.sh@167 -- # local IFS=, 00:05:33.657 16:29:59 -- setup/hugepages.sh@169 -- # local node 00:05:33.657 16:29:59 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@170 -- # local nodes_hp 00:05:33.657 16:29:59 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:05:33.657 16:29:59 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:05:33.657 16:29:59 -- setup/hugepages.sh@49 -- # local size=1048576 00:05:33.657 16:29:59 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:05:33.657 16:29:59 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:33.657 16:29:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:05:33.657 16:29:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:33.657 16:29:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:33.657 16:29:59 -- setup/hugepages.sh@83 -- # : 256 00:05:33.657 16:29:59 -- setup/hugepages.sh@84 -- # : 1 00:05:33.657 16:29:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:33.657 16:29:59 -- setup/hugepages.sh@83 -- # : 0 00:05:33.657 16:29:59 -- setup/hugepages.sh@84 -- # : 0 00:05:33.657 16:29:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:05:33.657 16:29:59 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:05:33.657 16:29:59 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:33.657 16:29:59 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:33.657 16:29:59 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:33.657 16:29:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:33.657 16:29:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:33.657 16:29:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:33.657 16:29:59 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:33.657 16:29:59 -- setup/hugepages.sh@78 -- # return 0 00:05:33.657 16:29:59 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:05:33.657 16:29:59 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:33.657 16:29:59 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:33.657 16:29:59 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:33.657 16:29:59 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:33.657 16:29:59 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:33.657 16:29:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:33.657 16:29:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:33.657 16:29:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:33.657 16:29:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:33.657 16:29:59 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:05:33.658 16:29:59 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:33.658 16:29:59 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:33.658 16:29:59 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:33.658 16:29:59 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:05:33.658 16:29:59 -- setup/hugepages.sh@78 -- # return 0 00:05:33.658 16:29:59 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:05:33.658 16:29:59 -- setup/hugepages.sh@187 -- # setup output 00:05:33.658 16:29:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:33.658 16:29:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:35.037 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:35.037 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:35.037 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:35.037 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:35.037 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:35.037 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:35.037 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:35.037 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:35.037 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:35.037 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:35.037 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:35.037 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:35.037 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:35.037 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:35.037 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:35.037 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:35.037 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:35.037 16:30:00 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:05:35.037 16:30:00 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:05:35.037 16:30:00 -- setup/hugepages.sh@89 -- # local node 00:05:35.037 16:30:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:35.037 16:30:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:35.037 16:30:00 -- setup/hugepages.sh@92 -- # local surp 00:05:35.037 16:30:00 -- setup/hugepages.sh@93 -- # local resv 00:05:35.037 16:30:00 -- setup/hugepages.sh@94 -- # local anon 00:05:35.037 16:30:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:35.037 16:30:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:35.038 16:30:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:35.038 16:30:00 -- setup/common.sh@18 -- # local node= 00:05:35.038 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.038 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.038 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.038 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:35.038 16:30:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:35.038 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.038 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43006540 kB' 'MemAvailable: 46753780 kB' 'Buffers: 2708 kB' 'Cached: 11976080 kB' 'SwapCached: 0 kB' 'Active: 8688136 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296024 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465904 kB' 'Mapped: 189172 kB' 'Shmem: 7834032 kB' 'KReclaimable: 192616 kB' 'Slab: 665588 kB' 'SReclaimable: 192616 kB' 'SUnreclaim: 472972 kB' 'KernelStack: 12896 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9369856 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198316 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.038 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.038 16:30:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:35.039 16:30:00 -- setup/common.sh@33 -- # echo 0 00:05:35.039 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.039 16:30:00 -- setup/hugepages.sh@97 -- # anon=0 00:05:35.039 16:30:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:35.039 16:30:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:35.039 16:30:00 -- setup/common.sh@18 -- # local node= 00:05:35.039 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.039 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.039 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.039 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:35.039 16:30:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:35.039 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.039 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43012108 kB' 'MemAvailable: 46759348 kB' 'Buffers: 2708 kB' 'Cached: 11976084 kB' 'SwapCached: 0 kB' 'Active: 8688564 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296452 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465996 kB' 'Mapped: 189540 kB' 'Shmem: 7834036 kB' 'KReclaimable: 192616 kB' 'Slab: 665576 kB' 'SReclaimable: 192616 kB' 'SUnreclaim: 472960 kB' 'KernelStack: 12912 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9369868 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198300 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.039 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.039 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.040 16:30:00 -- setup/common.sh@33 -- # echo 0 00:05:35.040 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.040 16:30:00 -- setup/hugepages.sh@99 -- # surp=0 00:05:35.040 16:30:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:35.040 16:30:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:35.040 16:30:00 -- setup/common.sh@18 -- # local node= 00:05:35.040 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.040 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.040 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.040 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:35.040 16:30:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:35.040 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.040 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43015768 kB' 'MemAvailable: 46763008 kB' 'Buffers: 2708 kB' 'Cached: 11976096 kB' 'SwapCached: 0 kB' 'Active: 8688320 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296208 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465660 kB' 'Mapped: 189464 kB' 'Shmem: 7834048 kB' 'KReclaimable: 192616 kB' 'Slab: 665544 kB' 'SReclaimable: 192616 kB' 'SUnreclaim: 472928 kB' 'KernelStack: 12896 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9369884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198300 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.040 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.040 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.041 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.041 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:35.041 16:30:00 -- setup/common.sh@33 -- # echo 0 00:05:35.041 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.041 16:30:00 -- setup/hugepages.sh@100 -- # resv=0 00:05:35.041 16:30:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:05:35.041 nr_hugepages=1536 00:05:35.041 16:30:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:35.041 resv_hugepages=0 00:05:35.041 16:30:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:35.041 surplus_hugepages=0 00:05:35.041 16:30:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:35.041 anon_hugepages=0 00:05:35.041 16:30:00 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:35.041 16:30:00 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:05:35.041 16:30:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:35.041 16:30:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:35.041 16:30:00 -- setup/common.sh@18 -- # local node= 00:05:35.041 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.041 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.041 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.042 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:35.042 16:30:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:35.042 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.042 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43018956 kB' 'MemAvailable: 46766196 kB' 'Buffers: 2708 kB' 'Cached: 11976108 kB' 'SwapCached: 0 kB' 'Active: 8684612 kB' 'Inactive: 3752644 kB' 'Active(anon): 8292500 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461964 kB' 'Mapped: 189464 kB' 'Shmem: 7834060 kB' 'KReclaimable: 192616 kB' 'Slab: 665544 kB' 'SReclaimable: 192616 kB' 'SUnreclaim: 472928 kB' 'KernelStack: 12912 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9366456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.042 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.042 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.303 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.303 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:35.304 16:30:00 -- setup/common.sh@33 -- # echo 1536 00:05:35.304 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.304 16:30:00 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:35.304 16:30:00 -- setup/hugepages.sh@112 -- # get_nodes 00:05:35.304 16:30:00 -- setup/hugepages.sh@27 -- # local node 00:05:35.304 16:30:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:35.304 16:30:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:35.304 16:30:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:35.304 16:30:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:35.304 16:30:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:35.304 16:30:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:35.304 16:30:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:35.304 16:30:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:35.304 16:30:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:35.304 16:30:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:35.304 16:30:00 -- setup/common.sh@18 -- # local node=0 00:05:35.304 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.304 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.304 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.304 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:35.304 16:30:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:35.304 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.304 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20041112 kB' 'MemUsed: 12833812 kB' 'SwapCached: 0 kB' 'Active: 6869208 kB' 'Inactive: 3635704 kB' 'Active(anon): 6679268 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150092 kB' 'Mapped: 112308 kB' 'AnonPages: 358008 kB' 'Shmem: 6324448 kB' 'KernelStack: 7976 kB' 'PageTables: 5116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112936 kB' 'Slab: 411920 kB' 'SReclaimable: 112936 kB' 'SUnreclaim: 298984 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.304 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.304 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@33 -- # echo 0 00:05:35.305 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.305 16:30:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:35.305 16:30:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:35.305 16:30:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:35.305 16:30:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:35.305 16:30:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:35.305 16:30:00 -- setup/common.sh@18 -- # local node=1 00:05:35.305 16:30:00 -- setup/common.sh@19 -- # local var val 00:05:35.305 16:30:00 -- setup/common.sh@20 -- # local mem_f mem 00:05:35.305 16:30:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:35.305 16:30:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:35.305 16:30:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:35.305 16:30:00 -- setup/common.sh@28 -- # mapfile -t mem 00:05:35.305 16:30:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22975136 kB' 'MemUsed: 4685612 kB' 'SwapCached: 0 kB' 'Active: 1818528 kB' 'Inactive: 116940 kB' 'Active(anon): 1616356 kB' 'Inactive(anon): 0 kB' 'Active(file): 202172 kB' 'Inactive(file): 116940 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1828736 kB' 'Mapped: 76820 kB' 'AnonPages: 106888 kB' 'Shmem: 1509624 kB' 'KernelStack: 4936 kB' 'PageTables: 2748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 79680 kB' 'Slab: 253608 kB' 'SReclaimable: 79680 kB' 'SUnreclaim: 173928 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.305 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.305 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # continue 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # IFS=': ' 00:05:35.306 16:30:00 -- setup/common.sh@31 -- # read -r var val _ 00:05:35.306 16:30:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:35.306 16:30:00 -- setup/common.sh@33 -- # echo 0 00:05:35.306 16:30:00 -- setup/common.sh@33 -- # return 0 00:05:35.306 16:30:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:35.306 16:30:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:35.306 16:30:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:35.306 16:30:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:35.306 16:30:00 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:35.306 node0=512 expecting 512 00:05:35.306 16:30:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:35.306 16:30:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:35.306 16:30:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:35.306 16:30:00 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:05:35.306 node1=1024 expecting 1024 00:05:35.306 16:30:00 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:05:35.306 00:05:35.306 real 0m1.497s 00:05:35.306 user 0m0.619s 00:05:35.306 sys 0m0.844s 00:05:35.306 16:30:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.306 16:30:00 -- common/autotest_common.sh@10 -- # set +x 00:05:35.306 ************************************ 00:05:35.306 END TEST custom_alloc 00:05:35.306 ************************************ 00:05:35.306 16:30:00 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:05:35.306 16:30:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.306 16:30:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.306 16:30:00 -- common/autotest_common.sh@10 -- # set +x 00:05:35.306 ************************************ 00:05:35.306 START TEST no_shrink_alloc 00:05:35.306 ************************************ 00:05:35.306 16:30:00 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:05:35.306 16:30:00 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:05:35.306 16:30:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:35.306 16:30:00 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:05:35.306 16:30:00 -- setup/hugepages.sh@51 -- # shift 00:05:35.306 16:30:00 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:05:35.306 16:30:00 -- setup/hugepages.sh@52 -- # local node_ids 00:05:35.306 16:30:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:35.306 16:30:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:35.306 16:30:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:05:35.306 16:30:00 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:05:35.306 16:30:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:35.306 16:30:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:35.306 16:30:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:35.306 16:30:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:35.306 16:30:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:35.306 16:30:00 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:05:35.306 16:30:00 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:35.306 16:30:00 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:05:35.306 16:30:00 -- setup/hugepages.sh@73 -- # return 0 00:05:35.306 16:30:00 -- setup/hugepages.sh@198 -- # setup output 00:05:35.307 16:30:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:35.307 16:30:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:36.686 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:36.686 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:36.686 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:36.686 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:36.686 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:36.686 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:36.686 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:36.686 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:36.686 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:36.686 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:36.686 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:36.686 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:36.686 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:36.686 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:36.686 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:36.686 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:36.686 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:36.686 16:30:01 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:05:36.686 16:30:01 -- setup/hugepages.sh@89 -- # local node 00:05:36.686 16:30:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:36.686 16:30:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:36.686 16:30:01 -- setup/hugepages.sh@92 -- # local surp 00:05:36.686 16:30:01 -- setup/hugepages.sh@93 -- # local resv 00:05:36.686 16:30:01 -- setup/hugepages.sh@94 -- # local anon 00:05:36.686 16:30:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:36.686 16:30:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:36.686 16:30:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:36.686 16:30:01 -- setup/common.sh@18 -- # local node= 00:05:36.686 16:30:01 -- setup/common.sh@19 -- # local var val 00:05:36.686 16:30:01 -- setup/common.sh@20 -- # local mem_f mem 00:05:36.686 16:30:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:36.686 16:30:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:36.686 16:30:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:36.686 16:30:01 -- setup/common.sh@28 -- # mapfile -t mem 00:05:36.686 16:30:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43994424 kB' 'MemAvailable: 47741660 kB' 'Buffers: 2708 kB' 'Cached: 11976168 kB' 'SwapCached: 0 kB' 'Active: 8686540 kB' 'Inactive: 3752644 kB' 'Active(anon): 8294428 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 463536 kB' 'Mapped: 189212 kB' 'Shmem: 7834120 kB' 'KReclaimable: 192608 kB' 'Slab: 665328 kB' 'SReclaimable: 192608 kB' 'SUnreclaim: 472720 kB' 'KernelStack: 12896 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9366876 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.686 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.686 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:36.687 16:30:01 -- setup/common.sh@33 -- # echo 0 00:05:36.687 16:30:01 -- setup/common.sh@33 -- # return 0 00:05:36.687 16:30:01 -- setup/hugepages.sh@97 -- # anon=0 00:05:36.687 16:30:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:36.687 16:30:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:36.687 16:30:01 -- setup/common.sh@18 -- # local node= 00:05:36.687 16:30:01 -- setup/common.sh@19 -- # local var val 00:05:36.687 16:30:01 -- setup/common.sh@20 -- # local mem_f mem 00:05:36.687 16:30:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:36.687 16:30:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:36.687 16:30:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:36.687 16:30:01 -- setup/common.sh@28 -- # mapfile -t mem 00:05:36.687 16:30:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43995468 kB' 'MemAvailable: 47742704 kB' 'Buffers: 2708 kB' 'Cached: 11976172 kB' 'SwapCached: 0 kB' 'Active: 8688372 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296260 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465436 kB' 'Mapped: 189696 kB' 'Shmem: 7834124 kB' 'KReclaimable: 192608 kB' 'Slab: 665336 kB' 'SReclaimable: 192608 kB' 'SUnreclaim: 472728 kB' 'KernelStack: 12880 kB' 'PageTables: 7752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.687 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.687 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.688 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.688 16:30:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:01 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.689 16:30:01 -- setup/common.sh@33 -- # echo 0 00:05:36.689 16:30:01 -- setup/common.sh@33 -- # return 0 00:05:36.689 16:30:01 -- setup/hugepages.sh@99 -- # surp=0 00:05:36.689 16:30:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:36.689 16:30:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:36.689 16:30:01 -- setup/common.sh@18 -- # local node= 00:05:36.689 16:30:01 -- setup/common.sh@19 -- # local var val 00:05:36.689 16:30:01 -- setup/common.sh@20 -- # local mem_f mem 00:05:36.689 16:30:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:36.689 16:30:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:36.689 16:30:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:36.689 16:30:01 -- setup/common.sh@28 -- # mapfile -t mem 00:05:36.689 16:30:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43995720 kB' 'MemAvailable: 47742956 kB' 'Buffers: 2708 kB' 'Cached: 11976184 kB' 'SwapCached: 0 kB' 'Active: 8688100 kB' 'Inactive: 3752644 kB' 'Active(anon): 8295988 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465092 kB' 'Mapped: 189572 kB' 'Shmem: 7834136 kB' 'KReclaimable: 192608 kB' 'Slab: 665296 kB' 'SReclaimable: 192608 kB' 'SUnreclaim: 472688 kB' 'KernelStack: 12912 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.689 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.689 16:30:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:36.690 16:30:02 -- setup/common.sh@33 -- # echo 0 00:05:36.690 16:30:02 -- setup/common.sh@33 -- # return 0 00:05:36.690 16:30:02 -- setup/hugepages.sh@100 -- # resv=0 00:05:36.690 16:30:02 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:36.690 nr_hugepages=1024 00:05:36.690 16:30:02 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:36.690 resv_hugepages=0 00:05:36.690 16:30:02 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:36.690 surplus_hugepages=0 00:05:36.690 16:30:02 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:36.690 anon_hugepages=0 00:05:36.690 16:30:02 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:36.690 16:30:02 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:36.690 16:30:02 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:36.690 16:30:02 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:36.690 16:30:02 -- setup/common.sh@18 -- # local node= 00:05:36.690 16:30:02 -- setup/common.sh@19 -- # local var val 00:05:36.690 16:30:02 -- setup/common.sh@20 -- # local mem_f mem 00:05:36.690 16:30:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:36.690 16:30:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:36.690 16:30:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:36.690 16:30:02 -- setup/common.sh@28 -- # mapfile -t mem 00:05:36.690 16:30:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43995400 kB' 'MemAvailable: 47742636 kB' 'Buffers: 2708 kB' 'Cached: 11976184 kB' 'SwapCached: 0 kB' 'Active: 8689056 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296944 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466072 kB' 'Mapped: 189572 kB' 'Shmem: 7834136 kB' 'KReclaimable: 192608 kB' 'Slab: 665296 kB' 'SReclaimable: 192608 kB' 'SUnreclaim: 472688 kB' 'KernelStack: 12960 kB' 'PageTables: 7928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9372700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.690 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.690 16:30:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.691 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.691 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:36.692 16:30:02 -- setup/common.sh@33 -- # echo 1024 00:05:36.692 16:30:02 -- setup/common.sh@33 -- # return 0 00:05:36.692 16:30:02 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:36.692 16:30:02 -- setup/hugepages.sh@112 -- # get_nodes 00:05:36.692 16:30:02 -- setup/hugepages.sh@27 -- # local node 00:05:36.692 16:30:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:36.692 16:30:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:36.692 16:30:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:36.692 16:30:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:36.692 16:30:02 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:36.692 16:30:02 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:36.692 16:30:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:36.692 16:30:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:36.692 16:30:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:36.692 16:30:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:36.692 16:30:02 -- setup/common.sh@18 -- # local node=0 00:05:36.692 16:30:02 -- setup/common.sh@19 -- # local var val 00:05:36.692 16:30:02 -- setup/common.sh@20 -- # local mem_f mem 00:05:36.692 16:30:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:36.692 16:30:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:36.692 16:30:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:36.692 16:30:02 -- setup/common.sh@28 -- # mapfile -t mem 00:05:36.692 16:30:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 18939440 kB' 'MemUsed: 13935484 kB' 'SwapCached: 0 kB' 'Active: 6870000 kB' 'Inactive: 3635704 kB' 'Active(anon): 6680060 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150136 kB' 'Mapped: 112756 kB' 'AnonPages: 358704 kB' 'Shmem: 6324492 kB' 'KernelStack: 8216 kB' 'PageTables: 5692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112936 kB' 'Slab: 411812 kB' 'SReclaimable: 112936 kB' 'SUnreclaim: 298876 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.692 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.692 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # continue 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # IFS=': ' 00:05:36.693 16:30:02 -- setup/common.sh@31 -- # read -r var val _ 00:05:36.693 16:30:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:36.693 16:30:02 -- setup/common.sh@33 -- # echo 0 00:05:36.693 16:30:02 -- setup/common.sh@33 -- # return 0 00:05:36.693 16:30:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:36.693 16:30:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:36.693 16:30:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:36.693 16:30:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:36.693 16:30:02 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:36.693 node0=1024 expecting 1024 00:05:36.693 16:30:02 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:36.693 16:30:02 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:05:36.693 16:30:02 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:05:36.693 16:30:02 -- setup/hugepages.sh@202 -- # setup output 00:05:36.693 16:30:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:36.693 16:30:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:38.074 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:38.074 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:38.074 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:38.074 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:38.074 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:38.074 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:38.074 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:38.074 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:38.074 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:38.074 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:38.074 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:38.074 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:38.074 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:38.074 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:38.074 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:38.074 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:38.074 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:38.074 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:05:38.074 16:30:03 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:05:38.074 16:30:03 -- setup/hugepages.sh@89 -- # local node 00:05:38.074 16:30:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:38.074 16:30:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:38.074 16:30:03 -- setup/hugepages.sh@92 -- # local surp 00:05:38.074 16:30:03 -- setup/hugepages.sh@93 -- # local resv 00:05:38.074 16:30:03 -- setup/hugepages.sh@94 -- # local anon 00:05:38.074 16:30:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:38.074 16:30:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:38.074 16:30:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:38.074 16:30:03 -- setup/common.sh@18 -- # local node= 00:05:38.074 16:30:03 -- setup/common.sh@19 -- # local var val 00:05:38.074 16:30:03 -- setup/common.sh@20 -- # local mem_f mem 00:05:38.074 16:30:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:38.074 16:30:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:38.074 16:30:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:38.074 16:30:03 -- setup/common.sh@28 -- # mapfile -t mem 00:05:38.075 16:30:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43993412 kB' 'MemAvailable: 47740644 kB' 'Buffers: 2708 kB' 'Cached: 11976252 kB' 'SwapCached: 0 kB' 'Active: 8688428 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296316 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465348 kB' 'Mapped: 189616 kB' 'Shmem: 7834204 kB' 'KReclaimable: 192600 kB' 'Slab: 665552 kB' 'SReclaimable: 192600 kB' 'SUnreclaim: 472952 kB' 'KernelStack: 12944 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198524 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.075 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.075 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:38.076 16:30:03 -- setup/common.sh@33 -- # echo 0 00:05:38.076 16:30:03 -- setup/common.sh@33 -- # return 0 00:05:38.076 16:30:03 -- setup/hugepages.sh@97 -- # anon=0 00:05:38.076 16:30:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:38.076 16:30:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:38.076 16:30:03 -- setup/common.sh@18 -- # local node= 00:05:38.076 16:30:03 -- setup/common.sh@19 -- # local var val 00:05:38.076 16:30:03 -- setup/common.sh@20 -- # local mem_f mem 00:05:38.076 16:30:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:38.076 16:30:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:38.076 16:30:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:38.076 16:30:03 -- setup/common.sh@28 -- # mapfile -t mem 00:05:38.076 16:30:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43993952 kB' 'MemAvailable: 47741184 kB' 'Buffers: 2708 kB' 'Cached: 11976256 kB' 'SwapCached: 0 kB' 'Active: 8688720 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296608 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465636 kB' 'Mapped: 189696 kB' 'Shmem: 7834208 kB' 'KReclaimable: 192600 kB' 'Slab: 665592 kB' 'SReclaimable: 192600 kB' 'SUnreclaim: 472992 kB' 'KernelStack: 12928 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368960 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198492 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.076 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.076 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.077 16:30:03 -- setup/common.sh@33 -- # echo 0 00:05:38.077 16:30:03 -- setup/common.sh@33 -- # return 0 00:05:38.077 16:30:03 -- setup/hugepages.sh@99 -- # surp=0 00:05:38.077 16:30:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:38.077 16:30:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:38.077 16:30:03 -- setup/common.sh@18 -- # local node= 00:05:38.077 16:30:03 -- setup/common.sh@19 -- # local var val 00:05:38.077 16:30:03 -- setup/common.sh@20 -- # local mem_f mem 00:05:38.077 16:30:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:38.077 16:30:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:38.077 16:30:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:38.077 16:30:03 -- setup/common.sh@28 -- # mapfile -t mem 00:05:38.077 16:30:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43994704 kB' 'MemAvailable: 47741936 kB' 'Buffers: 2708 kB' 'Cached: 11976268 kB' 'SwapCached: 0 kB' 'Active: 8688416 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296304 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465268 kB' 'Mapped: 189576 kB' 'Shmem: 7834220 kB' 'KReclaimable: 192600 kB' 'Slab: 665624 kB' 'SReclaimable: 192600 kB' 'SUnreclaim: 473024 kB' 'KernelStack: 12944 kB' 'PageTables: 7776 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368976 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198492 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.077 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.077 16:30:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.078 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:38.078 16:30:03 -- setup/common.sh@33 -- # echo 0 00:05:38.078 16:30:03 -- setup/common.sh@33 -- # return 0 00:05:38.078 16:30:03 -- setup/hugepages.sh@100 -- # resv=0 00:05:38.078 16:30:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:38.078 nr_hugepages=1024 00:05:38.078 16:30:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:38.078 resv_hugepages=0 00:05:38.078 16:30:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:38.078 surplus_hugepages=0 00:05:38.078 16:30:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:38.078 anon_hugepages=0 00:05:38.078 16:30:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:38.078 16:30:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:38.078 16:30:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:38.078 16:30:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:38.078 16:30:03 -- setup/common.sh@18 -- # local node= 00:05:38.078 16:30:03 -- setup/common.sh@19 -- # local var val 00:05:38.078 16:30:03 -- setup/common.sh@20 -- # local mem_f mem 00:05:38.078 16:30:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:38.078 16:30:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:38.078 16:30:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:38.078 16:30:03 -- setup/common.sh@28 -- # mapfile -t mem 00:05:38.078 16:30:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.078 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43994704 kB' 'MemAvailable: 47741936 kB' 'Buffers: 2708 kB' 'Cached: 11976284 kB' 'SwapCached: 0 kB' 'Active: 8688452 kB' 'Inactive: 3752644 kB' 'Active(anon): 8296340 kB' 'Inactive(anon): 0 kB' 'Active(file): 392112 kB' 'Inactive(file): 3752644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465272 kB' 'Mapped: 189576 kB' 'Shmem: 7834236 kB' 'KReclaimable: 192600 kB' 'Slab: 665624 kB' 'SReclaimable: 192600 kB' 'SUnreclaim: 473024 kB' 'KernelStack: 12944 kB' 'PageTables: 7776 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9368992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198492 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1588828 kB' 'DirectMap2M: 13010944 kB' 'DirectMap1G: 55574528 kB' 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.079 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.079 16:30:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:38.080 16:30:03 -- setup/common.sh@33 -- # echo 1024 00:05:38.080 16:30:03 -- setup/common.sh@33 -- # return 0 00:05:38.080 16:30:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:38.080 16:30:03 -- setup/hugepages.sh@112 -- # get_nodes 00:05:38.080 16:30:03 -- setup/hugepages.sh@27 -- # local node 00:05:38.080 16:30:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:38.080 16:30:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:38.080 16:30:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:38.080 16:30:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:38.080 16:30:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:38.080 16:30:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:38.080 16:30:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:38.080 16:30:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:38.080 16:30:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:38.080 16:30:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:38.080 16:30:03 -- setup/common.sh@18 -- # local node=0 00:05:38.080 16:30:03 -- setup/common.sh@19 -- # local var val 00:05:38.080 16:30:03 -- setup/common.sh@20 -- # local mem_f mem 00:05:38.080 16:30:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:38.080 16:30:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:38.080 16:30:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:38.080 16:30:03 -- setup/common.sh@28 -- # mapfile -t mem 00:05:38.080 16:30:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 18945088 kB' 'MemUsed: 13929836 kB' 'SwapCached: 0 kB' 'Active: 6869232 kB' 'Inactive: 3635704 kB' 'Active(anon): 6679292 kB' 'Inactive(anon): 0 kB' 'Active(file): 189940 kB' 'Inactive(file): 3635704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10150140 kB' 'Mapped: 112756 kB' 'AnonPages: 357900 kB' 'Shmem: 6324496 kB' 'KernelStack: 7944 kB' 'PageTables: 4988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112936 kB' 'Slab: 411844 kB' 'SReclaimable: 112936 kB' 'SUnreclaim: 298908 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.080 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.080 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # continue 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # IFS=': ' 00:05:38.081 16:30:03 -- setup/common.sh@31 -- # read -r var val _ 00:05:38.081 16:30:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:38.081 16:30:03 -- setup/common.sh@33 -- # echo 0 00:05:38.081 16:30:03 -- setup/common.sh@33 -- # return 0 00:05:38.081 16:30:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:38.081 16:30:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:38.081 16:30:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:38.081 16:30:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:38.081 16:30:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:38.081 node0=1024 expecting 1024 00:05:38.081 16:30:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:38.081 00:05:38.081 real 0m2.944s 00:05:38.081 user 0m1.179s 00:05:38.081 sys 0m1.697s 00:05:38.081 16:30:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:38.081 16:30:03 -- common/autotest_common.sh@10 -- # set +x 00:05:38.081 ************************************ 00:05:38.081 END TEST no_shrink_alloc 00:05:38.081 ************************************ 00:05:38.340 16:30:03 -- setup/hugepages.sh@217 -- # clear_hp 00:05:38.340 16:30:03 -- setup/hugepages.sh@37 -- # local node hp 00:05:38.340 16:30:03 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:38.340 16:30:03 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:38.340 16:30:03 -- setup/hugepages.sh@41 -- # echo 0 00:05:38.340 16:30:03 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:38.340 16:30:03 -- setup/hugepages.sh@41 -- # echo 0 00:05:38.340 16:30:03 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:38.340 16:30:03 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:38.340 16:30:03 -- setup/hugepages.sh@41 -- # echo 0 00:05:38.340 16:30:03 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:38.340 16:30:03 -- setup/hugepages.sh@41 -- # echo 0 00:05:38.340 16:30:03 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:38.340 16:30:03 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:38.340 00:05:38.340 real 0m11.851s 00:05:38.340 user 0m4.543s 00:05:38.340 sys 0m6.260s 00:05:38.340 16:30:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:38.340 16:30:03 -- common/autotest_common.sh@10 -- # set +x 00:05:38.340 ************************************ 00:05:38.340 END TEST hugepages 00:05:38.340 ************************************ 00:05:38.340 16:30:03 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:38.340 16:30:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:38.340 16:30:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:38.340 16:30:03 -- common/autotest_common.sh@10 -- # set +x 00:05:38.340 ************************************ 00:05:38.340 START TEST driver 00:05:38.340 ************************************ 00:05:38.340 16:30:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:38.340 * Looking for test storage... 00:05:38.340 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:38.340 16:30:03 -- setup/driver.sh@68 -- # setup reset 00:05:38.340 16:30:03 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:38.340 16:30:03 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:40.877 16:30:06 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:05:40.877 16:30:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:40.877 16:30:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:40.877 16:30:06 -- common/autotest_common.sh@10 -- # set +x 00:05:40.877 ************************************ 00:05:40.877 START TEST guess_driver 00:05:40.877 ************************************ 00:05:40.877 16:30:06 -- common/autotest_common.sh@1104 -- # guess_driver 00:05:40.877 16:30:06 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:05:40.877 16:30:06 -- setup/driver.sh@47 -- # local fail=0 00:05:40.877 16:30:06 -- setup/driver.sh@49 -- # pick_driver 00:05:40.877 16:30:06 -- setup/driver.sh@36 -- # vfio 00:05:40.877 16:30:06 -- setup/driver.sh@21 -- # local iommu_grups 00:05:40.877 16:30:06 -- setup/driver.sh@22 -- # local unsafe_vfio 00:05:40.877 16:30:06 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:05:40.877 16:30:06 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:05:40.877 16:30:06 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:05:40.877 16:30:06 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:05:40.877 16:30:06 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:05:40.877 16:30:06 -- setup/driver.sh@14 -- # mod vfio_pci 00:05:40.877 16:30:06 -- setup/driver.sh@12 -- # dep vfio_pci 00:05:40.877 16:30:06 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:05:40.877 16:30:06 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:05:40.877 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:05:40.877 16:30:06 -- setup/driver.sh@30 -- # return 0 00:05:40.877 16:30:06 -- setup/driver.sh@37 -- # echo vfio-pci 00:05:40.877 16:30:06 -- setup/driver.sh@49 -- # driver=vfio-pci 00:05:40.877 16:30:06 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:05:40.877 16:30:06 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:05:40.877 Looking for driver=vfio-pci 00:05:40.877 16:30:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:40.877 16:30:06 -- setup/driver.sh@45 -- # setup output config 00:05:40.877 16:30:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:40.877 16:30:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:42.258 16:30:07 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:42.258 16:30:07 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:42.258 16:30:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:43.198 16:30:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:43.198 16:30:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:43.198 16:30:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:43.198 16:30:08 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:43.198 16:30:08 -- setup/driver.sh@65 -- # setup reset 00:05:43.198 16:30:08 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:43.198 16:30:08 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:45.731 00:05:45.731 real 0m4.888s 00:05:45.731 user 0m1.067s 00:05:45.731 sys 0m1.985s 00:05:45.731 16:30:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:45.731 16:30:11 -- common/autotest_common.sh@10 -- # set +x 00:05:45.731 ************************************ 00:05:45.731 END TEST guess_driver 00:05:45.731 ************************************ 00:05:45.731 00:05:45.731 real 0m7.482s 00:05:45.731 user 0m1.639s 00:05:45.731 sys 0m3.029s 00:05:45.731 16:30:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:45.731 16:30:11 -- common/autotest_common.sh@10 -- # set +x 00:05:45.731 ************************************ 00:05:45.731 END TEST driver 00:05:45.731 ************************************ 00:05:45.731 16:30:11 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:45.731 16:30:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:45.731 16:30:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:45.731 16:30:11 -- common/autotest_common.sh@10 -- # set +x 00:05:45.731 ************************************ 00:05:45.731 START TEST devices 00:05:45.731 ************************************ 00:05:45.731 16:30:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:45.731 * Looking for test storage... 00:05:45.731 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:45.731 16:30:11 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:45.731 16:30:11 -- setup/devices.sh@192 -- # setup reset 00:05:45.731 16:30:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:45.731 16:30:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:47.633 16:30:12 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:47.633 16:30:12 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:05:47.633 16:30:12 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:05:47.633 16:30:12 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:05:47.633 16:30:12 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:05:47.633 16:30:12 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:05:47.633 16:30:12 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:05:47.633 16:30:12 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:47.633 16:30:12 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:05:47.633 16:30:12 -- setup/devices.sh@196 -- # blocks=() 00:05:47.633 16:30:12 -- setup/devices.sh@196 -- # declare -a blocks 00:05:47.633 16:30:12 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:47.633 16:30:12 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:47.633 16:30:12 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:47.633 16:30:12 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:47.633 16:30:12 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:47.633 16:30:12 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:47.633 16:30:12 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:47.633 16:30:12 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:47.633 16:30:12 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:47.633 16:30:12 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:47.633 16:30:12 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:47.633 No valid GPT data, bailing 00:05:47.633 16:30:12 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:47.633 16:30:12 -- scripts/common.sh@393 -- # pt= 00:05:47.633 16:30:12 -- scripts/common.sh@394 -- # return 1 00:05:47.633 16:30:12 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:47.633 16:30:12 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:47.633 16:30:12 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:47.633 16:30:12 -- setup/common.sh@80 -- # echo 1000204886016 00:05:47.633 16:30:12 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:47.634 16:30:12 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:47.634 16:30:12 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:47.634 16:30:12 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:47.634 16:30:12 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:47.634 16:30:12 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:47.634 16:30:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:47.634 16:30:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:47.634 16:30:12 -- common/autotest_common.sh@10 -- # set +x 00:05:47.634 ************************************ 00:05:47.634 START TEST nvme_mount 00:05:47.634 ************************************ 00:05:47.634 16:30:12 -- common/autotest_common.sh@1104 -- # nvme_mount 00:05:47.634 16:30:12 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:47.634 16:30:12 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:47.634 16:30:12 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:47.634 16:30:12 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:47.634 16:30:12 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:47.634 16:30:12 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:47.634 16:30:12 -- setup/common.sh@40 -- # local part_no=1 00:05:47.634 16:30:12 -- setup/common.sh@41 -- # local size=1073741824 00:05:47.634 16:30:12 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:47.634 16:30:12 -- setup/common.sh@44 -- # parts=() 00:05:47.634 16:30:12 -- setup/common.sh@44 -- # local parts 00:05:47.634 16:30:12 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:47.634 16:30:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:47.634 16:30:12 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:47.634 16:30:12 -- setup/common.sh@46 -- # (( part++ )) 00:05:47.634 16:30:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:47.634 16:30:12 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:47.634 16:30:12 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:47.634 16:30:12 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:48.572 Creating new GPT entries in memory. 00:05:48.572 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:48.572 other utilities. 00:05:48.572 16:30:13 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:48.572 16:30:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:48.572 16:30:13 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:48.572 16:30:13 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:48.572 16:30:13 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:49.509 Creating new GPT entries in memory. 00:05:49.509 The operation has completed successfully. 00:05:49.509 16:30:14 -- setup/common.sh@57 -- # (( part++ )) 00:05:49.509 16:30:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:49.509 16:30:14 -- setup/common.sh@62 -- # wait 1065823 00:05:49.509 16:30:14 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:49.509 16:30:14 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:49.509 16:30:14 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:49.509 16:30:14 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:49.509 16:30:14 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:49.509 16:30:14 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:49.509 16:30:14 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:49.509 16:30:14 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:49.509 16:30:14 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:49.509 16:30:14 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:49.509 16:30:14 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:49.509 16:30:14 -- setup/devices.sh@53 -- # local found=0 00:05:49.509 16:30:14 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:49.509 16:30:14 -- setup/devices.sh@56 -- # : 00:05:49.509 16:30:14 -- setup/devices.sh@59 -- # local pci status 00:05:49.509 16:30:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:49.509 16:30:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:49.509 16:30:14 -- setup/devices.sh@47 -- # setup output config 00:05:49.509 16:30:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:49.509 16:30:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:50.887 16:30:16 -- setup/devices.sh@63 -- # found=1 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:50.887 16:30:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:50.887 16:30:16 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:50.887 16:30:16 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:50.887 16:30:16 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:50.887 16:30:16 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:50.887 16:30:16 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:50.887 16:30:16 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:50.887 16:30:16 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:50.887 16:30:16 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:50.887 16:30:16 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:51.146 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:51.146 16:30:16 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:51.146 16:30:16 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:51.406 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:51.406 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:51.406 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:51.406 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:51.406 16:30:16 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:51.406 16:30:16 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:51.406 16:30:16 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:51.406 16:30:16 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:51.406 16:30:16 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:51.406 16:30:16 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:51.406 16:30:16 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:51.406 16:30:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:51.406 16:30:16 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:51.406 16:30:16 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:51.406 16:30:16 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:51.406 16:30:16 -- setup/devices.sh@53 -- # local found=0 00:05:51.406 16:30:16 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:51.406 16:30:16 -- setup/devices.sh@56 -- # : 00:05:51.406 16:30:16 -- setup/devices.sh@59 -- # local pci status 00:05:51.406 16:30:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:51.406 16:30:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:51.406 16:30:16 -- setup/devices.sh@47 -- # setup output config 00:05:51.406 16:30:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:51.406 16:30:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:52.422 16:30:17 -- setup/devices.sh@63 -- # found=1 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.422 16:30:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:52.422 16:30:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.681 16:30:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:52.681 16:30:18 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:52.681 16:30:18 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:52.681 16:30:18 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:52.681 16:30:18 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:52.681 16:30:18 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:52.681 16:30:18 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:52.681 16:30:18 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:52.681 16:30:18 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:52.681 16:30:18 -- setup/devices.sh@50 -- # local mount_point= 00:05:52.681 16:30:18 -- setup/devices.sh@51 -- # local test_file= 00:05:52.681 16:30:18 -- setup/devices.sh@53 -- # local found=0 00:05:52.681 16:30:18 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:52.681 16:30:18 -- setup/devices.sh@59 -- # local pci status 00:05:52.681 16:30:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:52.681 16:30:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:52.681 16:30:18 -- setup/devices.sh@47 -- # setup output config 00:05:52.681 16:30:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:52.681 16:30:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:54.057 16:30:19 -- setup/devices.sh@63 -- # found=1 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.057 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.057 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:54.058 16:30:19 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:54.058 16:30:19 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:54.058 16:30:19 -- setup/devices.sh@68 -- # return 0 00:05:54.058 16:30:19 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:54.058 16:30:19 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:54.058 16:30:19 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:54.058 16:30:19 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:54.318 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:54.318 00:05:54.318 real 0m6.733s 00:05:54.318 user 0m1.559s 00:05:54.318 sys 0m2.767s 00:05:54.318 16:30:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:54.318 16:30:19 -- common/autotest_common.sh@10 -- # set +x 00:05:54.318 ************************************ 00:05:54.318 END TEST nvme_mount 00:05:54.318 ************************************ 00:05:54.318 16:30:19 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:54.318 16:30:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:54.318 16:30:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:54.318 16:30:19 -- common/autotest_common.sh@10 -- # set +x 00:05:54.318 ************************************ 00:05:54.318 START TEST dm_mount 00:05:54.318 ************************************ 00:05:54.318 16:30:19 -- common/autotest_common.sh@1104 -- # dm_mount 00:05:54.318 16:30:19 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:54.318 16:30:19 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:54.318 16:30:19 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:54.318 16:30:19 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:54.318 16:30:19 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:54.318 16:30:19 -- setup/common.sh@40 -- # local part_no=2 00:05:54.318 16:30:19 -- setup/common.sh@41 -- # local size=1073741824 00:05:54.318 16:30:19 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:54.318 16:30:19 -- setup/common.sh@44 -- # parts=() 00:05:54.318 16:30:19 -- setup/common.sh@44 -- # local parts 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:54.318 16:30:19 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part++ )) 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:54.318 16:30:19 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part++ )) 00:05:54.318 16:30:19 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:54.318 16:30:19 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:54.318 16:30:19 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:54.318 16:30:19 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:55.258 Creating new GPT entries in memory. 00:05:55.258 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:55.258 other utilities. 00:05:55.258 16:30:20 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:55.258 16:30:20 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:55.258 16:30:20 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:55.258 16:30:20 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:55.258 16:30:20 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:56.197 Creating new GPT entries in memory. 00:05:56.197 The operation has completed successfully. 00:05:56.197 16:30:21 -- setup/common.sh@57 -- # (( part++ )) 00:05:56.197 16:30:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:56.197 16:30:21 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:56.197 16:30:21 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:56.197 16:30:21 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:57.577 The operation has completed successfully. 00:05:57.577 16:30:22 -- setup/common.sh@57 -- # (( part++ )) 00:05:57.577 16:30:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:57.577 16:30:22 -- setup/common.sh@62 -- # wait 1068294 00:05:57.577 16:30:22 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:57.577 16:30:22 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:57.577 16:30:22 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:57.577 16:30:22 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:57.577 16:30:22 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:57.577 16:30:22 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:57.577 16:30:22 -- setup/devices.sh@161 -- # break 00:05:57.577 16:30:22 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:57.577 16:30:22 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:57.577 16:30:22 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:57.577 16:30:22 -- setup/devices.sh@166 -- # dm=dm-0 00:05:57.577 16:30:22 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:57.577 16:30:22 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:57.577 16:30:22 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:57.577 16:30:22 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:57.577 16:30:22 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:57.577 16:30:22 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:57.577 16:30:22 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:57.577 16:30:22 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:57.577 16:30:22 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:57.577 16:30:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:57.577 16:30:22 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:57.577 16:30:22 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:57.577 16:30:22 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:57.577 16:30:22 -- setup/devices.sh@53 -- # local found=0 00:05:57.577 16:30:22 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:57.577 16:30:22 -- setup/devices.sh@56 -- # : 00:05:57.577 16:30:22 -- setup/devices.sh@59 -- # local pci status 00:05:57.577 16:30:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:57.577 16:30:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:57.577 16:30:22 -- setup/devices.sh@47 -- # setup output config 00:05:57.577 16:30:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:57.577 16:30:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:58.510 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.510 16:30:23 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:58.510 16:30:23 -- setup/devices.sh@63 -- # found=1 00:05:58.510 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.510 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.510 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.510 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.511 16:30:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.511 16:30:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.769 16:30:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:58.769 16:30:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.769 16:30:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:58.769 16:30:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:58.769 16:30:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:58.769 16:30:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:58.769 16:30:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:58.769 16:30:24 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:58.769 16:30:24 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:58.769 16:30:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:58.769 16:30:24 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:58.769 16:30:24 -- setup/devices.sh@50 -- # local mount_point= 00:05:58.769 16:30:24 -- setup/devices.sh@51 -- # local test_file= 00:05:58.769 16:30:24 -- setup/devices.sh@53 -- # local found=0 00:05:58.769 16:30:24 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:58.769 16:30:24 -- setup/devices.sh@59 -- # local pci status 00:05:58.769 16:30:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:58.769 16:30:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:58.769 16:30:24 -- setup/devices.sh@47 -- # setup output config 00:05:58.769 16:30:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:58.769 16:30:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:06:00.143 16:30:25 -- setup/devices.sh@63 -- # found=1 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:06:00.143 16:30:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:06:00.143 16:30:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:06:00.143 16:30:25 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:06:00.143 16:30:25 -- setup/devices.sh@68 -- # return 0 00:06:00.143 16:30:25 -- setup/devices.sh@187 -- # cleanup_dm 00:06:00.143 16:30:25 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:06:00.143 16:30:25 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:06:00.144 16:30:25 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:06:00.144 16:30:25 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:06:00.144 16:30:25 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:06:00.144 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:06:00.144 16:30:25 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:06:00.144 16:30:25 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:06:00.144 00:06:00.144 real 0m6.036s 00:06:00.144 user 0m1.056s 00:06:00.144 sys 0m1.836s 00:06:00.144 16:30:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:00.144 16:30:25 -- common/autotest_common.sh@10 -- # set +x 00:06:00.144 ************************************ 00:06:00.144 END TEST dm_mount 00:06:00.144 ************************************ 00:06:00.144 16:30:25 -- setup/devices.sh@1 -- # cleanup 00:06:00.144 16:30:25 -- setup/devices.sh@11 -- # cleanup_nvme 00:06:00.144 16:30:25 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:06:00.403 16:30:25 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:06:00.403 16:30:25 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:06:00.403 16:30:25 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:06:00.403 16:30:25 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:06:00.662 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:06:00.662 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:06:00.662 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:06:00.662 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:06:00.662 16:30:25 -- setup/devices.sh@12 -- # cleanup_dm 00:06:00.662 16:30:25 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:06:00.662 16:30:25 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:06:00.662 16:30:25 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:06:00.662 16:30:25 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:06:00.662 16:30:25 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:06:00.662 16:30:25 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:06:00.662 00:06:00.662 real 0m14.791s 00:06:00.662 user 0m3.288s 00:06:00.662 sys 0m5.714s 00:06:00.662 16:30:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:00.662 16:30:25 -- common/autotest_common.sh@10 -- # set +x 00:06:00.662 ************************************ 00:06:00.662 END TEST devices 00:06:00.662 ************************************ 00:06:00.662 00:06:00.662 real 0m45.494s 00:06:00.662 user 0m12.872s 00:06:00.662 sys 0m21.028s 00:06:00.662 16:30:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:00.662 16:30:25 -- common/autotest_common.sh@10 -- # set +x 00:06:00.662 ************************************ 00:06:00.662 END TEST setup.sh 00:06:00.662 ************************************ 00:06:00.662 16:30:25 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:06:01.598 Hugepages 00:06:01.598 node hugesize free / total 00:06:01.598 node0 1048576kB 0 / 0 00:06:01.598 node0 2048kB 2048 / 2048 00:06:01.598 node1 1048576kB 0 / 0 00:06:01.598 node1 2048kB 0 / 0 00:06:01.598 00:06:01.598 Type BDF Vendor Device NUMA Driver Device Block devices 00:06:01.598 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:06:01.598 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:06:01.598 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:06:01.598 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:06:01.598 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:06:01.857 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:06:01.857 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:06:01.857 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:06:01.857 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:06:01.857 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:06:01.857 16:30:27 -- spdk/autotest.sh@141 -- # uname -s 00:06:01.857 16:30:27 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:06:01.857 16:30:27 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:06:01.857 16:30:27 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:06:03.233 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:06:03.233 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:06:03.233 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:06:04.173 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:06:04.432 16:30:29 -- common/autotest_common.sh@1517 -- # sleep 1 00:06:05.371 16:30:30 -- common/autotest_common.sh@1518 -- # bdfs=() 00:06:05.371 16:30:30 -- common/autotest_common.sh@1518 -- # local bdfs 00:06:05.371 16:30:30 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:06:05.371 16:30:30 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:06:05.371 16:30:30 -- common/autotest_common.sh@1498 -- # bdfs=() 00:06:05.371 16:30:30 -- common/autotest_common.sh@1498 -- # local bdfs 00:06:05.371 16:30:30 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:06:05.371 16:30:30 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:06:05.371 16:30:30 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:06:05.371 16:30:30 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:06:05.371 16:30:30 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:06:05.371 16:30:30 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:06:06.749 Waiting for block devices as requested 00:06:06.749 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:06:06.749 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:06:06.749 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:06:07.009 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:06:07.009 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:06:07.009 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:06:07.009 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:06:07.269 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:06:07.269 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:06:07.269 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:06:07.269 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:06:07.529 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:06:07.529 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:06:07.529 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:06:07.529 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:06:07.788 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:06:07.788 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:06:07.788 16:30:33 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:06:07.788 16:30:33 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:06:07.788 16:30:33 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:06:07.788 16:30:33 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:06:07.788 16:30:33 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:06:07.788 16:30:33 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:06:08.047 16:30:33 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:06:08.047 16:30:33 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:06:08.047 16:30:33 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:06:08.047 16:30:33 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:06:08.047 16:30:33 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:06:08.047 16:30:33 -- common/autotest_common.sh@1530 -- # grep oacs 00:06:08.047 16:30:33 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:06:08.047 16:30:33 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:06:08.047 16:30:33 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:06:08.047 16:30:33 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:06:08.047 16:30:33 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:06:08.047 16:30:33 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:06:08.047 16:30:33 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:06:08.047 16:30:33 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:06:08.047 16:30:33 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:06:08.047 16:30:33 -- common/autotest_common.sh@1542 -- # continue 00:06:08.047 16:30:33 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:06:08.047 16:30:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:08.047 16:30:33 -- common/autotest_common.sh@10 -- # set +x 00:06:08.047 16:30:33 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:06:08.047 16:30:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:08.047 16:30:33 -- common/autotest_common.sh@10 -- # set +x 00:06:08.047 16:30:33 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:06:09.424 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:06:09.424 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:06:09.424 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:06:10.364 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:06:10.364 16:30:35 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:06:10.364 16:30:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:10.364 16:30:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.364 16:30:35 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:06:10.364 16:30:35 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:06:10.364 16:30:35 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:06:10.364 16:30:35 -- common/autotest_common.sh@1562 -- # bdfs=() 00:06:10.364 16:30:35 -- common/autotest_common.sh@1562 -- # local bdfs 00:06:10.364 16:30:35 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:06:10.364 16:30:35 -- common/autotest_common.sh@1498 -- # bdfs=() 00:06:10.364 16:30:35 -- common/autotest_common.sh@1498 -- # local bdfs 00:06:10.364 16:30:35 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:06:10.364 16:30:35 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:06:10.364 16:30:35 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:06:10.365 16:30:35 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:06:10.365 16:30:35 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:06:10.623 16:30:35 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:06:10.623 16:30:35 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:06:10.623 16:30:35 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:06:10.623 16:30:35 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:06:10.623 16:30:35 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:06:10.623 16:30:35 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:06:10.623 16:30:35 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:06:10.623 16:30:35 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=1073729 00:06:10.623 16:30:35 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:10.623 16:30:35 -- common/autotest_common.sh@1583 -- # waitforlisten 1073729 00:06:10.623 16:30:35 -- common/autotest_common.sh@819 -- # '[' -z 1073729 ']' 00:06:10.623 16:30:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:10.623 16:30:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:10.623 16:30:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:10.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:10.623 16:30:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:10.623 16:30:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.623 [2024-10-13 16:30:35.920584] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:10.624 [2024-10-13 16:30:35.920676] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1073729 ] 00:06:10.624 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.624 [2024-10-13 16:30:35.976408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.624 [2024-10-13 16:30:36.060287] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:10.624 [2024-10-13 16:30:36.060465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.557 16:30:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:11.557 16:30:36 -- common/autotest_common.sh@852 -- # return 0 00:06:11.557 16:30:36 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:06:11.557 16:30:36 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:06:11.557 16:30:36 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:06:14.852 nvme0n1 00:06:14.852 16:30:39 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:06:14.852 [2024-10-13 16:30:40.189658] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:06:14.852 [2024-10-13 16:30:40.189730] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:06:14.852 request: 00:06:14.852 { 00:06:14.852 "nvme_ctrlr_name": "nvme0", 00:06:14.852 "password": "test", 00:06:14.852 "method": "bdev_nvme_opal_revert", 00:06:14.852 "req_id": 1 00:06:14.852 } 00:06:14.852 Got JSON-RPC error response 00:06:14.852 response: 00:06:14.852 { 00:06:14.852 "code": -32603, 00:06:14.852 "message": "Internal error" 00:06:14.852 } 00:06:14.852 16:30:40 -- common/autotest_common.sh@1589 -- # true 00:06:14.852 16:30:40 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:06:14.852 16:30:40 -- common/autotest_common.sh@1593 -- # killprocess 1073729 00:06:14.852 16:30:40 -- common/autotest_common.sh@926 -- # '[' -z 1073729 ']' 00:06:14.852 16:30:40 -- common/autotest_common.sh@930 -- # kill -0 1073729 00:06:14.852 16:30:40 -- common/autotest_common.sh@931 -- # uname 00:06:14.852 16:30:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:14.852 16:30:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1073729 00:06:14.852 16:30:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:14.852 16:30:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:14.852 16:30:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1073729' 00:06:14.852 killing process with pid 1073729 00:06:14.852 16:30:40 -- common/autotest_common.sh@945 -- # kill 1073729 00:06:14.852 16:30:40 -- common/autotest_common.sh@950 -- # wait 1073729 00:06:14.852 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.852 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.852 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:14.853 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.111 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:15.112 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:06:16.486 16:30:41 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:06:16.486 16:30:41 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:06:16.486 16:30:41 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:06:16.486 16:30:41 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:06:16.486 16:30:41 -- spdk/autotest.sh@173 -- # timing_enter lib 00:06:16.486 16:30:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:16.486 16:30:41 -- common/autotest_common.sh@10 -- # set +x 00:06:16.486 16:30:41 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:06:16.486 16:30:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:16.486 16:30:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.486 16:30:41 -- common/autotest_common.sh@10 -- # set +x 00:06:16.746 ************************************ 00:06:16.746 START TEST env 00:06:16.746 ************************************ 00:06:16.746 16:30:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:06:16.746 * Looking for test storage... 00:06:16.746 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:06:16.746 16:30:42 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:06:16.746 16:30:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:16.746 16:30:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.746 16:30:42 -- common/autotest_common.sh@10 -- # set +x 00:06:16.746 ************************************ 00:06:16.746 START TEST env_memory 00:06:16.746 ************************************ 00:06:16.746 16:30:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:06:16.746 00:06:16.746 00:06:16.746 CUnit - A unit testing framework for C - Version 2.1-3 00:06:16.746 http://cunit.sourceforge.net/ 00:06:16.746 00:06:16.746 00:06:16.746 Suite: memory 00:06:16.746 Test: alloc and free memory map ...[2024-10-13 16:30:42.077778] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:06:16.746 passed 00:06:16.746 Test: mem map translation ...[2024-10-13 16:30:42.099825] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:06:16.746 [2024-10-13 16:30:42.099852] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:06:16.746 [2024-10-13 16:30:42.099898] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:06:16.746 [2024-10-13 16:30:42.099912] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:06:16.746 passed 00:06:16.746 Test: mem map registration ...[2024-10-13 16:30:42.144589] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:06:16.746 [2024-10-13 16:30:42.144616] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:06:16.746 passed 00:06:16.746 Test: mem map adjacent registrations ...passed 00:06:16.746 00:06:16.746 Run Summary: Type Total Ran Passed Failed Inactive 00:06:16.746 suites 1 1 n/a 0 0 00:06:16.746 tests 4 4 4 0 0 00:06:16.746 asserts 152 152 152 0 n/a 00:06:16.746 00:06:16.746 Elapsed time = 0.147 seconds 00:06:16.746 00:06:16.746 real 0m0.155s 00:06:16.746 user 0m0.149s 00:06:16.746 sys 0m0.005s 00:06:16.746 16:30:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:16.746 16:30:42 -- common/autotest_common.sh@10 -- # set +x 00:06:16.746 ************************************ 00:06:16.746 END TEST env_memory 00:06:16.746 ************************************ 00:06:16.746 16:30:42 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:06:16.746 16:30:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:16.746 16:30:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.746 16:30:42 -- common/autotest_common.sh@10 -- # set +x 00:06:16.746 ************************************ 00:06:16.746 START TEST env_vtophys 00:06:16.746 ************************************ 00:06:16.746 16:30:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:06:16.746 EAL: lib.eal log level changed from notice to debug 00:06:16.746 EAL: Detected lcore 0 as core 0 on socket 0 00:06:16.746 EAL: Detected lcore 1 as core 1 on socket 0 00:06:16.746 EAL: Detected lcore 2 as core 2 on socket 0 00:06:16.746 EAL: Detected lcore 3 as core 3 on socket 0 00:06:16.746 EAL: Detected lcore 4 as core 4 on socket 0 00:06:16.746 EAL: Detected lcore 5 as core 5 on socket 0 00:06:16.746 EAL: Detected lcore 6 as core 8 on socket 0 00:06:16.746 EAL: Detected lcore 7 as core 9 on socket 0 00:06:16.747 EAL: Detected lcore 8 as core 10 on socket 0 00:06:16.747 EAL: Detected lcore 9 as core 11 on socket 0 00:06:16.747 EAL: Detected lcore 10 as core 12 on socket 0 00:06:16.747 EAL: Detected lcore 11 as core 13 on socket 0 00:06:16.747 EAL: Detected lcore 12 as core 0 on socket 1 00:06:16.747 EAL: Detected lcore 13 as core 1 on socket 1 00:06:16.747 EAL: Detected lcore 14 as core 2 on socket 1 00:06:16.747 EAL: Detected lcore 15 as core 3 on socket 1 00:06:16.747 EAL: Detected lcore 16 as core 4 on socket 1 00:06:16.747 EAL: Detected lcore 17 as core 5 on socket 1 00:06:16.747 EAL: Detected lcore 18 as core 8 on socket 1 00:06:16.747 EAL: Detected lcore 19 as core 9 on socket 1 00:06:16.747 EAL: Detected lcore 20 as core 10 on socket 1 00:06:16.747 EAL: Detected lcore 21 as core 11 on socket 1 00:06:16.747 EAL: Detected lcore 22 as core 12 on socket 1 00:06:16.747 EAL: Detected lcore 23 as core 13 on socket 1 00:06:16.747 EAL: Detected lcore 24 as core 0 on socket 0 00:06:16.747 EAL: Detected lcore 25 as core 1 on socket 0 00:06:16.747 EAL: Detected lcore 26 as core 2 on socket 0 00:06:16.747 EAL: Detected lcore 27 as core 3 on socket 0 00:06:16.747 EAL: Detected lcore 28 as core 4 on socket 0 00:06:16.747 EAL: Detected lcore 29 as core 5 on socket 0 00:06:16.747 EAL: Detected lcore 30 as core 8 on socket 0 00:06:16.747 EAL: Detected lcore 31 as core 9 on socket 0 00:06:16.747 EAL: Detected lcore 32 as core 10 on socket 0 00:06:16.747 EAL: Detected lcore 33 as core 11 on socket 0 00:06:16.747 EAL: Detected lcore 34 as core 12 on socket 0 00:06:16.747 EAL: Detected lcore 35 as core 13 on socket 0 00:06:16.747 EAL: Detected lcore 36 as core 0 on socket 1 00:06:16.747 EAL: Detected lcore 37 as core 1 on socket 1 00:06:16.747 EAL: Detected lcore 38 as core 2 on socket 1 00:06:16.747 EAL: Detected lcore 39 as core 3 on socket 1 00:06:16.747 EAL: Detected lcore 40 as core 4 on socket 1 00:06:16.747 EAL: Detected lcore 41 as core 5 on socket 1 00:06:16.747 EAL: Detected lcore 42 as core 8 on socket 1 00:06:16.747 EAL: Detected lcore 43 as core 9 on socket 1 00:06:16.747 EAL: Detected lcore 44 as core 10 on socket 1 00:06:16.747 EAL: Detected lcore 45 as core 11 on socket 1 00:06:16.747 EAL: Detected lcore 46 as core 12 on socket 1 00:06:16.747 EAL: Detected lcore 47 as core 13 on socket 1 00:06:17.006 EAL: Maximum logical cores by configuration: 128 00:06:17.006 EAL: Detected CPU lcores: 48 00:06:17.006 EAL: Detected NUMA nodes: 2 00:06:17.006 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:06:17.006 EAL: Detected shared linkage of DPDK 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:06:17.006 EAL: Registered [vdev] bus. 00:06:17.006 EAL: bus.vdev log level changed from disabled to notice 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:06:17.006 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:06:17.006 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:06:17.006 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:06:17.006 EAL: No shared files mode enabled, IPC will be disabled 00:06:17.006 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Bus pci wants IOVA as 'DC' 00:06:17.007 EAL: Bus vdev wants IOVA as 'DC' 00:06:17.007 EAL: Buses did not request a specific IOVA mode. 00:06:17.007 EAL: IOMMU is available, selecting IOVA as VA mode. 00:06:17.007 EAL: Selected IOVA mode 'VA' 00:06:17.007 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.007 EAL: Probing VFIO support... 00:06:17.007 EAL: IOMMU type 1 (Type 1) is supported 00:06:17.007 EAL: IOMMU type 7 (sPAPR) is not supported 00:06:17.007 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:06:17.007 EAL: VFIO support initialized 00:06:17.007 EAL: Ask a virtual area of 0x2e000 bytes 00:06:17.007 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:06:17.007 EAL: Setting up physically contiguous memory... 00:06:17.007 EAL: Setting maximum number of open files to 524288 00:06:17.007 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:06:17.007 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:06:17.007 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:06:17.007 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:06:17.007 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.007 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:06:17.007 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.007 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.007 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:06:17.007 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:06:17.007 EAL: Hugepages will be freed exactly as allocated. 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: TSC frequency is ~2700000 KHz 00:06:17.007 EAL: Main lcore 0 is ready (tid=7faaaeb10a00;cpuset=[0]) 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 0 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 2MB 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: No PCI address specified using 'addr=' in: bus=pci 00:06:17.007 EAL: Mem event callback 'spdk:(nil)' registered 00:06:17.007 00:06:17.007 00:06:17.007 CUnit - A unit testing framework for C - Version 2.1-3 00:06:17.007 http://cunit.sourceforge.net/ 00:06:17.007 00:06:17.007 00:06:17.007 Suite: components_suite 00:06:17.007 Test: vtophys_malloc_test ...passed 00:06:17.007 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 4MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 4MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 6MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 6MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 10MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 10MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 18MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 18MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 34MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 34MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 66MB 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was shrunk by 66MB 00:06:17.007 EAL: Trying to obtain current memory policy. 00:06:17.007 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.007 EAL: Restoring previous memory policy: 4 00:06:17.007 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.007 EAL: request: mp_malloc_sync 00:06:17.007 EAL: No shared files mode enabled, IPC is disabled 00:06:17.007 EAL: Heap on socket 0 was expanded by 130MB 00:06:17.008 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.008 EAL: request: mp_malloc_sync 00:06:17.008 EAL: No shared files mode enabled, IPC is disabled 00:06:17.008 EAL: Heap on socket 0 was shrunk by 130MB 00:06:17.008 EAL: Trying to obtain current memory policy. 00:06:17.008 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.008 EAL: Restoring previous memory policy: 4 00:06:17.008 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.008 EAL: request: mp_malloc_sync 00:06:17.008 EAL: No shared files mode enabled, IPC is disabled 00:06:17.008 EAL: Heap on socket 0 was expanded by 258MB 00:06:17.266 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.266 EAL: request: mp_malloc_sync 00:06:17.266 EAL: No shared files mode enabled, IPC is disabled 00:06:17.266 EAL: Heap on socket 0 was shrunk by 258MB 00:06:17.266 EAL: Trying to obtain current memory policy. 00:06:17.266 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.266 EAL: Restoring previous memory policy: 4 00:06:17.266 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.266 EAL: request: mp_malloc_sync 00:06:17.266 EAL: No shared files mode enabled, IPC is disabled 00:06:17.266 EAL: Heap on socket 0 was expanded by 514MB 00:06:17.524 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.524 EAL: request: mp_malloc_sync 00:06:17.524 EAL: No shared files mode enabled, IPC is disabled 00:06:17.524 EAL: Heap on socket 0 was shrunk by 514MB 00:06:17.524 EAL: Trying to obtain current memory policy. 00:06:17.524 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.782 EAL: Restoring previous memory policy: 4 00:06:17.782 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.782 EAL: request: mp_malloc_sync 00:06:17.782 EAL: No shared files mode enabled, IPC is disabled 00:06:17.782 EAL: Heap on socket 0 was expanded by 1026MB 00:06:18.039 EAL: Calling mem event callback 'spdk:(nil)' 00:06:18.298 EAL: request: mp_malloc_sync 00:06:18.298 EAL: No shared files mode enabled, IPC is disabled 00:06:18.298 EAL: Heap on socket 0 was shrunk by 1026MB 00:06:18.298 passed 00:06:18.298 00:06:18.298 Run Summary: Type Total Ran Passed Failed Inactive 00:06:18.298 suites 1 1 n/a 0 0 00:06:18.298 tests 2 2 2 0 0 00:06:18.298 asserts 497 497 497 0 n/a 00:06:18.298 00:06:18.298 Elapsed time = 1.302 seconds 00:06:18.298 EAL: Calling mem event callback 'spdk:(nil)' 00:06:18.298 EAL: request: mp_malloc_sync 00:06:18.298 EAL: No shared files mode enabled, IPC is disabled 00:06:18.298 EAL: Heap on socket 0 was shrunk by 2MB 00:06:18.298 EAL: No shared files mode enabled, IPC is disabled 00:06:18.298 EAL: No shared files mode enabled, IPC is disabled 00:06:18.298 EAL: No shared files mode enabled, IPC is disabled 00:06:18.298 00:06:18.298 real 0m1.416s 00:06:18.298 user 0m0.841s 00:06:18.298 sys 0m0.539s 00:06:18.298 16:30:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:18.298 16:30:43 -- common/autotest_common.sh@10 -- # set +x 00:06:18.298 ************************************ 00:06:18.298 END TEST env_vtophys 00:06:18.298 ************************************ 00:06:18.298 16:30:43 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:06:18.298 16:30:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:18.298 16:30:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:18.298 16:30:43 -- common/autotest_common.sh@10 -- # set +x 00:06:18.298 ************************************ 00:06:18.298 START TEST env_pci 00:06:18.298 ************************************ 00:06:18.298 16:30:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:06:18.298 00:06:18.298 00:06:18.298 CUnit - A unit testing framework for C - Version 2.1-3 00:06:18.298 http://cunit.sourceforge.net/ 00:06:18.298 00:06:18.298 00:06:18.298 Suite: pci 00:06:18.298 Test: pci_hook ...[2024-10-13 16:30:43.685519] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1074762 has claimed it 00:06:18.298 EAL: Cannot find device (10000:00:01.0) 00:06:18.298 EAL: Failed to attach device on primary process 00:06:18.298 passed 00:06:18.298 00:06:18.298 Run Summary: Type Total Ran Passed Failed Inactive 00:06:18.298 suites 1 1 n/a 0 0 00:06:18.298 tests 1 1 1 0 0 00:06:18.298 asserts 25 25 25 0 n/a 00:06:18.298 00:06:18.298 Elapsed time = 0.022 seconds 00:06:18.298 00:06:18.298 real 0m0.034s 00:06:18.298 user 0m0.009s 00:06:18.298 sys 0m0.025s 00:06:18.298 16:30:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:18.298 16:30:43 -- common/autotest_common.sh@10 -- # set +x 00:06:18.298 ************************************ 00:06:18.298 END TEST env_pci 00:06:18.298 ************************************ 00:06:18.298 16:30:43 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:06:18.298 16:30:43 -- env/env.sh@15 -- # uname 00:06:18.298 16:30:43 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:06:18.298 16:30:43 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:06:18.298 16:30:43 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:06:18.298 16:30:43 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:06:18.298 16:30:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:18.298 16:30:43 -- common/autotest_common.sh@10 -- # set +x 00:06:18.298 ************************************ 00:06:18.298 START TEST env_dpdk_post_init 00:06:18.298 ************************************ 00:06:18.298 16:30:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:06:18.298 EAL: Detected CPU lcores: 48 00:06:18.298 EAL: Detected NUMA nodes: 2 00:06:18.298 EAL: Detected shared linkage of DPDK 00:06:18.298 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:06:18.298 EAL: Selected IOVA mode 'VA' 00:06:18.298 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.298 EAL: VFIO support initialized 00:06:18.298 TELEMETRY: No legacy callbacks, legacy socket not created 00:06:18.558 EAL: Using IOMMU type 1 (Type 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:06:18.558 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:06:19.496 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:06:22.776 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:06:22.776 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:06:22.776 Starting DPDK initialization... 00:06:22.776 Starting SPDK post initialization... 00:06:22.776 SPDK NVMe probe 00:06:22.776 Attaching to 0000:88:00.0 00:06:22.776 Attached to 0000:88:00.0 00:06:22.776 Cleaning up... 00:06:22.776 00:06:22.776 real 0m4.373s 00:06:22.776 user 0m3.262s 00:06:22.776 sys 0m0.165s 00:06:22.776 16:30:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.776 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:22.776 ************************************ 00:06:22.776 END TEST env_dpdk_post_init 00:06:22.776 ************************************ 00:06:22.776 16:30:48 -- env/env.sh@26 -- # uname 00:06:22.776 16:30:48 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:06:22.776 16:30:48 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:06:22.776 16:30:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:22.776 16:30:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.776 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:22.776 ************************************ 00:06:22.776 START TEST env_mem_callbacks 00:06:22.776 ************************************ 00:06:22.776 16:30:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:06:22.776 EAL: Detected CPU lcores: 48 00:06:22.776 EAL: Detected NUMA nodes: 2 00:06:22.776 EAL: Detected shared linkage of DPDK 00:06:22.776 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:06:22.776 EAL: Selected IOVA mode 'VA' 00:06:22.776 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.776 EAL: VFIO support initialized 00:06:22.776 TELEMETRY: No legacy callbacks, legacy socket not created 00:06:22.776 00:06:22.776 00:06:22.776 CUnit - A unit testing framework for C - Version 2.1-3 00:06:22.776 http://cunit.sourceforge.net/ 00:06:22.776 00:06:22.776 00:06:22.776 Suite: memory 00:06:22.776 Test: test ... 00:06:22.776 register 0x200000200000 2097152 00:06:22.776 malloc 3145728 00:06:22.776 register 0x200000400000 4194304 00:06:22.776 buf 0x200000500000 len 3145728 PASSED 00:06:22.776 malloc 64 00:06:22.776 buf 0x2000004fff40 len 64 PASSED 00:06:22.776 malloc 4194304 00:06:22.776 register 0x200000800000 6291456 00:06:22.776 buf 0x200000a00000 len 4194304 PASSED 00:06:22.776 free 0x200000500000 3145728 00:06:22.776 free 0x2000004fff40 64 00:06:22.776 unregister 0x200000400000 4194304 PASSED 00:06:22.776 free 0x200000a00000 4194304 00:06:22.776 unregister 0x200000800000 6291456 PASSED 00:06:22.776 malloc 8388608 00:06:22.776 register 0x200000400000 10485760 00:06:22.776 buf 0x200000600000 len 8388608 PASSED 00:06:22.776 free 0x200000600000 8388608 00:06:22.776 unregister 0x200000400000 10485760 PASSED 00:06:22.776 passed 00:06:22.776 00:06:22.776 Run Summary: Type Total Ran Passed Failed Inactive 00:06:22.776 suites 1 1 n/a 0 0 00:06:22.776 tests 1 1 1 0 0 00:06:22.776 asserts 15 15 15 0 n/a 00:06:22.777 00:06:22.777 Elapsed time = 0.005 seconds 00:06:22.777 00:06:22.777 real 0m0.047s 00:06:22.777 user 0m0.009s 00:06:22.777 sys 0m0.038s 00:06:22.777 16:30:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.777 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:22.777 ************************************ 00:06:22.777 END TEST env_mem_callbacks 00:06:22.777 ************************************ 00:06:22.777 00:06:22.777 real 0m6.224s 00:06:22.777 user 0m4.366s 00:06:22.777 sys 0m0.903s 00:06:22.777 16:30:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.777 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:22.777 ************************************ 00:06:22.777 END TEST env 00:06:22.777 ************************************ 00:06:22.777 16:30:48 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:06:22.777 16:30:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:22.777 16:30:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.777 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:22.777 ************************************ 00:06:22.777 START TEST rpc 00:06:22.777 ************************************ 00:06:22.777 16:30:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:06:23.035 * Looking for test storage... 00:06:23.035 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:06:23.035 16:30:48 -- rpc/rpc.sh@65 -- # spdk_pid=1075427 00:06:23.035 16:30:48 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:06:23.035 16:30:48 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:23.035 16:30:48 -- rpc/rpc.sh@67 -- # waitforlisten 1075427 00:06:23.035 16:30:48 -- common/autotest_common.sh@819 -- # '[' -z 1075427 ']' 00:06:23.035 16:30:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.035 16:30:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:23.035 16:30:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.035 16:30:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:23.035 16:30:48 -- common/autotest_common.sh@10 -- # set +x 00:06:23.035 [2024-10-13 16:30:48.335436] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:23.035 [2024-10-13 16:30:48.335545] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1075427 ] 00:06:23.035 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.035 [2024-10-13 16:30:48.391082] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.035 [2024-10-13 16:30:48.475256] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.035 [2024-10-13 16:30:48.475438] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:06:23.035 [2024-10-13 16:30:48.475458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1075427' to capture a snapshot of events at runtime. 00:06:23.035 [2024-10-13 16:30:48.475471] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1075427 for offline analysis/debug. 00:06:23.035 [2024-10-13 16:30:48.475500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.968 16:30:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:23.968 16:30:49 -- common/autotest_common.sh@852 -- # return 0 00:06:23.968 16:30:49 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:06:23.968 16:30:49 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:06:23.968 16:30:49 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:06:23.968 16:30:49 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:06:23.968 16:30:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:23.968 16:30:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 ************************************ 00:06:23.968 START TEST rpc_integrity 00:06:23.968 ************************************ 00:06:23.968 16:30:49 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:06:23.968 16:30:49 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:06:23.968 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.968 16:30:49 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:06:23.968 16:30:49 -- rpc/rpc.sh@13 -- # jq length 00:06:23.968 16:30:49 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:06:23.968 16:30:49 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:06:23.968 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.968 16:30:49 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:06:23.968 16:30:49 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:06:23.968 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.968 16:30:49 -- rpc/rpc.sh@16 -- # bdevs='[ 00:06:23.968 { 00:06:23.968 "name": "Malloc0", 00:06:23.968 "aliases": [ 00:06:23.968 "be81efec-f5bc-43f4-b24a-9f7d6ae1fbba" 00:06:23.968 ], 00:06:23.968 "product_name": "Malloc disk", 00:06:23.968 "block_size": 512, 00:06:23.968 "num_blocks": 16384, 00:06:23.968 "uuid": "be81efec-f5bc-43f4-b24a-9f7d6ae1fbba", 00:06:23.968 "assigned_rate_limits": { 00:06:23.968 "rw_ios_per_sec": 0, 00:06:23.968 "rw_mbytes_per_sec": 0, 00:06:23.968 "r_mbytes_per_sec": 0, 00:06:23.968 "w_mbytes_per_sec": 0 00:06:23.968 }, 00:06:23.968 "claimed": false, 00:06:23.968 "zoned": false, 00:06:23.968 "supported_io_types": { 00:06:23.968 "read": true, 00:06:23.968 "write": true, 00:06:23.968 "unmap": true, 00:06:23.968 "write_zeroes": true, 00:06:23.968 "flush": true, 00:06:23.968 "reset": true, 00:06:23.968 "compare": false, 00:06:23.968 "compare_and_write": false, 00:06:23.968 "abort": true, 00:06:23.968 "nvme_admin": false, 00:06:23.968 "nvme_io": false 00:06:23.968 }, 00:06:23.968 "memory_domains": [ 00:06:23.968 { 00:06:23.968 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:23.968 "dma_device_type": 2 00:06:23.968 } 00:06:23.968 ], 00:06:23.968 "driver_specific": {} 00:06:23.968 } 00:06:23.968 ]' 00:06:23.968 16:30:49 -- rpc/rpc.sh@17 -- # jq length 00:06:23.968 16:30:49 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:06:23.968 16:30:49 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:06:23.968 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 [2024-10-13 16:30:49.403154] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:06:23.968 [2024-10-13 16:30:49.403207] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:06:23.968 [2024-10-13 16:30:49.403227] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x568b20 00:06:23.968 [2024-10-13 16:30:49.403239] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:06:23.968 [2024-10-13 16:30:49.404473] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:06:23.968 [2024-10-13 16:30:49.404497] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:06:23.968 Passthru0 00:06:23.968 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.968 16:30:49 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:06:23.968 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.968 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.968 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.968 16:30:49 -- rpc/rpc.sh@20 -- # bdevs='[ 00:06:23.968 { 00:06:23.968 "name": "Malloc0", 00:06:23.968 "aliases": [ 00:06:23.968 "be81efec-f5bc-43f4-b24a-9f7d6ae1fbba" 00:06:23.968 ], 00:06:23.968 "product_name": "Malloc disk", 00:06:23.968 "block_size": 512, 00:06:23.968 "num_blocks": 16384, 00:06:23.968 "uuid": "be81efec-f5bc-43f4-b24a-9f7d6ae1fbba", 00:06:23.969 "assigned_rate_limits": { 00:06:23.969 "rw_ios_per_sec": 0, 00:06:23.969 "rw_mbytes_per_sec": 0, 00:06:23.969 "r_mbytes_per_sec": 0, 00:06:23.969 "w_mbytes_per_sec": 0 00:06:23.969 }, 00:06:23.969 "claimed": true, 00:06:23.969 "claim_type": "exclusive_write", 00:06:23.969 "zoned": false, 00:06:23.969 "supported_io_types": { 00:06:23.969 "read": true, 00:06:23.969 "write": true, 00:06:23.969 "unmap": true, 00:06:23.969 "write_zeroes": true, 00:06:23.969 "flush": true, 00:06:23.969 "reset": true, 00:06:23.969 "compare": false, 00:06:23.969 "compare_and_write": false, 00:06:23.969 "abort": true, 00:06:23.969 "nvme_admin": false, 00:06:23.969 "nvme_io": false 00:06:23.969 }, 00:06:23.969 "memory_domains": [ 00:06:23.969 { 00:06:23.969 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:23.969 "dma_device_type": 2 00:06:23.969 } 00:06:23.969 ], 00:06:23.969 "driver_specific": {} 00:06:23.969 }, 00:06:23.969 { 00:06:23.969 "name": "Passthru0", 00:06:23.969 "aliases": [ 00:06:23.969 "b30ef70b-e1e4-5e3b-9d73-49707c62dbf1" 00:06:23.969 ], 00:06:23.969 "product_name": "passthru", 00:06:23.969 "block_size": 512, 00:06:23.969 "num_blocks": 16384, 00:06:23.969 "uuid": "b30ef70b-e1e4-5e3b-9d73-49707c62dbf1", 00:06:23.969 "assigned_rate_limits": { 00:06:23.969 "rw_ios_per_sec": 0, 00:06:23.969 "rw_mbytes_per_sec": 0, 00:06:23.969 "r_mbytes_per_sec": 0, 00:06:23.969 "w_mbytes_per_sec": 0 00:06:23.969 }, 00:06:23.969 "claimed": false, 00:06:23.969 "zoned": false, 00:06:23.969 "supported_io_types": { 00:06:23.969 "read": true, 00:06:23.969 "write": true, 00:06:23.969 "unmap": true, 00:06:23.969 "write_zeroes": true, 00:06:23.969 "flush": true, 00:06:23.969 "reset": true, 00:06:23.969 "compare": false, 00:06:23.969 "compare_and_write": false, 00:06:23.969 "abort": true, 00:06:23.969 "nvme_admin": false, 00:06:23.969 "nvme_io": false 00:06:23.969 }, 00:06:23.969 "memory_domains": [ 00:06:23.969 { 00:06:23.969 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:23.969 "dma_device_type": 2 00:06:23.969 } 00:06:23.969 ], 00:06:23.969 "driver_specific": { 00:06:23.969 "passthru": { 00:06:23.969 "name": "Passthru0", 00:06:23.969 "base_bdev_name": "Malloc0" 00:06:23.969 } 00:06:23.969 } 00:06:23.969 } 00:06:23.969 ]' 00:06:23.969 16:30:49 -- rpc/rpc.sh@21 -- # jq length 00:06:23.969 16:30:49 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:06:23.969 16:30:49 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:06:23.969 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.969 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:23.969 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.969 16:30:49 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:06:23.969 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.969 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:06:24.227 16:30:49 -- rpc/rpc.sh@26 -- # jq length 00:06:24.227 16:30:49 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:06:24.227 00:06:24.227 real 0m0.213s 00:06:24.227 user 0m0.128s 00:06:24.227 sys 0m0.026s 00:06:24.227 16:30:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 ************************************ 00:06:24.227 END TEST rpc_integrity 00:06:24.227 ************************************ 00:06:24.227 16:30:49 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:06:24.227 16:30:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:24.227 16:30:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 ************************************ 00:06:24.227 START TEST rpc_plugins 00:06:24.227 ************************************ 00:06:24.227 16:30:49 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:06:24.227 16:30:49 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:06:24.227 16:30:49 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@31 -- # bdevs='[ 00:06:24.227 { 00:06:24.227 "name": "Malloc1", 00:06:24.227 "aliases": [ 00:06:24.227 "db451fa4-8a53-44a0-9bc0-07c458404d3c" 00:06:24.227 ], 00:06:24.227 "product_name": "Malloc disk", 00:06:24.227 "block_size": 4096, 00:06:24.227 "num_blocks": 256, 00:06:24.227 "uuid": "db451fa4-8a53-44a0-9bc0-07c458404d3c", 00:06:24.227 "assigned_rate_limits": { 00:06:24.227 "rw_ios_per_sec": 0, 00:06:24.227 "rw_mbytes_per_sec": 0, 00:06:24.227 "r_mbytes_per_sec": 0, 00:06:24.227 "w_mbytes_per_sec": 0 00:06:24.227 }, 00:06:24.227 "claimed": false, 00:06:24.227 "zoned": false, 00:06:24.227 "supported_io_types": { 00:06:24.227 "read": true, 00:06:24.227 "write": true, 00:06:24.227 "unmap": true, 00:06:24.227 "write_zeroes": true, 00:06:24.227 "flush": true, 00:06:24.227 "reset": true, 00:06:24.227 "compare": false, 00:06:24.227 "compare_and_write": false, 00:06:24.227 "abort": true, 00:06:24.227 "nvme_admin": false, 00:06:24.227 "nvme_io": false 00:06:24.227 }, 00:06:24.227 "memory_domains": [ 00:06:24.227 { 00:06:24.227 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:24.227 "dma_device_type": 2 00:06:24.227 } 00:06:24.227 ], 00:06:24.227 "driver_specific": {} 00:06:24.227 } 00:06:24.227 ]' 00:06:24.227 16:30:49 -- rpc/rpc.sh@32 -- # jq length 00:06:24.227 16:30:49 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:06:24.227 16:30:49 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:06:24.227 16:30:49 -- rpc/rpc.sh@36 -- # jq length 00:06:24.227 16:30:49 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:06:24.227 00:06:24.227 real 0m0.109s 00:06:24.227 user 0m0.066s 00:06:24.227 sys 0m0.009s 00:06:24.227 16:30:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 ************************************ 00:06:24.227 END TEST rpc_plugins 00:06:24.227 ************************************ 00:06:24.227 16:30:49 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:06:24.227 16:30:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:24.227 16:30:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 ************************************ 00:06:24.227 START TEST rpc_trace_cmd_test 00:06:24.227 ************************************ 00:06:24.227 16:30:49 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:06:24.227 16:30:49 -- rpc/rpc.sh@40 -- # local info 00:06:24.227 16:30:49 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:06:24.227 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.227 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.227 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.227 16:30:49 -- rpc/rpc.sh@42 -- # info='{ 00:06:24.227 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1075427", 00:06:24.227 "tpoint_group_mask": "0x8", 00:06:24.227 "iscsi_conn": { 00:06:24.227 "mask": "0x2", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "scsi": { 00:06:24.227 "mask": "0x4", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "bdev": { 00:06:24.227 "mask": "0x8", 00:06:24.227 "tpoint_mask": "0xffffffffffffffff" 00:06:24.227 }, 00:06:24.227 "nvmf_rdma": { 00:06:24.227 "mask": "0x10", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "nvmf_tcp": { 00:06:24.227 "mask": "0x20", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "ftl": { 00:06:24.227 "mask": "0x40", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "blobfs": { 00:06:24.227 "mask": "0x80", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "dsa": { 00:06:24.227 "mask": "0x200", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "thread": { 00:06:24.227 "mask": "0x400", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "nvme_pcie": { 00:06:24.227 "mask": "0x800", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.227 "iaa": { 00:06:24.227 "mask": "0x1000", 00:06:24.227 "tpoint_mask": "0x0" 00:06:24.227 }, 00:06:24.228 "nvme_tcp": { 00:06:24.228 "mask": "0x2000", 00:06:24.228 "tpoint_mask": "0x0" 00:06:24.228 }, 00:06:24.228 "bdev_nvme": { 00:06:24.228 "mask": "0x4000", 00:06:24.228 "tpoint_mask": "0x0" 00:06:24.228 } 00:06:24.228 }' 00:06:24.228 16:30:49 -- rpc/rpc.sh@43 -- # jq length 00:06:24.228 16:30:49 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:06:24.228 16:30:49 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:06:24.485 16:30:49 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:06:24.485 16:30:49 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:06:24.485 16:30:49 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:06:24.485 16:30:49 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:06:24.485 16:30:49 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:06:24.485 16:30:49 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:06:24.485 16:30:49 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:06:24.485 00:06:24.485 real 0m0.190s 00:06:24.485 user 0m0.164s 00:06:24.485 sys 0m0.016s 00:06:24.485 16:30:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.485 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.485 ************************************ 00:06:24.485 END TEST rpc_trace_cmd_test 00:06:24.485 ************************************ 00:06:24.485 16:30:49 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:06:24.485 16:30:49 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:06:24.485 16:30:49 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:06:24.485 16:30:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:24.485 16:30:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.485 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.485 ************************************ 00:06:24.485 START TEST rpc_daemon_integrity 00:06:24.485 ************************************ 00:06:24.485 16:30:49 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:06:24.485 16:30:49 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:06:24.485 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.485 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.485 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.485 16:30:49 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:06:24.485 16:30:49 -- rpc/rpc.sh@13 -- # jq length 00:06:24.485 16:30:49 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:06:24.485 16:30:49 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:06:24.485 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.485 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.485 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.485 16:30:49 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:06:24.485 16:30:49 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:06:24.485 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.485 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.485 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.485 16:30:49 -- rpc/rpc.sh@16 -- # bdevs='[ 00:06:24.485 { 00:06:24.485 "name": "Malloc2", 00:06:24.485 "aliases": [ 00:06:24.485 "2e581856-19b1-4e73-89b3-9325fa9715c9" 00:06:24.485 ], 00:06:24.485 "product_name": "Malloc disk", 00:06:24.485 "block_size": 512, 00:06:24.485 "num_blocks": 16384, 00:06:24.485 "uuid": "2e581856-19b1-4e73-89b3-9325fa9715c9", 00:06:24.485 "assigned_rate_limits": { 00:06:24.485 "rw_ios_per_sec": 0, 00:06:24.485 "rw_mbytes_per_sec": 0, 00:06:24.485 "r_mbytes_per_sec": 0, 00:06:24.485 "w_mbytes_per_sec": 0 00:06:24.485 }, 00:06:24.485 "claimed": false, 00:06:24.485 "zoned": false, 00:06:24.485 "supported_io_types": { 00:06:24.485 "read": true, 00:06:24.485 "write": true, 00:06:24.485 "unmap": true, 00:06:24.485 "write_zeroes": true, 00:06:24.485 "flush": true, 00:06:24.485 "reset": true, 00:06:24.485 "compare": false, 00:06:24.485 "compare_and_write": false, 00:06:24.485 "abort": true, 00:06:24.485 "nvme_admin": false, 00:06:24.485 "nvme_io": false 00:06:24.485 }, 00:06:24.485 "memory_domains": [ 00:06:24.485 { 00:06:24.485 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:24.485 "dma_device_type": 2 00:06:24.485 } 00:06:24.485 ], 00:06:24.485 "driver_specific": {} 00:06:24.485 } 00:06:24.485 ]' 00:06:24.485 16:30:49 -- rpc/rpc.sh@17 -- # jq length 00:06:24.743 16:30:49 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:06:24.743 16:30:49 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:06:24.743 16:30:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.743 16:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 [2024-10-13 16:30:49.996818] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:06:24.743 [2024-10-13 16:30:49.996867] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:06:24.743 [2024-10-13 16:30:49.996891] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x567ec0 00:06:24.743 [2024-10-13 16:30:49.996903] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:06:24.743 [2024-10-13 16:30:49.998004] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:06:24.743 [2024-10-13 16:30:49.998024] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:06:24.743 Passthru0 00:06:24.743 16:30:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.743 16:30:50 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:06:24.743 16:30:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.743 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 16:30:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.743 16:30:50 -- rpc/rpc.sh@20 -- # bdevs='[ 00:06:24.743 { 00:06:24.743 "name": "Malloc2", 00:06:24.743 "aliases": [ 00:06:24.743 "2e581856-19b1-4e73-89b3-9325fa9715c9" 00:06:24.743 ], 00:06:24.743 "product_name": "Malloc disk", 00:06:24.743 "block_size": 512, 00:06:24.743 "num_blocks": 16384, 00:06:24.743 "uuid": "2e581856-19b1-4e73-89b3-9325fa9715c9", 00:06:24.743 "assigned_rate_limits": { 00:06:24.743 "rw_ios_per_sec": 0, 00:06:24.743 "rw_mbytes_per_sec": 0, 00:06:24.743 "r_mbytes_per_sec": 0, 00:06:24.743 "w_mbytes_per_sec": 0 00:06:24.743 }, 00:06:24.743 "claimed": true, 00:06:24.743 "claim_type": "exclusive_write", 00:06:24.743 "zoned": false, 00:06:24.743 "supported_io_types": { 00:06:24.743 "read": true, 00:06:24.743 "write": true, 00:06:24.743 "unmap": true, 00:06:24.743 "write_zeroes": true, 00:06:24.743 "flush": true, 00:06:24.743 "reset": true, 00:06:24.743 "compare": false, 00:06:24.743 "compare_and_write": false, 00:06:24.743 "abort": true, 00:06:24.743 "nvme_admin": false, 00:06:24.743 "nvme_io": false 00:06:24.743 }, 00:06:24.743 "memory_domains": [ 00:06:24.743 { 00:06:24.743 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:24.743 "dma_device_type": 2 00:06:24.743 } 00:06:24.743 ], 00:06:24.743 "driver_specific": {} 00:06:24.743 }, 00:06:24.743 { 00:06:24.743 "name": "Passthru0", 00:06:24.743 "aliases": [ 00:06:24.743 "c9fc23ac-bcc6-50d6-a9a9-a3c84bc184f1" 00:06:24.743 ], 00:06:24.743 "product_name": "passthru", 00:06:24.743 "block_size": 512, 00:06:24.743 "num_blocks": 16384, 00:06:24.743 "uuid": "c9fc23ac-bcc6-50d6-a9a9-a3c84bc184f1", 00:06:24.743 "assigned_rate_limits": { 00:06:24.743 "rw_ios_per_sec": 0, 00:06:24.743 "rw_mbytes_per_sec": 0, 00:06:24.743 "r_mbytes_per_sec": 0, 00:06:24.743 "w_mbytes_per_sec": 0 00:06:24.743 }, 00:06:24.743 "claimed": false, 00:06:24.743 "zoned": false, 00:06:24.743 "supported_io_types": { 00:06:24.743 "read": true, 00:06:24.743 "write": true, 00:06:24.743 "unmap": true, 00:06:24.743 "write_zeroes": true, 00:06:24.743 "flush": true, 00:06:24.743 "reset": true, 00:06:24.743 "compare": false, 00:06:24.743 "compare_and_write": false, 00:06:24.743 "abort": true, 00:06:24.743 "nvme_admin": false, 00:06:24.743 "nvme_io": false 00:06:24.743 }, 00:06:24.743 "memory_domains": [ 00:06:24.743 { 00:06:24.743 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:24.743 "dma_device_type": 2 00:06:24.743 } 00:06:24.743 ], 00:06:24.743 "driver_specific": { 00:06:24.743 "passthru": { 00:06:24.743 "name": "Passthru0", 00:06:24.743 "base_bdev_name": "Malloc2" 00:06:24.743 } 00:06:24.743 } 00:06:24.743 } 00:06:24.743 ]' 00:06:24.743 16:30:50 -- rpc/rpc.sh@21 -- # jq length 00:06:24.743 16:30:50 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:06:24.743 16:30:50 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:06:24.743 16:30:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.743 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 16:30:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.743 16:30:50 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:06:24.743 16:30:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.743 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 16:30:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.743 16:30:50 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:06:24.743 16:30:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.743 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 16:30:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.743 16:30:50 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:06:24.743 16:30:50 -- rpc/rpc.sh@26 -- # jq length 00:06:24.743 16:30:50 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:06:24.743 00:06:24.743 real 0m0.221s 00:06:24.743 user 0m0.152s 00:06:24.743 sys 0m0.015s 00:06:24.743 16:30:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.743 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:24.743 ************************************ 00:06:24.743 END TEST rpc_daemon_integrity 00:06:24.743 ************************************ 00:06:24.743 16:30:50 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:06:24.743 16:30:50 -- rpc/rpc.sh@84 -- # killprocess 1075427 00:06:24.743 16:30:50 -- common/autotest_common.sh@926 -- # '[' -z 1075427 ']' 00:06:24.743 16:30:50 -- common/autotest_common.sh@930 -- # kill -0 1075427 00:06:24.743 16:30:50 -- common/autotest_common.sh@931 -- # uname 00:06:24.743 16:30:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:24.743 16:30:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1075427 00:06:24.743 16:30:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:24.743 16:30:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:24.743 16:30:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1075427' 00:06:24.743 killing process with pid 1075427 00:06:24.743 16:30:50 -- common/autotest_common.sh@945 -- # kill 1075427 00:06:24.743 16:30:50 -- common/autotest_common.sh@950 -- # wait 1075427 00:06:25.308 00:06:25.308 real 0m2.319s 00:06:25.308 user 0m2.980s 00:06:25.308 sys 0m0.559s 00:06:25.308 16:30:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.308 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.308 ************************************ 00:06:25.308 END TEST rpc 00:06:25.308 ************************************ 00:06:25.308 16:30:50 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:25.308 16:30:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.308 16:30:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.308 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.308 ************************************ 00:06:25.308 START TEST rpc_client 00:06:25.308 ************************************ 00:06:25.308 16:30:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:25.308 * Looking for test storage... 00:06:25.308 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:06:25.308 16:30:50 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:06:25.308 OK 00:06:25.308 16:30:50 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:06:25.308 00:06:25.308 real 0m0.069s 00:06:25.308 user 0m0.036s 00:06:25.308 sys 0m0.038s 00:06:25.308 16:30:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.308 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.308 ************************************ 00:06:25.308 END TEST rpc_client 00:06:25.308 ************************************ 00:06:25.308 16:30:50 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:06:25.308 16:30:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.308 16:30:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.308 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.308 ************************************ 00:06:25.308 START TEST json_config 00:06:25.308 ************************************ 00:06:25.308 16:30:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:06:25.308 16:30:50 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:25.308 16:30:50 -- nvmf/common.sh@7 -- # uname -s 00:06:25.308 16:30:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:25.308 16:30:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:25.308 16:30:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:25.308 16:30:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:25.308 16:30:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:25.308 16:30:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:25.308 16:30:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:25.308 16:30:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:25.308 16:30:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:25.308 16:30:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:25.308 16:30:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:25.308 16:30:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:25.308 16:30:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:25.308 16:30:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:25.308 16:30:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:25.308 16:30:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:25.308 16:30:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:25.308 16:30:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:25.308 16:30:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:25.308 16:30:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.308 16:30:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.308 16:30:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.308 16:30:50 -- paths/export.sh@5 -- # export PATH 00:06:25.308 16:30:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.308 16:30:50 -- nvmf/common.sh@46 -- # : 0 00:06:25.308 16:30:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:25.309 16:30:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:25.309 16:30:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:25.309 16:30:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:25.309 16:30:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:25.309 16:30:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:25.309 16:30:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:25.309 16:30:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:25.309 16:30:50 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:06:25.309 16:30:50 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:06:25.309 16:30:50 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:06:25.309 16:30:50 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:06:25.309 16:30:50 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:06:25.309 16:30:50 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:06:25.309 16:30:50 -- json_config/json_config.sh@32 -- # declare -A app_params 00:06:25.309 16:30:50 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:06:25.309 16:30:50 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:06:25.309 16:30:50 -- json_config/json_config.sh@43 -- # last_event_id=0 00:06:25.309 16:30:50 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:25.309 16:30:50 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:06:25.309 INFO: JSON configuration test init 00:06:25.309 16:30:50 -- json_config/json_config.sh@420 -- # json_config_test_init 00:06:25.309 16:30:50 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:06:25.309 16:30:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:25.309 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.309 16:30:50 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:06:25.309 16:30:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:25.309 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.309 16:30:50 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:06:25.309 16:30:50 -- json_config/json_config.sh@98 -- # local app=target 00:06:25.309 16:30:50 -- json_config/json_config.sh@99 -- # shift 00:06:25.309 16:30:50 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:06:25.309 16:30:50 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:25.309 16:30:50 -- json_config/json_config.sh@111 -- # app_pid[$app]=1075909 00:06:25.309 16:30:50 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:06:25.309 16:30:50 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:06:25.309 Waiting for target to run... 00:06:25.309 16:30:50 -- json_config/json_config.sh@114 -- # waitforlisten 1075909 /var/tmp/spdk_tgt.sock 00:06:25.309 16:30:50 -- common/autotest_common.sh@819 -- # '[' -z 1075909 ']' 00:06:25.309 16:30:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:25.309 16:30:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.309 16:30:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:25.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:25.309 16:30:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.309 16:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:25.309 [2024-10-13 16:30:50.783284] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:25.309 [2024-10-13 16:30:50.783378] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1075909 ] 00:06:25.309 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.876 [2024-10-13 16:30:51.280756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.876 [2024-10-13 16:30:51.352427] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.876 [2024-10-13 16:30:51.352642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.441 16:30:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:26.441 16:30:51 -- common/autotest_common.sh@852 -- # return 0 00:06:26.441 16:30:51 -- json_config/json_config.sh@115 -- # echo '' 00:06:26.441 00:06:26.441 16:30:51 -- json_config/json_config.sh@322 -- # create_accel_config 00:06:26.441 16:30:51 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:06:26.441 16:30:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:26.441 16:30:51 -- common/autotest_common.sh@10 -- # set +x 00:06:26.441 16:30:51 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:06:26.441 16:30:51 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:06:26.441 16:30:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:26.441 16:30:51 -- common/autotest_common.sh@10 -- # set +x 00:06:26.441 16:30:51 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:06:26.441 16:30:51 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:06:26.441 16:30:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:29.863 16:30:54 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:06:29.863 16:30:54 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:06:29.863 16:30:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:29.863 16:30:54 -- common/autotest_common.sh@10 -- # set +x 00:06:29.863 16:30:54 -- json_config/json_config.sh@48 -- # local ret=0 00:06:29.863 16:30:54 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:29.863 16:30:54 -- json_config/json_config.sh@49 -- # local enabled_types 00:06:29.863 16:30:54 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:06:29.863 16:30:54 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:06:29.863 16:30:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:29.863 16:30:55 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:29.863 16:30:55 -- json_config/json_config.sh@51 -- # local get_types 00:06:29.863 16:30:55 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:06:29.863 16:30:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:29.863 16:30:55 -- common/autotest_common.sh@10 -- # set +x 00:06:29.863 16:30:55 -- json_config/json_config.sh@58 -- # return 0 00:06:29.863 16:30:55 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:06:29.863 16:30:55 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:06:29.863 16:30:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:29.863 16:30:55 -- common/autotest_common.sh@10 -- # set +x 00:06:29.863 16:30:55 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:29.863 16:30:55 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:06:29.863 16:30:55 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:29.864 16:30:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:30.121 MallocForNvmf0 00:06:30.121 16:30:55 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:30.121 16:30:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:30.378 MallocForNvmf1 00:06:30.378 16:30:55 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:06:30.378 16:30:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:06:30.636 [2024-10-13 16:30:55.904218] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:30.636 16:30:55 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:30.636 16:30:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:30.893 16:30:56 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:30.893 16:30:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:31.151 16:30:56 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:31.151 16:30:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:31.409 16:30:56 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:31.409 16:30:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:31.409 [2024-10-13 16:30:56.895456] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:31.666 16:30:56 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:06:31.666 16:30:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:31.666 16:30:56 -- common/autotest_common.sh@10 -- # set +x 00:06:31.666 16:30:56 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:06:31.666 16:30:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:31.666 16:30:56 -- common/autotest_common.sh@10 -- # set +x 00:06:31.666 16:30:56 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:06:31.666 16:30:56 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:31.666 16:30:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:31.924 MallocBdevForConfigChangeCheck 00:06:31.924 16:30:57 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:06:31.924 16:30:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:31.924 16:30:57 -- common/autotest_common.sh@10 -- # set +x 00:06:31.924 16:30:57 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:06:31.924 16:30:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:32.181 16:30:57 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:06:32.181 INFO: shutting down applications... 00:06:32.181 16:30:57 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:06:32.181 16:30:57 -- json_config/json_config.sh@431 -- # json_config_clear target 00:06:32.181 16:30:57 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:06:32.181 16:30:57 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:34.078 Calling clear_iscsi_subsystem 00:06:34.078 Calling clear_nvmf_subsystem 00:06:34.078 Calling clear_nbd_subsystem 00:06:34.078 Calling clear_ublk_subsystem 00:06:34.078 Calling clear_vhost_blk_subsystem 00:06:34.078 Calling clear_vhost_scsi_subsystem 00:06:34.078 Calling clear_scheduler_subsystem 00:06:34.078 Calling clear_bdev_subsystem 00:06:34.078 Calling clear_accel_subsystem 00:06:34.078 Calling clear_vmd_subsystem 00:06:34.078 Calling clear_sock_subsystem 00:06:34.078 Calling clear_iobuf_subsystem 00:06:34.078 16:30:59 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:06:34.078 16:30:59 -- json_config/json_config.sh@396 -- # count=100 00:06:34.079 16:30:59 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:06:34.079 16:30:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:34.079 16:30:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:34.079 16:30:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:34.336 16:30:59 -- json_config/json_config.sh@398 -- # break 00:06:34.336 16:30:59 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:06:34.336 16:30:59 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:06:34.336 16:30:59 -- json_config/json_config.sh@120 -- # local app=target 00:06:34.336 16:30:59 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:06:34.336 16:30:59 -- json_config/json_config.sh@124 -- # [[ -n 1075909 ]] 00:06:34.336 16:30:59 -- json_config/json_config.sh@127 -- # kill -SIGINT 1075909 00:06:34.336 16:30:59 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:06:34.336 16:30:59 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:34.336 16:30:59 -- json_config/json_config.sh@130 -- # kill -0 1075909 00:06:34.336 16:30:59 -- json_config/json_config.sh@134 -- # sleep 0.5 00:06:34.901 16:31:00 -- json_config/json_config.sh@129 -- # (( i++ )) 00:06:34.901 16:31:00 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:34.901 16:31:00 -- json_config/json_config.sh@130 -- # kill -0 1075909 00:06:34.901 16:31:00 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:06:34.902 16:31:00 -- json_config/json_config.sh@132 -- # break 00:06:34.902 16:31:00 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:06:34.902 16:31:00 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:06:34.902 SPDK target shutdown done 00:06:34.902 16:31:00 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:06:34.902 INFO: relaunching applications... 00:06:34.902 16:31:00 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:34.902 16:31:00 -- json_config/json_config.sh@98 -- # local app=target 00:06:34.902 16:31:00 -- json_config/json_config.sh@99 -- # shift 00:06:34.902 16:31:00 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:06:34.902 16:31:00 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:06:34.902 16:31:00 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:06:34.902 16:31:00 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:34.902 16:31:00 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:34.902 16:31:00 -- json_config/json_config.sh@111 -- # app_pid[$app]=1077138 00:06:34.902 16:31:00 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:34.902 16:31:00 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:06:34.902 Waiting for target to run... 00:06:34.902 16:31:00 -- json_config/json_config.sh@114 -- # waitforlisten 1077138 /var/tmp/spdk_tgt.sock 00:06:34.902 16:31:00 -- common/autotest_common.sh@819 -- # '[' -z 1077138 ']' 00:06:34.902 16:31:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:34.902 16:31:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:34.902 16:31:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:34.902 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:34.902 16:31:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:34.902 16:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:34.902 [2024-10-13 16:31:00.202790] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:34.902 [2024-10-13 16:31:00.202879] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077138 ] 00:06:34.902 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.132 [2024-10-13 16:31:00.733298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.132 [2024-10-13 16:31:00.805543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.132 [2024-10-13 16:31:00.805735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.677 [2024-10-13 16:31:03.817768] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:38.677 [2024-10-13 16:31:03.850208] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:38.677 16:31:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:38.677 16:31:04 -- common/autotest_common.sh@852 -- # return 0 00:06:38.677 16:31:04 -- json_config/json_config.sh@115 -- # echo '' 00:06:38.677 00:06:38.677 16:31:04 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:06:38.677 16:31:04 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:38.677 INFO: Checking if target configuration is the same... 00:06:38.677 16:31:04 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:38.677 16:31:04 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:06:38.677 16:31:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:38.677 + '[' 2 -ne 2 ']' 00:06:38.677 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:38.677 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:38.677 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:38.677 +++ basename /dev/fd/62 00:06:38.677 ++ mktemp /tmp/62.XXX 00:06:38.677 + tmp_file_1=/tmp/62.nDa 00:06:38.677 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:38.677 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:38.677 + tmp_file_2=/tmp/spdk_tgt_config.json.vJt 00:06:38.677 + ret=0 00:06:38.677 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:39.242 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:39.242 + diff -u /tmp/62.nDa /tmp/spdk_tgt_config.json.vJt 00:06:39.242 + echo 'INFO: JSON config files are the same' 00:06:39.242 INFO: JSON config files are the same 00:06:39.242 + rm /tmp/62.nDa /tmp/spdk_tgt_config.json.vJt 00:06:39.242 + exit 0 00:06:39.242 16:31:04 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:06:39.242 16:31:04 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:39.242 INFO: changing configuration and checking if this can be detected... 00:06:39.242 16:31:04 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:39.242 16:31:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:39.499 16:31:04 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:39.499 16:31:04 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:06:39.499 16:31:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:39.499 + '[' 2 -ne 2 ']' 00:06:39.499 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:39.499 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:39.499 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:39.499 +++ basename /dev/fd/62 00:06:39.499 ++ mktemp /tmp/62.XXX 00:06:39.499 + tmp_file_1=/tmp/62.Hex 00:06:39.499 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:39.499 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:39.499 + tmp_file_2=/tmp/spdk_tgt_config.json.4Oe 00:06:39.499 + ret=0 00:06:39.499 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:39.756 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:39.756 + diff -u /tmp/62.Hex /tmp/spdk_tgt_config.json.4Oe 00:06:39.756 + ret=1 00:06:39.756 + echo '=== Start of file: /tmp/62.Hex ===' 00:06:39.756 + cat /tmp/62.Hex 00:06:39.756 + echo '=== End of file: /tmp/62.Hex ===' 00:06:39.756 + echo '' 00:06:39.756 + echo '=== Start of file: /tmp/spdk_tgt_config.json.4Oe ===' 00:06:39.756 + cat /tmp/spdk_tgt_config.json.4Oe 00:06:39.756 + echo '=== End of file: /tmp/spdk_tgt_config.json.4Oe ===' 00:06:39.756 + echo '' 00:06:39.756 + rm /tmp/62.Hex /tmp/spdk_tgt_config.json.4Oe 00:06:39.756 + exit 1 00:06:39.756 16:31:05 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:06:39.756 INFO: configuration change detected. 00:06:39.756 16:31:05 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:06:39.756 16:31:05 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:06:39.756 16:31:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:39.756 16:31:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.756 16:31:05 -- json_config/json_config.sh@360 -- # local ret=0 00:06:39.756 16:31:05 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:06:39.756 16:31:05 -- json_config/json_config.sh@370 -- # [[ -n 1077138 ]] 00:06:39.756 16:31:05 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:06:39.756 16:31:05 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:06:39.756 16:31:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:39.756 16:31:05 -- common/autotest_common.sh@10 -- # set +x 00:06:39.756 16:31:05 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:06:39.756 16:31:05 -- json_config/json_config.sh@246 -- # uname -s 00:06:39.756 16:31:05 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:06:39.756 16:31:05 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:06:39.756 16:31:05 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:06:39.756 16:31:05 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:06:39.756 16:31:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:39.756 16:31:05 -- common/autotest_common.sh@10 -- # set +x 00:06:40.013 16:31:05 -- json_config/json_config.sh@376 -- # killprocess 1077138 00:06:40.013 16:31:05 -- common/autotest_common.sh@926 -- # '[' -z 1077138 ']' 00:06:40.013 16:31:05 -- common/autotest_common.sh@930 -- # kill -0 1077138 00:06:40.013 16:31:05 -- common/autotest_common.sh@931 -- # uname 00:06:40.013 16:31:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:40.013 16:31:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1077138 00:06:40.013 16:31:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:40.013 16:31:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:40.013 16:31:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1077138' 00:06:40.013 killing process with pid 1077138 00:06:40.013 16:31:05 -- common/autotest_common.sh@945 -- # kill 1077138 00:06:40.013 16:31:05 -- common/autotest_common.sh@950 -- # wait 1077138 00:06:41.385 16:31:06 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:41.385 16:31:06 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:06:41.385 16:31:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:41.385 16:31:06 -- common/autotest_common.sh@10 -- # set +x 00:06:41.643 16:31:06 -- json_config/json_config.sh@381 -- # return 0 00:06:41.643 16:31:06 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:06:41.643 INFO: Success 00:06:41.643 00:06:41.643 real 0m16.225s 00:06:41.643 user 0m18.474s 00:06:41.643 sys 0m2.312s 00:06:41.643 16:31:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:41.643 16:31:06 -- common/autotest_common.sh@10 -- # set +x 00:06:41.643 ************************************ 00:06:41.643 END TEST json_config 00:06:41.643 ************************************ 00:06:41.643 16:31:06 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:41.643 16:31:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:41.643 16:31:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.643 16:31:06 -- common/autotest_common.sh@10 -- # set +x 00:06:41.643 ************************************ 00:06:41.643 START TEST json_config_extra_key 00:06:41.643 ************************************ 00:06:41.643 16:31:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:41.643 16:31:06 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:41.643 16:31:06 -- nvmf/common.sh@7 -- # uname -s 00:06:41.643 16:31:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:41.643 16:31:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:41.643 16:31:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:41.643 16:31:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:41.643 16:31:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:41.643 16:31:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:41.643 16:31:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:41.643 16:31:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:41.643 16:31:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:41.643 16:31:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:41.643 16:31:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.643 16:31:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.643 16:31:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:41.643 16:31:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:41.643 16:31:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:41.643 16:31:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:41.643 16:31:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:41.643 16:31:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:41.643 16:31:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:41.643 16:31:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.643 16:31:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.643 16:31:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.643 16:31:06 -- paths/export.sh@5 -- # export PATH 00:06:41.643 16:31:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.643 16:31:06 -- nvmf/common.sh@46 -- # : 0 00:06:41.643 16:31:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:41.643 16:31:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:41.643 16:31:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:41.643 16:31:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:41.644 16:31:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:41.644 16:31:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:41.644 16:31:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:41.644 16:31:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:06:41.644 INFO: launching applications... 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@25 -- # shift 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1078078 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:06:41.644 Waiting for target to run... 00:06:41.644 16:31:06 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1078078 /var/tmp/spdk_tgt.sock 00:06:41.644 16:31:06 -- common/autotest_common.sh@819 -- # '[' -z 1078078 ']' 00:06:41.644 16:31:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:41.644 16:31:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:41.644 16:31:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:41.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:41.644 16:31:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:41.644 16:31:06 -- common/autotest_common.sh@10 -- # set +x 00:06:41.644 [2024-10-13 16:31:07.025982] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:41.644 [2024-10-13 16:31:07.026068] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078078 ] 00:06:41.644 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.211 [2024-10-13 16:31:07.529371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.211 [2024-10-13 16:31:07.601118] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.211 [2024-10-13 16:31:07.601312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.776 16:31:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:42.776 16:31:07 -- common/autotest_common.sh@852 -- # return 0 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:06:42.776 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:06:42.776 INFO: shutting down applications... 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1078078 ]] 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1078078 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1078078 00:06:42.776 16:31:07 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1078078 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:43.033 SPDK target shutdown done 00:06:43.033 16:31:08 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:43.033 Success 00:06:43.033 00:06:43.033 real 0m1.565s 00:06:43.033 user 0m1.366s 00:06:43.033 sys 0m0.592s 00:06:43.033 16:31:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:43.033 16:31:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.033 ************************************ 00:06:43.033 END TEST json_config_extra_key 00:06:43.033 ************************************ 00:06:43.033 16:31:08 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:43.033 16:31:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:43.033 16:31:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:43.033 16:31:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.033 ************************************ 00:06:43.033 START TEST alias_rpc 00:06:43.033 ************************************ 00:06:43.033 16:31:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:43.291 * Looking for test storage... 00:06:43.291 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:43.291 16:31:08 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:43.291 16:31:08 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1078386 00:06:43.291 16:31:08 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:43.291 16:31:08 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1078386 00:06:43.291 16:31:08 -- common/autotest_common.sh@819 -- # '[' -z 1078386 ']' 00:06:43.291 16:31:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.291 16:31:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:43.291 16:31:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.291 16:31:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:43.291 16:31:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.291 [2024-10-13 16:31:08.628121] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:43.291 [2024-10-13 16:31:08.628217] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078386 ] 00:06:43.291 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.291 [2024-10-13 16:31:08.686419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.291 [2024-10-13 16:31:08.770744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.291 [2024-10-13 16:31:08.770915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.225 16:31:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:44.225 16:31:09 -- common/autotest_common.sh@852 -- # return 0 00:06:44.225 16:31:09 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:44.482 16:31:09 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1078386 00:06:44.482 16:31:09 -- common/autotest_common.sh@926 -- # '[' -z 1078386 ']' 00:06:44.482 16:31:09 -- common/autotest_common.sh@930 -- # kill -0 1078386 00:06:44.482 16:31:09 -- common/autotest_common.sh@931 -- # uname 00:06:44.482 16:31:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:44.482 16:31:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1078386 00:06:44.482 16:31:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:44.482 16:31:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:44.482 16:31:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1078386' 00:06:44.482 killing process with pid 1078386 00:06:44.482 16:31:09 -- common/autotest_common.sh@945 -- # kill 1078386 00:06:44.482 16:31:09 -- common/autotest_common.sh@950 -- # wait 1078386 00:06:45.048 00:06:45.048 real 0m1.770s 00:06:45.048 user 0m2.094s 00:06:45.048 sys 0m0.432s 00:06:45.048 16:31:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:45.048 16:31:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.048 ************************************ 00:06:45.048 END TEST alias_rpc 00:06:45.048 ************************************ 00:06:45.048 16:31:10 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:06:45.048 16:31:10 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:45.048 16:31:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:45.048 16:31:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:45.048 16:31:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.048 ************************************ 00:06:45.048 START TEST spdkcli_tcp 00:06:45.048 ************************************ 00:06:45.048 16:31:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:45.048 * Looking for test storage... 00:06:45.048 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:45.048 16:31:10 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:45.048 16:31:10 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:45.048 16:31:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:45.048 16:31:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1078588 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:45.048 16:31:10 -- spdkcli/tcp.sh@27 -- # waitforlisten 1078588 00:06:45.048 16:31:10 -- common/autotest_common.sh@819 -- # '[' -z 1078588 ']' 00:06:45.048 16:31:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.048 16:31:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:45.048 16:31:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.048 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.048 16:31:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:45.048 16:31:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.048 [2024-10-13 16:31:10.431977] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:45.048 [2024-10-13 16:31:10.432066] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078588 ] 00:06:45.048 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.048 [2024-10-13 16:31:10.496473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:45.306 [2024-10-13 16:31:10.582515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.306 [2024-10-13 16:31:10.582724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.306 [2024-10-13 16:31:10.582743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.240 16:31:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:46.240 16:31:11 -- common/autotest_common.sh@852 -- # return 0 00:06:46.240 16:31:11 -- spdkcli/tcp.sh@31 -- # socat_pid=1078723 00:06:46.240 16:31:11 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:46.240 16:31:11 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:46.240 [ 00:06:46.240 "bdev_malloc_delete", 00:06:46.240 "bdev_malloc_create", 00:06:46.240 "bdev_null_resize", 00:06:46.240 "bdev_null_delete", 00:06:46.240 "bdev_null_create", 00:06:46.240 "bdev_nvme_cuse_unregister", 00:06:46.240 "bdev_nvme_cuse_register", 00:06:46.240 "bdev_opal_new_user", 00:06:46.240 "bdev_opal_set_lock_state", 00:06:46.240 "bdev_opal_delete", 00:06:46.240 "bdev_opal_get_info", 00:06:46.240 "bdev_opal_create", 00:06:46.240 "bdev_nvme_opal_revert", 00:06:46.240 "bdev_nvme_opal_init", 00:06:46.240 "bdev_nvme_send_cmd", 00:06:46.240 "bdev_nvme_get_path_iostat", 00:06:46.240 "bdev_nvme_get_mdns_discovery_info", 00:06:46.240 "bdev_nvme_stop_mdns_discovery", 00:06:46.240 "bdev_nvme_start_mdns_discovery", 00:06:46.240 "bdev_nvme_set_multipath_policy", 00:06:46.240 "bdev_nvme_set_preferred_path", 00:06:46.240 "bdev_nvme_get_io_paths", 00:06:46.240 "bdev_nvme_remove_error_injection", 00:06:46.240 "bdev_nvme_add_error_injection", 00:06:46.240 "bdev_nvme_get_discovery_info", 00:06:46.240 "bdev_nvme_stop_discovery", 00:06:46.240 "bdev_nvme_start_discovery", 00:06:46.240 "bdev_nvme_get_controller_health_info", 00:06:46.240 "bdev_nvme_disable_controller", 00:06:46.240 "bdev_nvme_enable_controller", 00:06:46.240 "bdev_nvme_reset_controller", 00:06:46.240 "bdev_nvme_get_transport_statistics", 00:06:46.240 "bdev_nvme_apply_firmware", 00:06:46.240 "bdev_nvme_detach_controller", 00:06:46.240 "bdev_nvme_get_controllers", 00:06:46.240 "bdev_nvme_attach_controller", 00:06:46.240 "bdev_nvme_set_hotplug", 00:06:46.240 "bdev_nvme_set_options", 00:06:46.240 "bdev_passthru_delete", 00:06:46.240 "bdev_passthru_create", 00:06:46.240 "bdev_lvol_grow_lvstore", 00:06:46.240 "bdev_lvol_get_lvols", 00:06:46.240 "bdev_lvol_get_lvstores", 00:06:46.240 "bdev_lvol_delete", 00:06:46.240 "bdev_lvol_set_read_only", 00:06:46.240 "bdev_lvol_resize", 00:06:46.240 "bdev_lvol_decouple_parent", 00:06:46.240 "bdev_lvol_inflate", 00:06:46.240 "bdev_lvol_rename", 00:06:46.240 "bdev_lvol_clone_bdev", 00:06:46.240 "bdev_lvol_clone", 00:06:46.240 "bdev_lvol_snapshot", 00:06:46.240 "bdev_lvol_create", 00:06:46.240 "bdev_lvol_delete_lvstore", 00:06:46.240 "bdev_lvol_rename_lvstore", 00:06:46.240 "bdev_lvol_create_lvstore", 00:06:46.240 "bdev_raid_set_options", 00:06:46.240 "bdev_raid_remove_base_bdev", 00:06:46.240 "bdev_raid_add_base_bdev", 00:06:46.240 "bdev_raid_delete", 00:06:46.240 "bdev_raid_create", 00:06:46.240 "bdev_raid_get_bdevs", 00:06:46.240 "bdev_error_inject_error", 00:06:46.240 "bdev_error_delete", 00:06:46.240 "bdev_error_create", 00:06:46.240 "bdev_split_delete", 00:06:46.240 "bdev_split_create", 00:06:46.240 "bdev_delay_delete", 00:06:46.240 "bdev_delay_create", 00:06:46.240 "bdev_delay_update_latency", 00:06:46.240 "bdev_zone_block_delete", 00:06:46.240 "bdev_zone_block_create", 00:06:46.240 "blobfs_create", 00:06:46.240 "blobfs_detect", 00:06:46.240 "blobfs_set_cache_size", 00:06:46.240 "bdev_aio_delete", 00:06:46.240 "bdev_aio_rescan", 00:06:46.240 "bdev_aio_create", 00:06:46.240 "bdev_ftl_set_property", 00:06:46.240 "bdev_ftl_get_properties", 00:06:46.240 "bdev_ftl_get_stats", 00:06:46.240 "bdev_ftl_unmap", 00:06:46.240 "bdev_ftl_unload", 00:06:46.240 "bdev_ftl_delete", 00:06:46.240 "bdev_ftl_load", 00:06:46.240 "bdev_ftl_create", 00:06:46.240 "bdev_virtio_attach_controller", 00:06:46.240 "bdev_virtio_scsi_get_devices", 00:06:46.240 "bdev_virtio_detach_controller", 00:06:46.240 "bdev_virtio_blk_set_hotplug", 00:06:46.240 "bdev_iscsi_delete", 00:06:46.240 "bdev_iscsi_create", 00:06:46.240 "bdev_iscsi_set_options", 00:06:46.240 "accel_error_inject_error", 00:06:46.240 "ioat_scan_accel_module", 00:06:46.240 "dsa_scan_accel_module", 00:06:46.240 "iaa_scan_accel_module", 00:06:46.240 "vfu_virtio_create_scsi_endpoint", 00:06:46.240 "vfu_virtio_scsi_remove_target", 00:06:46.240 "vfu_virtio_scsi_add_target", 00:06:46.240 "vfu_virtio_create_blk_endpoint", 00:06:46.240 "vfu_virtio_delete_endpoint", 00:06:46.240 "iscsi_set_options", 00:06:46.240 "iscsi_get_auth_groups", 00:06:46.240 "iscsi_auth_group_remove_secret", 00:06:46.240 "iscsi_auth_group_add_secret", 00:06:46.240 "iscsi_delete_auth_group", 00:06:46.240 "iscsi_create_auth_group", 00:06:46.240 "iscsi_set_discovery_auth", 00:06:46.240 "iscsi_get_options", 00:06:46.240 "iscsi_target_node_request_logout", 00:06:46.240 "iscsi_target_node_set_redirect", 00:06:46.240 "iscsi_target_node_set_auth", 00:06:46.240 "iscsi_target_node_add_lun", 00:06:46.240 "iscsi_get_connections", 00:06:46.240 "iscsi_portal_group_set_auth", 00:06:46.240 "iscsi_start_portal_group", 00:06:46.240 "iscsi_delete_portal_group", 00:06:46.240 "iscsi_create_portal_group", 00:06:46.240 "iscsi_get_portal_groups", 00:06:46.240 "iscsi_delete_target_node", 00:06:46.240 "iscsi_target_node_remove_pg_ig_maps", 00:06:46.240 "iscsi_target_node_add_pg_ig_maps", 00:06:46.240 "iscsi_create_target_node", 00:06:46.240 "iscsi_get_target_nodes", 00:06:46.240 "iscsi_delete_initiator_group", 00:06:46.240 "iscsi_initiator_group_remove_initiators", 00:06:46.240 "iscsi_initiator_group_add_initiators", 00:06:46.240 "iscsi_create_initiator_group", 00:06:46.240 "iscsi_get_initiator_groups", 00:06:46.240 "nvmf_set_crdt", 00:06:46.240 "nvmf_set_config", 00:06:46.240 "nvmf_set_max_subsystems", 00:06:46.240 "nvmf_subsystem_get_listeners", 00:06:46.240 "nvmf_subsystem_get_qpairs", 00:06:46.240 "nvmf_subsystem_get_controllers", 00:06:46.240 "nvmf_get_stats", 00:06:46.240 "nvmf_get_transports", 00:06:46.240 "nvmf_create_transport", 00:06:46.240 "nvmf_get_targets", 00:06:46.240 "nvmf_delete_target", 00:06:46.240 "nvmf_create_target", 00:06:46.240 "nvmf_subsystem_allow_any_host", 00:06:46.240 "nvmf_subsystem_remove_host", 00:06:46.240 "nvmf_subsystem_add_host", 00:06:46.240 "nvmf_subsystem_remove_ns", 00:06:46.240 "nvmf_subsystem_add_ns", 00:06:46.240 "nvmf_subsystem_listener_set_ana_state", 00:06:46.240 "nvmf_discovery_get_referrals", 00:06:46.240 "nvmf_discovery_remove_referral", 00:06:46.240 "nvmf_discovery_add_referral", 00:06:46.240 "nvmf_subsystem_remove_listener", 00:06:46.240 "nvmf_subsystem_add_listener", 00:06:46.240 "nvmf_delete_subsystem", 00:06:46.240 "nvmf_create_subsystem", 00:06:46.240 "nvmf_get_subsystems", 00:06:46.240 "env_dpdk_get_mem_stats", 00:06:46.240 "nbd_get_disks", 00:06:46.240 "nbd_stop_disk", 00:06:46.240 "nbd_start_disk", 00:06:46.240 "ublk_recover_disk", 00:06:46.240 "ublk_get_disks", 00:06:46.240 "ublk_stop_disk", 00:06:46.240 "ublk_start_disk", 00:06:46.240 "ublk_destroy_target", 00:06:46.240 "ublk_create_target", 00:06:46.240 "virtio_blk_create_transport", 00:06:46.240 "virtio_blk_get_transports", 00:06:46.240 "vhost_controller_set_coalescing", 00:06:46.240 "vhost_get_controllers", 00:06:46.240 "vhost_delete_controller", 00:06:46.240 "vhost_create_blk_controller", 00:06:46.240 "vhost_scsi_controller_remove_target", 00:06:46.240 "vhost_scsi_controller_add_target", 00:06:46.240 "vhost_start_scsi_controller", 00:06:46.240 "vhost_create_scsi_controller", 00:06:46.240 "thread_set_cpumask", 00:06:46.240 "framework_get_scheduler", 00:06:46.240 "framework_set_scheduler", 00:06:46.240 "framework_get_reactors", 00:06:46.240 "thread_get_io_channels", 00:06:46.240 "thread_get_pollers", 00:06:46.240 "thread_get_stats", 00:06:46.240 "framework_monitor_context_switch", 00:06:46.240 "spdk_kill_instance", 00:06:46.240 "log_enable_timestamps", 00:06:46.240 "log_get_flags", 00:06:46.240 "log_clear_flag", 00:06:46.240 "log_set_flag", 00:06:46.240 "log_get_level", 00:06:46.240 "log_set_level", 00:06:46.240 "log_get_print_level", 00:06:46.240 "log_set_print_level", 00:06:46.240 "framework_enable_cpumask_locks", 00:06:46.240 "framework_disable_cpumask_locks", 00:06:46.240 "framework_wait_init", 00:06:46.240 "framework_start_init", 00:06:46.240 "scsi_get_devices", 00:06:46.240 "bdev_get_histogram", 00:06:46.240 "bdev_enable_histogram", 00:06:46.240 "bdev_set_qos_limit", 00:06:46.240 "bdev_set_qd_sampling_period", 00:06:46.240 "bdev_get_bdevs", 00:06:46.240 "bdev_reset_iostat", 00:06:46.240 "bdev_get_iostat", 00:06:46.240 "bdev_examine", 00:06:46.240 "bdev_wait_for_examine", 00:06:46.240 "bdev_set_options", 00:06:46.240 "notify_get_notifications", 00:06:46.240 "notify_get_types", 00:06:46.240 "accel_get_stats", 00:06:46.240 "accel_set_options", 00:06:46.240 "accel_set_driver", 00:06:46.240 "accel_crypto_key_destroy", 00:06:46.240 "accel_crypto_keys_get", 00:06:46.240 "accel_crypto_key_create", 00:06:46.240 "accel_assign_opc", 00:06:46.240 "accel_get_module_info", 00:06:46.240 "accel_get_opc_assignments", 00:06:46.240 "vmd_rescan", 00:06:46.240 "vmd_remove_device", 00:06:46.240 "vmd_enable", 00:06:46.240 "sock_set_default_impl", 00:06:46.240 "sock_impl_set_options", 00:06:46.240 "sock_impl_get_options", 00:06:46.240 "iobuf_get_stats", 00:06:46.240 "iobuf_set_options", 00:06:46.240 "framework_get_pci_devices", 00:06:46.240 "framework_get_config", 00:06:46.240 "framework_get_subsystems", 00:06:46.240 "vfu_tgt_set_base_path", 00:06:46.240 "trace_get_info", 00:06:46.241 "trace_get_tpoint_group_mask", 00:06:46.241 "trace_disable_tpoint_group", 00:06:46.241 "trace_enable_tpoint_group", 00:06:46.241 "trace_clear_tpoint_mask", 00:06:46.241 "trace_set_tpoint_mask", 00:06:46.241 "spdk_get_version", 00:06:46.241 "rpc_get_methods" 00:06:46.241 ] 00:06:46.241 16:31:11 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:46.241 16:31:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:46.241 16:31:11 -- common/autotest_common.sh@10 -- # set +x 00:06:46.241 16:31:11 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:46.241 16:31:11 -- spdkcli/tcp.sh@38 -- # killprocess 1078588 00:06:46.241 16:31:11 -- common/autotest_common.sh@926 -- # '[' -z 1078588 ']' 00:06:46.241 16:31:11 -- common/autotest_common.sh@930 -- # kill -0 1078588 00:06:46.241 16:31:11 -- common/autotest_common.sh@931 -- # uname 00:06:46.241 16:31:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:46.241 16:31:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1078588 00:06:46.241 16:31:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:46.241 16:31:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:46.241 16:31:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1078588' 00:06:46.241 killing process with pid 1078588 00:06:46.241 16:31:11 -- common/autotest_common.sh@945 -- # kill 1078588 00:06:46.241 16:31:11 -- common/autotest_common.sh@950 -- # wait 1078588 00:06:46.806 00:06:46.806 real 0m1.786s 00:06:46.806 user 0m3.539s 00:06:46.806 sys 0m0.493s 00:06:46.806 16:31:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:46.806 16:31:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.806 ************************************ 00:06:46.806 END TEST spdkcli_tcp 00:06:46.806 ************************************ 00:06:46.806 16:31:12 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:46.806 16:31:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:46.806 16:31:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:46.806 16:31:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.806 ************************************ 00:06:46.806 START TEST dpdk_mem_utility 00:06:46.806 ************************************ 00:06:46.806 16:31:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:46.806 * Looking for test storage... 00:06:46.806 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:46.806 16:31:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:46.806 16:31:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1078920 00:06:46.806 16:31:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:46.806 16:31:12 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1078920 00:06:46.806 16:31:12 -- common/autotest_common.sh@819 -- # '[' -z 1078920 ']' 00:06:46.806 16:31:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:46.806 16:31:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:46.806 16:31:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:46.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:46.806 16:31:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:46.806 16:31:12 -- common/autotest_common.sh@10 -- # set +x 00:06:46.806 [2024-10-13 16:31:12.235354] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:46.806 [2024-10-13 16:31:12.235452] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078920 ] 00:06:46.806 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.806 [2024-10-13 16:31:12.290689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.064 [2024-10-13 16:31:12.373283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:47.064 [2024-10-13 16:31:12.373480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.998 16:31:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:47.998 16:31:13 -- common/autotest_common.sh@852 -- # return 0 00:06:47.998 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:47.998 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:47.998 16:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:47.998 16:31:13 -- common/autotest_common.sh@10 -- # set +x 00:06:47.998 { 00:06:47.998 "filename": "/tmp/spdk_mem_dump.txt" 00:06:47.998 } 00:06:47.998 16:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:47.998 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:47.998 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:47.998 1 heaps totaling size 814.000000 MiB 00:06:47.998 size: 814.000000 MiB heap id: 0 00:06:47.998 end heaps---------- 00:06:47.998 8 mempools totaling size 598.116089 MiB 00:06:47.998 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:47.998 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:47.998 size: 84.521057 MiB name: bdev_io_1078920 00:06:47.998 size: 51.011292 MiB name: evtpool_1078920 00:06:47.998 size: 50.003479 MiB name: msgpool_1078920 00:06:47.998 size: 21.763794 MiB name: PDU_Pool 00:06:47.998 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:47.998 size: 0.026123 MiB name: Session_Pool 00:06:47.998 end mempools------- 00:06:47.998 6 memzones totaling size 4.142822 MiB 00:06:47.998 size: 1.000366 MiB name: RG_ring_0_1078920 00:06:47.998 size: 1.000366 MiB name: RG_ring_1_1078920 00:06:47.998 size: 1.000366 MiB name: RG_ring_4_1078920 00:06:47.998 size: 1.000366 MiB name: RG_ring_5_1078920 00:06:47.998 size: 0.125366 MiB name: RG_ring_2_1078920 00:06:47.998 size: 0.015991 MiB name: RG_ring_3_1078920 00:06:47.998 end memzones------- 00:06:47.998 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:47.998 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:47.998 list of free elements. size: 12.519348 MiB 00:06:47.998 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:47.998 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:47.998 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:47.998 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:47.998 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:47.998 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:47.998 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:47.998 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:47.998 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:47.998 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:47.998 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:47.998 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:47.998 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:47.998 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:47.998 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:47.998 list of standard malloc elements. size: 199.218079 MiB 00:06:47.998 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:47.998 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:47.998 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:47.998 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:47.998 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:47.998 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:47.998 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:47.998 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:47.998 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:47.998 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:47.998 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:47.998 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:47.998 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:47.998 list of memzone associated elements. size: 602.262573 MiB 00:06:47.998 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:47.998 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:47.998 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:47.998 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:47.998 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:47.999 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1078920_0 00:06:47.999 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:47.999 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1078920_0 00:06:47.999 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:47.999 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1078920_0 00:06:47.999 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:47.999 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:47.999 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:47.999 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:47.999 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:47.999 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1078920 00:06:47.999 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:47.999 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1078920 00:06:47.999 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:47.999 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1078920 00:06:47.999 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:47.999 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:47.999 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:47.999 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:47.999 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:47.999 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:47.999 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:47.999 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:47.999 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:47.999 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1078920 00:06:47.999 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:47.999 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1078920 00:06:47.999 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:47.999 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1078920 00:06:47.999 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:47.999 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1078920 00:06:47.999 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:47.999 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1078920 00:06:47.999 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:47.999 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:47.999 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:47.999 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:47.999 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:47.999 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:47.999 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:47.999 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1078920 00:06:47.999 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:47.999 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:47.999 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:47.999 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:47.999 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:47.999 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1078920 00:06:47.999 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:47.999 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:47.999 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:47.999 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1078920 00:06:47.999 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:47.999 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1078920 00:06:47.999 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:47.999 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:47.999 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:47.999 16:31:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1078920 00:06:47.999 16:31:13 -- common/autotest_common.sh@926 -- # '[' -z 1078920 ']' 00:06:47.999 16:31:13 -- common/autotest_common.sh@930 -- # kill -0 1078920 00:06:47.999 16:31:13 -- common/autotest_common.sh@931 -- # uname 00:06:47.999 16:31:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:47.999 16:31:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1078920 00:06:47.999 16:31:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:47.999 16:31:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:47.999 16:31:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1078920' 00:06:47.999 killing process with pid 1078920 00:06:47.999 16:31:13 -- common/autotest_common.sh@945 -- # kill 1078920 00:06:47.999 16:31:13 -- common/autotest_common.sh@950 -- # wait 1078920 00:06:48.257 00:06:48.257 real 0m1.579s 00:06:48.257 user 0m1.760s 00:06:48.257 sys 0m0.426s 00:06:48.257 16:31:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:48.257 16:31:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.257 ************************************ 00:06:48.257 END TEST dpdk_mem_utility 00:06:48.257 ************************************ 00:06:48.257 16:31:13 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:48.257 16:31:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:48.257 16:31:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:48.257 16:31:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.257 ************************************ 00:06:48.257 START TEST event 00:06:48.257 ************************************ 00:06:48.257 16:31:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:48.515 * Looking for test storage... 00:06:48.515 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:48.515 16:31:13 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:48.515 16:31:13 -- bdev/nbd_common.sh@6 -- # set -e 00:06:48.515 16:31:13 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:48.515 16:31:13 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:48.515 16:31:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:48.515 16:31:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.515 ************************************ 00:06:48.515 START TEST event_perf 00:06:48.515 ************************************ 00:06:48.515 16:31:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:48.515 Running I/O for 1 seconds...[2024-10-13 16:31:13.801643] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:48.515 [2024-10-13 16:31:13.801744] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1079182 ] 00:06:48.515 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.515 [2024-10-13 16:31:13.860889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:48.515 [2024-10-13 16:31:13.942748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:48.515 [2024-10-13 16:31:13.942809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:48.515 [2024-10-13 16:31:13.942877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:48.515 [2024-10-13 16:31:13.942879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.888 Running I/O for 1 seconds... 00:06:49.888 lcore 0: 232051 00:06:49.888 lcore 1: 232049 00:06:49.888 lcore 2: 232052 00:06:49.888 lcore 3: 232055 00:06:49.888 done. 00:06:49.888 00:06:49.888 real 0m1.231s 00:06:49.888 user 0m4.147s 00:06:49.888 sys 0m0.078s 00:06:49.888 16:31:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.888 16:31:15 -- common/autotest_common.sh@10 -- # set +x 00:06:49.888 ************************************ 00:06:49.888 END TEST event_perf 00:06:49.888 ************************************ 00:06:49.888 16:31:15 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:49.888 16:31:15 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:49.888 16:31:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.888 16:31:15 -- common/autotest_common.sh@10 -- # set +x 00:06:49.888 ************************************ 00:06:49.888 START TEST event_reactor 00:06:49.888 ************************************ 00:06:49.888 16:31:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:49.888 [2024-10-13 16:31:15.058344] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:49.888 [2024-10-13 16:31:15.058460] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1079403 ] 00:06:49.888 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.888 [2024-10-13 16:31:15.114070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.888 [2024-10-13 16:31:15.195113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.820 test_start 00:06:50.820 oneshot 00:06:50.820 tick 100 00:06:50.820 tick 100 00:06:50.820 tick 250 00:06:50.820 tick 100 00:06:50.820 tick 100 00:06:50.820 tick 100 00:06:50.820 tick 250 00:06:50.820 tick 500 00:06:50.820 tick 100 00:06:50.820 tick 100 00:06:50.820 tick 250 00:06:50.820 tick 100 00:06:50.820 tick 100 00:06:50.820 test_end 00:06:50.820 00:06:50.820 real 0m1.224s 00:06:50.820 user 0m1.141s 00:06:50.820 sys 0m0.077s 00:06:50.820 16:31:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.820 16:31:16 -- common/autotest_common.sh@10 -- # set +x 00:06:50.820 ************************************ 00:06:50.820 END TEST event_reactor 00:06:50.820 ************************************ 00:06:50.820 16:31:16 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:50.820 16:31:16 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:50.820 16:31:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.820 16:31:16 -- common/autotest_common.sh@10 -- # set +x 00:06:50.820 ************************************ 00:06:50.820 START TEST event_reactor_perf 00:06:50.820 ************************************ 00:06:50.820 16:31:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:50.820 [2024-10-13 16:31:16.306761] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:50.820 [2024-10-13 16:31:16.306849] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1079557 ] 00:06:51.077 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.077 [2024-10-13 16:31:16.359153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.077 [2024-10-13 16:31:16.439778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.449 test_start 00:06:52.449 test_end 00:06:52.449 Performance: 442218 events per second 00:06:52.449 00:06:52.449 real 0m1.219s 00:06:52.449 user 0m1.139s 00:06:52.449 sys 0m0.075s 00:06:52.449 16:31:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:52.449 16:31:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.449 ************************************ 00:06:52.449 END TEST event_reactor_perf 00:06:52.449 ************************************ 00:06:52.449 16:31:17 -- event/event.sh@49 -- # uname -s 00:06:52.449 16:31:17 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:52.449 16:31:17 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:52.449 16:31:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:52.449 16:31:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:52.449 16:31:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.449 ************************************ 00:06:52.449 START TEST event_scheduler 00:06:52.449 ************************************ 00:06:52.449 16:31:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:52.449 * Looking for test storage... 00:06:52.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1079738 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@37 -- # waitforlisten 1079738 00:06:52.449 16:31:17 -- common/autotest_common.sh@819 -- # '[' -z 1079738 ']' 00:06:52.449 16:31:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:52.449 16:31:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:52.449 16:31:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:52.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:52.449 16:31:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:52.449 16:31:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.449 [2024-10-13 16:31:17.640986] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:52.449 [2024-10-13 16:31:17.641061] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1079738 ] 00:06:52.449 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.449 [2024-10-13 16:31:17.697948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:52.449 [2024-10-13 16:31:17.783480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.449 [2024-10-13 16:31:17.783543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:52.449 [2024-10-13 16:31:17.783608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:52.449 [2024-10-13 16:31:17.783610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:52.449 16:31:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:52.449 16:31:17 -- common/autotest_common.sh@852 -- # return 0 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:52.449 16:31:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.449 16:31:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.449 POWER: Env isn't set yet! 00:06:52.449 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:52.449 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:52.449 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:52.449 POWER: Cannot get available frequencies of lcore 0 00:06:52.449 POWER: Attempting to initialise PSTAT power management... 00:06:52.449 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:52.449 POWER: Initialized successfully for lcore 0 power management 00:06:52.449 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:52.449 POWER: Initialized successfully for lcore 1 power management 00:06:52.449 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:52.449 POWER: Initialized successfully for lcore 2 power management 00:06:52.449 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:52.449 POWER: Initialized successfully for lcore 3 power management 00:06:52.449 [2024-10-13 16:31:17.909607] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:52.449 [2024-10-13 16:31:17.909625] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:52.449 [2024-10-13 16:31:17.909636] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:52.449 16:31:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.449 16:31:17 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:52.449 16:31:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.449 16:31:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 [2024-10-13 16:31:18.011019] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:52.706 16:31:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:52.706 16:31:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 ************************************ 00:06:52.706 START TEST scheduler_create_thread 00:06:52.706 ************************************ 00:06:52.706 16:31:18 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 2 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 3 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 4 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 5 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 6 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 7 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 8 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 9 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 10 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:52.706 16:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.706 16:31:18 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:52.706 16:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.706 16:31:18 -- common/autotest_common.sh@10 -- # set +x 00:06:54.077 16:31:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:54.077 16:31:19 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:54.077 16:31:19 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:54.077 16:31:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:54.077 16:31:19 -- common/autotest_common.sh@10 -- # set +x 00:06:55.449 16:31:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.449 00:06:55.449 real 0m2.621s 00:06:55.449 user 0m0.012s 00:06:55.449 sys 0m0.004s 00:06:55.449 16:31:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:55.449 16:31:20 -- common/autotest_common.sh@10 -- # set +x 00:06:55.449 ************************************ 00:06:55.449 END TEST scheduler_create_thread 00:06:55.449 ************************************ 00:06:55.449 16:31:20 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:55.449 16:31:20 -- scheduler/scheduler.sh@46 -- # killprocess 1079738 00:06:55.449 16:31:20 -- common/autotest_common.sh@926 -- # '[' -z 1079738 ']' 00:06:55.449 16:31:20 -- common/autotest_common.sh@930 -- # kill -0 1079738 00:06:55.449 16:31:20 -- common/autotest_common.sh@931 -- # uname 00:06:55.449 16:31:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:55.449 16:31:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1079738 00:06:55.449 16:31:20 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:06:55.449 16:31:20 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:06:55.449 16:31:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1079738' 00:06:55.449 killing process with pid 1079738 00:06:55.449 16:31:20 -- common/autotest_common.sh@945 -- # kill 1079738 00:06:55.449 16:31:20 -- common/autotest_common.sh@950 -- # wait 1079738 00:06:55.706 [2024-10-13 16:31:21.118507] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:55.963 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:55.963 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:55.963 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:55.963 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:55.963 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:55.963 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:55.963 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:55.963 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:55.963 00:06:55.963 real 0m3.809s 00:06:55.963 user 0m5.863s 00:06:55.963 sys 0m0.308s 00:06:55.963 16:31:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:55.963 16:31:21 -- common/autotest_common.sh@10 -- # set +x 00:06:55.963 ************************************ 00:06:55.963 END TEST event_scheduler 00:06:55.963 ************************************ 00:06:55.963 16:31:21 -- event/event.sh@51 -- # modprobe -n nbd 00:06:55.963 16:31:21 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:55.963 16:31:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:55.963 16:31:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:55.963 16:31:21 -- common/autotest_common.sh@10 -- # set +x 00:06:55.963 ************************************ 00:06:55.963 START TEST app_repeat 00:06:55.963 ************************************ 00:06:55.963 16:31:21 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:06:55.963 16:31:21 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:55.963 16:31:21 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:55.963 16:31:21 -- event/event.sh@13 -- # local nbd_list 00:06:55.963 16:31:21 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:55.963 16:31:21 -- event/event.sh@14 -- # local bdev_list 00:06:55.963 16:31:21 -- event/event.sh@15 -- # local repeat_times=4 00:06:55.963 16:31:21 -- event/event.sh@17 -- # modprobe nbd 00:06:55.963 16:31:21 -- event/event.sh@19 -- # repeat_pid=1080199 00:06:55.963 16:31:21 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:55.963 16:31:21 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:55.963 16:31:21 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1080199' 00:06:55.963 Process app_repeat pid: 1080199 00:06:55.963 16:31:21 -- event/event.sh@23 -- # for i in {0..2} 00:06:55.964 16:31:21 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:55.964 spdk_app_start Round 0 00:06:55.964 16:31:21 -- event/event.sh@25 -- # waitforlisten 1080199 /var/tmp/spdk-nbd.sock 00:06:55.964 16:31:21 -- common/autotest_common.sh@819 -- # '[' -z 1080199 ']' 00:06:55.964 16:31:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:55.964 16:31:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:55.964 16:31:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:55.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:55.964 16:31:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:55.964 16:31:21 -- common/autotest_common.sh@10 -- # set +x 00:06:55.964 [2024-10-13 16:31:21.415126] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:06:55.964 [2024-10-13 16:31:21.415208] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1080199 ] 00:06:55.964 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.221 [2024-10-13 16:31:21.478164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:56.221 [2024-10-13 16:31:21.566971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:56.221 [2024-10-13 16:31:21.566976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.154 16:31:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:57.154 16:31:22 -- common/autotest_common.sh@852 -- # return 0 00:06:57.154 16:31:22 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:57.154 Malloc0 00:06:57.154 16:31:22 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:57.719 Malloc1 00:06:57.719 16:31:22 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@12 -- # local i 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:57.719 16:31:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:57.719 /dev/nbd0 00:06:57.719 16:31:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:57.719 16:31:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:57.719 16:31:23 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:57.719 16:31:23 -- common/autotest_common.sh@857 -- # local i 00:06:57.719 16:31:23 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:57.719 16:31:23 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:57.719 16:31:23 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:57.719 16:31:23 -- common/autotest_common.sh@861 -- # break 00:06:57.719 16:31:23 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:57.719 16:31:23 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:57.719 16:31:23 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:57.719 1+0 records in 00:06:57.719 1+0 records out 00:06:57.719 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193756 s, 21.1 MB/s 00:06:57.719 16:31:23 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:57.719 16:31:23 -- common/autotest_common.sh@874 -- # size=4096 00:06:57.719 16:31:23 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:57.719 16:31:23 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:57.719 16:31:23 -- common/autotest_common.sh@877 -- # return 0 00:06:57.719 16:31:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:57.719 16:31:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:57.719 16:31:23 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:57.976 /dev/nbd1 00:06:57.976 16:31:23 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:57.976 16:31:23 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:57.976 16:31:23 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:57.976 16:31:23 -- common/autotest_common.sh@857 -- # local i 00:06:57.976 16:31:23 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:57.976 16:31:23 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:57.976 16:31:23 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:57.976 16:31:23 -- common/autotest_common.sh@861 -- # break 00:06:57.976 16:31:23 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:57.976 16:31:23 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:57.976 16:31:23 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:58.233 1+0 records in 00:06:58.233 1+0 records out 00:06:58.234 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206685 s, 19.8 MB/s 00:06:58.234 16:31:23 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:58.234 16:31:23 -- common/autotest_common.sh@874 -- # size=4096 00:06:58.234 16:31:23 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:58.234 16:31:23 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:58.234 16:31:23 -- common/autotest_common.sh@877 -- # return 0 00:06:58.234 16:31:23 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:58.234 16:31:23 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:58.234 16:31:23 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:58.234 16:31:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.234 16:31:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:58.492 { 00:06:58.492 "nbd_device": "/dev/nbd0", 00:06:58.492 "bdev_name": "Malloc0" 00:06:58.492 }, 00:06:58.492 { 00:06:58.492 "nbd_device": "/dev/nbd1", 00:06:58.492 "bdev_name": "Malloc1" 00:06:58.492 } 00:06:58.492 ]' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:58.492 { 00:06:58.492 "nbd_device": "/dev/nbd0", 00:06:58.492 "bdev_name": "Malloc0" 00:06:58.492 }, 00:06:58.492 { 00:06:58.492 "nbd_device": "/dev/nbd1", 00:06:58.492 "bdev_name": "Malloc1" 00:06:58.492 } 00:06:58.492 ]' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:58.492 /dev/nbd1' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:58.492 /dev/nbd1' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@65 -- # count=2 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@95 -- # count=2 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:58.492 256+0 records in 00:06:58.492 256+0 records out 00:06:58.492 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00479807 s, 219 MB/s 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:58.492 256+0 records in 00:06:58.492 256+0 records out 00:06:58.492 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225775 s, 46.4 MB/s 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:58.492 256+0 records in 00:06:58.492 256+0 records out 00:06:58.492 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220899 s, 47.5 MB/s 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@51 -- # local i 00:06:58.492 16:31:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:58.493 16:31:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@41 -- # break 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@45 -- # return 0 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:58.750 16:31:24 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@41 -- # break 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@45 -- # return 0 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:59.008 16:31:24 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@65 -- # true 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@65 -- # count=0 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@104 -- # count=0 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:59.266 16:31:24 -- bdev/nbd_common.sh@109 -- # return 0 00:06:59.266 16:31:24 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:59.524 16:31:24 -- event/event.sh@35 -- # sleep 3 00:06:59.782 [2024-10-13 16:31:25.185859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:59.782 [2024-10-13 16:31:25.272121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.782 [2024-10-13 16:31:25.272122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:00.039 [2024-10-13 16:31:25.333167] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:00.039 [2024-10-13 16:31:25.333254] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:02.628 16:31:27 -- event/event.sh@23 -- # for i in {0..2} 00:07:02.628 16:31:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:07:02.628 spdk_app_start Round 1 00:07:02.628 16:31:27 -- event/event.sh@25 -- # waitforlisten 1080199 /var/tmp/spdk-nbd.sock 00:07:02.628 16:31:27 -- common/autotest_common.sh@819 -- # '[' -z 1080199 ']' 00:07:02.628 16:31:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:02.628 16:31:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:02.628 16:31:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:02.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:02.628 16:31:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:02.628 16:31:27 -- common/autotest_common.sh@10 -- # set +x 00:07:02.889 16:31:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:02.889 16:31:28 -- common/autotest_common.sh@852 -- # return 0 00:07:02.889 16:31:28 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:03.148 Malloc0 00:07:03.148 16:31:28 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:03.407 Malloc1 00:07:03.407 16:31:28 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@12 -- # local i 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:03.407 16:31:28 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:03.665 /dev/nbd0 00:07:03.665 16:31:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:03.665 16:31:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:03.665 16:31:29 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:07:03.665 16:31:29 -- common/autotest_common.sh@857 -- # local i 00:07:03.665 16:31:29 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:07:03.665 16:31:29 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:07:03.665 16:31:29 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:07:03.665 16:31:29 -- common/autotest_common.sh@861 -- # break 00:07:03.665 16:31:29 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:07:03.665 16:31:29 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:07:03.665 16:31:29 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:03.665 1+0 records in 00:07:03.665 1+0 records out 00:07:03.665 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00022316 s, 18.4 MB/s 00:07:03.665 16:31:29 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:03.665 16:31:29 -- common/autotest_common.sh@874 -- # size=4096 00:07:03.665 16:31:29 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:03.665 16:31:29 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:07:03.665 16:31:29 -- common/autotest_common.sh@877 -- # return 0 00:07:03.665 16:31:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:03.665 16:31:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:03.665 16:31:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:03.924 /dev/nbd1 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:03.924 16:31:29 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:07:03.924 16:31:29 -- common/autotest_common.sh@857 -- # local i 00:07:03.924 16:31:29 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:07:03.924 16:31:29 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:07:03.924 16:31:29 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:07:03.924 16:31:29 -- common/autotest_common.sh@861 -- # break 00:07:03.924 16:31:29 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:07:03.924 16:31:29 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:07:03.924 16:31:29 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:03.924 1+0 records in 00:07:03.924 1+0 records out 00:07:03.924 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000170466 s, 24.0 MB/s 00:07:03.924 16:31:29 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:03.924 16:31:29 -- common/autotest_common.sh@874 -- # size=4096 00:07:03.924 16:31:29 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:03.924 16:31:29 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:07:03.924 16:31:29 -- common/autotest_common.sh@877 -- # return 0 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.924 16:31:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:04.183 { 00:07:04.183 "nbd_device": "/dev/nbd0", 00:07:04.183 "bdev_name": "Malloc0" 00:07:04.183 }, 00:07:04.183 { 00:07:04.183 "nbd_device": "/dev/nbd1", 00:07:04.183 "bdev_name": "Malloc1" 00:07:04.183 } 00:07:04.183 ]' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:04.183 { 00:07:04.183 "nbd_device": "/dev/nbd0", 00:07:04.183 "bdev_name": "Malloc0" 00:07:04.183 }, 00:07:04.183 { 00:07:04.183 "nbd_device": "/dev/nbd1", 00:07:04.183 "bdev_name": "Malloc1" 00:07:04.183 } 00:07:04.183 ]' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:04.183 /dev/nbd1' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:04.183 /dev/nbd1' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@65 -- # count=2 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@95 -- # count=2 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:04.183 256+0 records in 00:07:04.183 256+0 records out 00:07:04.183 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506068 s, 207 MB/s 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:04.183 16:31:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:04.442 256+0 records in 00:07:04.442 256+0 records out 00:07:04.442 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205749 s, 51.0 MB/s 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:04.442 256+0 records in 00:07:04.442 256+0 records out 00:07:04.442 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230096 s, 45.6 MB/s 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@51 -- # local i 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:04.442 16:31:29 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:04.700 16:31:29 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@41 -- # break 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@45 -- # return 0 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:04.700 16:31:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@41 -- # break 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@45 -- # return 0 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:04.959 16:31:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@65 -- # true 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@65 -- # count=0 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@104 -- # count=0 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:05.217 16:31:30 -- bdev/nbd_common.sh@109 -- # return 0 00:07:05.217 16:31:30 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:05.477 16:31:30 -- event/event.sh@35 -- # sleep 3 00:07:05.735 [2024-10-13 16:31:31.070823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:05.735 [2024-10-13 16:31:31.158333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.735 [2024-10-13 16:31:31.158335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.735 [2024-10-13 16:31:31.219814] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:05.735 [2024-10-13 16:31:31.219898] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:09.017 16:31:33 -- event/event.sh@23 -- # for i in {0..2} 00:07:09.017 16:31:33 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:07:09.017 spdk_app_start Round 2 00:07:09.017 16:31:33 -- event/event.sh@25 -- # waitforlisten 1080199 /var/tmp/spdk-nbd.sock 00:07:09.017 16:31:33 -- common/autotest_common.sh@819 -- # '[' -z 1080199 ']' 00:07:09.017 16:31:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:09.017 16:31:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:09.017 16:31:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:09.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:09.017 16:31:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:09.017 16:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:09.017 16:31:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:09.017 16:31:34 -- common/autotest_common.sh@852 -- # return 0 00:07:09.017 16:31:34 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:09.017 Malloc0 00:07:09.017 16:31:34 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:09.275 Malloc1 00:07:09.275 16:31:34 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:09.275 16:31:34 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:09.275 16:31:34 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@12 -- # local i 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:09.276 16:31:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:09.534 /dev/nbd0 00:07:09.534 16:31:34 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:09.534 16:31:34 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:09.534 16:31:34 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:07:09.534 16:31:34 -- common/autotest_common.sh@857 -- # local i 00:07:09.534 16:31:34 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:07:09.534 16:31:34 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:07:09.534 16:31:34 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:07:09.534 16:31:34 -- common/autotest_common.sh@861 -- # break 00:07:09.534 16:31:34 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:07:09.534 16:31:34 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:07:09.534 16:31:34 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:09.534 1+0 records in 00:07:09.534 1+0 records out 00:07:09.534 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209396 s, 19.6 MB/s 00:07:09.534 16:31:34 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:09.534 16:31:34 -- common/autotest_common.sh@874 -- # size=4096 00:07:09.534 16:31:34 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:09.534 16:31:34 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:07:09.534 16:31:34 -- common/autotest_common.sh@877 -- # return 0 00:07:09.534 16:31:34 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:09.534 16:31:34 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:09.534 16:31:34 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:09.792 /dev/nbd1 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:09.792 16:31:35 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:07:09.792 16:31:35 -- common/autotest_common.sh@857 -- # local i 00:07:09.792 16:31:35 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:07:09.792 16:31:35 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:07:09.792 16:31:35 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:07:09.792 16:31:35 -- common/autotest_common.sh@861 -- # break 00:07:09.792 16:31:35 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:07:09.792 16:31:35 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:07:09.792 16:31:35 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:09.792 1+0 records in 00:07:09.792 1+0 records out 00:07:09.792 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000191546 s, 21.4 MB/s 00:07:09.792 16:31:35 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:09.792 16:31:35 -- common/autotest_common.sh@874 -- # size=4096 00:07:09.792 16:31:35 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:07:09.792 16:31:35 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:07:09.792 16:31:35 -- common/autotest_common.sh@877 -- # return 0 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:09.792 16:31:35 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:10.050 16:31:35 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:10.051 { 00:07:10.051 "nbd_device": "/dev/nbd0", 00:07:10.051 "bdev_name": "Malloc0" 00:07:10.051 }, 00:07:10.051 { 00:07:10.051 "nbd_device": "/dev/nbd1", 00:07:10.051 "bdev_name": "Malloc1" 00:07:10.051 } 00:07:10.051 ]' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:10.051 { 00:07:10.051 "nbd_device": "/dev/nbd0", 00:07:10.051 "bdev_name": "Malloc0" 00:07:10.051 }, 00:07:10.051 { 00:07:10.051 "nbd_device": "/dev/nbd1", 00:07:10.051 "bdev_name": "Malloc1" 00:07:10.051 } 00:07:10.051 ]' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:10.051 /dev/nbd1' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:10.051 /dev/nbd1' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@65 -- # count=2 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@95 -- # count=2 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:10.051 256+0 records in 00:07:10.051 256+0 records out 00:07:10.051 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00525787 s, 199 MB/s 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:10.051 16:31:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:10.309 256+0 records in 00:07:10.309 256+0 records out 00:07:10.309 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226668 s, 46.3 MB/s 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:10.309 256+0 records in 00:07:10.309 256+0 records out 00:07:10.309 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214006 s, 49.0 MB/s 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:10.309 16:31:35 -- bdev/nbd_common.sh@51 -- # local i 00:07:10.310 16:31:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:10.310 16:31:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@41 -- # break 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@45 -- # return 0 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:10.568 16:31:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@41 -- # break 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@45 -- # return 0 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:10.826 16:31:36 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@65 -- # true 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@65 -- # count=0 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@104 -- # count=0 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:11.085 16:31:36 -- bdev/nbd_common.sh@109 -- # return 0 00:07:11.085 16:31:36 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:11.344 16:31:36 -- event/event.sh@35 -- # sleep 3 00:07:11.602 [2024-10-13 16:31:36.926484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:11.602 [2024-10-13 16:31:37.013938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:11.602 [2024-10-13 16:31:37.013941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.603 [2024-10-13 16:31:37.075199] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:11.603 [2024-10-13 16:31:37.075277] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:14.889 16:31:39 -- event/event.sh@38 -- # waitforlisten 1080199 /var/tmp/spdk-nbd.sock 00:07:14.889 16:31:39 -- common/autotest_common.sh@819 -- # '[' -z 1080199 ']' 00:07:14.889 16:31:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:14.889 16:31:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:14.889 16:31:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:14.889 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:14.889 16:31:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:14.889 16:31:39 -- common/autotest_common.sh@10 -- # set +x 00:07:14.889 16:31:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:14.889 16:31:39 -- common/autotest_common.sh@852 -- # return 0 00:07:14.889 16:31:39 -- event/event.sh@39 -- # killprocess 1080199 00:07:14.889 16:31:39 -- common/autotest_common.sh@926 -- # '[' -z 1080199 ']' 00:07:14.889 16:31:39 -- common/autotest_common.sh@930 -- # kill -0 1080199 00:07:14.889 16:31:39 -- common/autotest_common.sh@931 -- # uname 00:07:14.889 16:31:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:14.889 16:31:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1080199 00:07:14.889 16:31:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:14.889 16:31:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:14.889 16:31:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1080199' 00:07:14.889 killing process with pid 1080199 00:07:14.889 16:31:39 -- common/autotest_common.sh@945 -- # kill 1080199 00:07:14.889 16:31:39 -- common/autotest_common.sh@950 -- # wait 1080199 00:07:14.889 spdk_app_start is called in Round 0. 00:07:14.889 Shutdown signal received, stop current app iteration 00:07:14.889 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 reinitialization... 00:07:14.889 spdk_app_start is called in Round 1. 00:07:14.889 Shutdown signal received, stop current app iteration 00:07:14.889 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 reinitialization... 00:07:14.889 spdk_app_start is called in Round 2. 00:07:14.889 Shutdown signal received, stop current app iteration 00:07:14.889 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 reinitialization... 00:07:14.889 spdk_app_start is called in Round 3. 00:07:14.889 Shutdown signal received, stop current app iteration 00:07:14.889 16:31:40 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:07:14.889 16:31:40 -- event/event.sh@42 -- # return 0 00:07:14.889 00:07:14.889 real 0m18.795s 00:07:14.889 user 0m41.234s 00:07:14.889 sys 0m3.171s 00:07:14.889 16:31:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:14.889 16:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.889 ************************************ 00:07:14.890 END TEST app_repeat 00:07:14.890 ************************************ 00:07:14.890 16:31:40 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:07:14.890 16:31:40 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:14.890 16:31:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:14.890 16:31:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:14.890 16:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.890 ************************************ 00:07:14.890 START TEST cpu_locks 00:07:14.890 ************************************ 00:07:14.890 16:31:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:14.890 * Looking for test storage... 00:07:14.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:07:14.890 16:31:40 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:07:14.890 16:31:40 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:07:14.890 16:31:40 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:07:14.890 16:31:40 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:07:14.890 16:31:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:14.890 16:31:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:14.890 16:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.890 ************************************ 00:07:14.890 START TEST default_locks 00:07:14.890 ************************************ 00:07:14.890 16:31:40 -- common/autotest_common.sh@1104 -- # default_locks 00:07:14.890 16:31:40 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1082766 00:07:14.890 16:31:40 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:14.890 16:31:40 -- event/cpu_locks.sh@47 -- # waitforlisten 1082766 00:07:14.890 16:31:40 -- common/autotest_common.sh@819 -- # '[' -z 1082766 ']' 00:07:14.890 16:31:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:14.890 16:31:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:14.890 16:31:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:14.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:14.890 16:31:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:14.890 16:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:14.890 [2024-10-13 16:31:40.317580] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:14.890 [2024-10-13 16:31:40.317678] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082766 ] 00:07:14.890 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.148 [2024-10-13 16:31:40.390635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.148 [2024-10-13 16:31:40.485171] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:15.148 [2024-10-13 16:31:40.485408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.082 16:31:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:16.082 16:31:41 -- common/autotest_common.sh@852 -- # return 0 00:07:16.082 16:31:41 -- event/cpu_locks.sh@49 -- # locks_exist 1082766 00:07:16.082 16:31:41 -- event/cpu_locks.sh@22 -- # lslocks -p 1082766 00:07:16.082 16:31:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:16.339 lslocks: write error 00:07:16.339 16:31:41 -- event/cpu_locks.sh@50 -- # killprocess 1082766 00:07:16.339 16:31:41 -- common/autotest_common.sh@926 -- # '[' -z 1082766 ']' 00:07:16.339 16:31:41 -- common/autotest_common.sh@930 -- # kill -0 1082766 00:07:16.339 16:31:41 -- common/autotest_common.sh@931 -- # uname 00:07:16.339 16:31:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:16.339 16:31:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1082766 00:07:16.339 16:31:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:16.339 16:31:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:16.339 16:31:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1082766' 00:07:16.339 killing process with pid 1082766 00:07:16.339 16:31:41 -- common/autotest_common.sh@945 -- # kill 1082766 00:07:16.339 16:31:41 -- common/autotest_common.sh@950 -- # wait 1082766 00:07:16.597 16:31:42 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1082766 00:07:16.597 16:31:42 -- common/autotest_common.sh@640 -- # local es=0 00:07:16.597 16:31:42 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1082766 00:07:16.597 16:31:42 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:07:16.597 16:31:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:16.597 16:31:42 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:07:16.597 16:31:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:16.597 16:31:42 -- common/autotest_common.sh@643 -- # waitforlisten 1082766 00:07:16.597 16:31:42 -- common/autotest_common.sh@819 -- # '[' -z 1082766 ']' 00:07:16.597 16:31:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:16.597 16:31:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:16.597 16:31:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:16.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:16.597 16:31:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:16.598 16:31:42 -- common/autotest_common.sh@10 -- # set +x 00:07:16.598 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1082766) - No such process 00:07:16.598 ERROR: process (pid: 1082766) is no longer running 00:07:16.598 16:31:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:16.598 16:31:42 -- common/autotest_common.sh@852 -- # return 1 00:07:16.598 16:31:42 -- common/autotest_common.sh@643 -- # es=1 00:07:16.598 16:31:42 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:16.598 16:31:42 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:16.598 16:31:42 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:16.598 16:31:42 -- event/cpu_locks.sh@54 -- # no_locks 00:07:16.598 16:31:42 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:16.598 16:31:42 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:16.598 16:31:42 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:16.598 00:07:16.598 real 0m1.814s 00:07:16.598 user 0m2.081s 00:07:16.598 sys 0m0.555s 00:07:16.598 16:31:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:16.598 16:31:42 -- common/autotest_common.sh@10 -- # set +x 00:07:16.598 ************************************ 00:07:16.598 END TEST default_locks 00:07:16.598 ************************************ 00:07:16.856 16:31:42 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:07:16.856 16:31:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:16.856 16:31:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:16.856 16:31:42 -- common/autotest_common.sh@10 -- # set +x 00:07:16.856 ************************************ 00:07:16.856 START TEST default_locks_via_rpc 00:07:16.856 ************************************ 00:07:16.856 16:31:42 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:07:16.857 16:31:42 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1083057 00:07:16.857 16:31:42 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:16.857 16:31:42 -- event/cpu_locks.sh@63 -- # waitforlisten 1083057 00:07:16.857 16:31:42 -- common/autotest_common.sh@819 -- # '[' -z 1083057 ']' 00:07:16.857 16:31:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:16.857 16:31:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:16.857 16:31:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:16.857 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:16.857 16:31:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:16.857 16:31:42 -- common/autotest_common.sh@10 -- # set +x 00:07:16.857 [2024-10-13 16:31:42.163922] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:16.857 [2024-10-13 16:31:42.163998] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083057 ] 00:07:16.857 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.857 [2024-10-13 16:31:42.227761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.857 [2024-10-13 16:31:42.314450] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:16.857 [2024-10-13 16:31:42.314633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.791 16:31:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:17.791 16:31:43 -- common/autotest_common.sh@852 -- # return 0 00:07:17.791 16:31:43 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:07:17.791 16:31:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:17.791 16:31:43 -- common/autotest_common.sh@10 -- # set +x 00:07:17.791 16:31:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:17.791 16:31:43 -- event/cpu_locks.sh@67 -- # no_locks 00:07:17.791 16:31:43 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:17.791 16:31:43 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:17.791 16:31:43 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:17.791 16:31:43 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:07:17.791 16:31:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:17.791 16:31:43 -- common/autotest_common.sh@10 -- # set +x 00:07:17.791 16:31:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:17.791 16:31:43 -- event/cpu_locks.sh@71 -- # locks_exist 1083057 00:07:17.791 16:31:43 -- event/cpu_locks.sh@22 -- # lslocks -p 1083057 00:07:17.791 16:31:43 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:18.048 16:31:43 -- event/cpu_locks.sh@73 -- # killprocess 1083057 00:07:18.048 16:31:43 -- common/autotest_common.sh@926 -- # '[' -z 1083057 ']' 00:07:18.048 16:31:43 -- common/autotest_common.sh@930 -- # kill -0 1083057 00:07:18.048 16:31:43 -- common/autotest_common.sh@931 -- # uname 00:07:18.048 16:31:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:18.048 16:31:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1083057 00:07:18.048 16:31:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:18.048 16:31:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:18.048 16:31:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1083057' 00:07:18.048 killing process with pid 1083057 00:07:18.048 16:31:43 -- common/autotest_common.sh@945 -- # kill 1083057 00:07:18.048 16:31:43 -- common/autotest_common.sh@950 -- # wait 1083057 00:07:18.616 00:07:18.616 real 0m1.704s 00:07:18.616 user 0m1.837s 00:07:18.616 sys 0m0.567s 00:07:18.616 16:31:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:18.616 16:31:43 -- common/autotest_common.sh@10 -- # set +x 00:07:18.616 ************************************ 00:07:18.616 END TEST default_locks_via_rpc 00:07:18.616 ************************************ 00:07:18.616 16:31:43 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:07:18.616 16:31:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:18.616 16:31:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:18.616 16:31:43 -- common/autotest_common.sh@10 -- # set +x 00:07:18.616 ************************************ 00:07:18.616 START TEST non_locking_app_on_locked_coremask 00:07:18.616 ************************************ 00:07:18.616 16:31:43 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:07:18.616 16:31:43 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1083233 00:07:18.616 16:31:43 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:18.616 16:31:43 -- event/cpu_locks.sh@81 -- # waitforlisten 1083233 /var/tmp/spdk.sock 00:07:18.616 16:31:43 -- common/autotest_common.sh@819 -- # '[' -z 1083233 ']' 00:07:18.616 16:31:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:18.616 16:31:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:18.616 16:31:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:18.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:18.616 16:31:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:18.616 16:31:43 -- common/autotest_common.sh@10 -- # set +x 00:07:18.616 [2024-10-13 16:31:43.889871] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:18.617 [2024-10-13 16:31:43.889959] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083233 ] 00:07:18.617 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.617 [2024-10-13 16:31:43.946521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.617 [2024-10-13 16:31:44.034712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:18.617 [2024-10-13 16:31:44.034878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.555 16:31:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:19.555 16:31:44 -- common/autotest_common.sh@852 -- # return 0 00:07:19.555 16:31:44 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1083375 00:07:19.555 16:31:44 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:07:19.555 16:31:44 -- event/cpu_locks.sh@85 -- # waitforlisten 1083375 /var/tmp/spdk2.sock 00:07:19.555 16:31:44 -- common/autotest_common.sh@819 -- # '[' -z 1083375 ']' 00:07:19.555 16:31:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:19.555 16:31:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:19.555 16:31:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:19.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:19.555 16:31:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:19.555 16:31:44 -- common/autotest_common.sh@10 -- # set +x 00:07:19.555 [2024-10-13 16:31:44.908560] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:19.555 [2024-10-13 16:31:44.908639] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083375 ] 00:07:19.555 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.555 [2024-10-13 16:31:44.995848] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:19.555 [2024-10-13 16:31:44.995892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.814 [2024-10-13 16:31:45.173837] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:19.814 [2024-10-13 16:31:45.174017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.380 16:31:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:20.380 16:31:45 -- common/autotest_common.sh@852 -- # return 0 00:07:20.380 16:31:45 -- event/cpu_locks.sh@87 -- # locks_exist 1083233 00:07:20.380 16:31:45 -- event/cpu_locks.sh@22 -- # lslocks -p 1083233 00:07:20.380 16:31:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:20.946 lslocks: write error 00:07:20.946 16:31:46 -- event/cpu_locks.sh@89 -- # killprocess 1083233 00:07:20.946 16:31:46 -- common/autotest_common.sh@926 -- # '[' -z 1083233 ']' 00:07:20.946 16:31:46 -- common/autotest_common.sh@930 -- # kill -0 1083233 00:07:20.946 16:31:46 -- common/autotest_common.sh@931 -- # uname 00:07:20.946 16:31:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:20.946 16:31:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1083233 00:07:20.946 16:31:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:20.946 16:31:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:20.946 16:31:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1083233' 00:07:20.946 killing process with pid 1083233 00:07:20.946 16:31:46 -- common/autotest_common.sh@945 -- # kill 1083233 00:07:20.946 16:31:46 -- common/autotest_common.sh@950 -- # wait 1083233 00:07:21.880 16:31:47 -- event/cpu_locks.sh@90 -- # killprocess 1083375 00:07:21.880 16:31:47 -- common/autotest_common.sh@926 -- # '[' -z 1083375 ']' 00:07:21.880 16:31:47 -- common/autotest_common.sh@930 -- # kill -0 1083375 00:07:21.880 16:31:47 -- common/autotest_common.sh@931 -- # uname 00:07:21.880 16:31:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:21.880 16:31:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1083375 00:07:21.880 16:31:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:21.880 16:31:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:21.880 16:31:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1083375' 00:07:21.880 killing process with pid 1083375 00:07:21.880 16:31:47 -- common/autotest_common.sh@945 -- # kill 1083375 00:07:21.880 16:31:47 -- common/autotest_common.sh@950 -- # wait 1083375 00:07:22.447 00:07:22.447 real 0m3.840s 00:07:22.447 user 0m4.220s 00:07:22.447 sys 0m1.107s 00:07:22.447 16:31:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:22.447 16:31:47 -- common/autotest_common.sh@10 -- # set +x 00:07:22.447 ************************************ 00:07:22.447 END TEST non_locking_app_on_locked_coremask 00:07:22.447 ************************************ 00:07:22.447 16:31:47 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:07:22.447 16:31:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:22.447 16:31:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:22.447 16:31:47 -- common/autotest_common.sh@10 -- # set +x 00:07:22.447 ************************************ 00:07:22.447 START TEST locking_app_on_unlocked_coremask 00:07:22.447 ************************************ 00:07:22.447 16:31:47 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:07:22.447 16:31:47 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1083811 00:07:22.447 16:31:47 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:22.447 16:31:47 -- event/cpu_locks.sh@99 -- # waitforlisten 1083811 /var/tmp/spdk.sock 00:07:22.447 16:31:47 -- common/autotest_common.sh@819 -- # '[' -z 1083811 ']' 00:07:22.447 16:31:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:22.447 16:31:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:22.447 16:31:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:22.447 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:22.447 16:31:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:22.448 16:31:47 -- common/autotest_common.sh@10 -- # set +x 00:07:22.448 [2024-10-13 16:31:47.761734] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:22.448 [2024-10-13 16:31:47.761825] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083811 ] 00:07:22.448 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.448 [2024-10-13 16:31:47.823790] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:22.448 [2024-10-13 16:31:47.823840] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.448 [2024-10-13 16:31:47.909303] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:22.448 [2024-10-13 16:31:47.909491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.383 16:31:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:23.383 16:31:48 -- common/autotest_common.sh@852 -- # return 0 00:07:23.383 16:31:48 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1083951 00:07:23.383 16:31:48 -- event/cpu_locks.sh@103 -- # waitforlisten 1083951 /var/tmp/spdk2.sock 00:07:23.383 16:31:48 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:23.383 16:31:48 -- common/autotest_common.sh@819 -- # '[' -z 1083951 ']' 00:07:23.383 16:31:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:23.383 16:31:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:23.383 16:31:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:23.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:23.383 16:31:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:23.383 16:31:48 -- common/autotest_common.sh@10 -- # set +x 00:07:23.383 [2024-10-13 16:31:48.765267] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:23.383 [2024-10-13 16:31:48.765349] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083951 ] 00:07:23.383 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.383 [2024-10-13 16:31:48.858038] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.641 [2024-10-13 16:31:49.035077] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:23.641 [2024-10-13 16:31:49.035284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.576 16:31:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:24.576 16:31:49 -- common/autotest_common.sh@852 -- # return 0 00:07:24.576 16:31:49 -- event/cpu_locks.sh@105 -- # locks_exist 1083951 00:07:24.576 16:31:49 -- event/cpu_locks.sh@22 -- # lslocks -p 1083951 00:07:24.576 16:31:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:24.835 lslocks: write error 00:07:24.835 16:31:50 -- event/cpu_locks.sh@107 -- # killprocess 1083811 00:07:24.835 16:31:50 -- common/autotest_common.sh@926 -- # '[' -z 1083811 ']' 00:07:24.835 16:31:50 -- common/autotest_common.sh@930 -- # kill -0 1083811 00:07:24.835 16:31:50 -- common/autotest_common.sh@931 -- # uname 00:07:24.835 16:31:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:24.835 16:31:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1083811 00:07:24.835 16:31:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:24.835 16:31:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:24.835 16:31:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1083811' 00:07:24.835 killing process with pid 1083811 00:07:24.835 16:31:50 -- common/autotest_common.sh@945 -- # kill 1083811 00:07:24.835 16:31:50 -- common/autotest_common.sh@950 -- # wait 1083811 00:07:25.781 16:31:50 -- event/cpu_locks.sh@108 -- # killprocess 1083951 00:07:25.781 16:31:50 -- common/autotest_common.sh@926 -- # '[' -z 1083951 ']' 00:07:25.781 16:31:50 -- common/autotest_common.sh@930 -- # kill -0 1083951 00:07:25.781 16:31:50 -- common/autotest_common.sh@931 -- # uname 00:07:25.781 16:31:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:25.781 16:31:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1083951 00:07:25.781 16:31:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:25.781 16:31:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:25.781 16:31:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1083951' 00:07:25.781 killing process with pid 1083951 00:07:25.781 16:31:50 -- common/autotest_common.sh@945 -- # kill 1083951 00:07:25.781 16:31:50 -- common/autotest_common.sh@950 -- # wait 1083951 00:07:26.037 00:07:26.037 real 0m3.670s 00:07:26.037 user 0m4.059s 00:07:26.037 sys 0m1.042s 00:07:26.037 16:31:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:26.037 16:31:51 -- common/autotest_common.sh@10 -- # set +x 00:07:26.037 ************************************ 00:07:26.038 END TEST locking_app_on_unlocked_coremask 00:07:26.038 ************************************ 00:07:26.038 16:31:51 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:26.038 16:31:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:26.038 16:31:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:26.038 16:31:51 -- common/autotest_common.sh@10 -- # set +x 00:07:26.038 ************************************ 00:07:26.038 START TEST locking_app_on_locked_coremask 00:07:26.038 ************************************ 00:07:26.038 16:31:51 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:07:26.038 16:31:51 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1084263 00:07:26.038 16:31:51 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:26.038 16:31:51 -- event/cpu_locks.sh@116 -- # waitforlisten 1084263 /var/tmp/spdk.sock 00:07:26.038 16:31:51 -- common/autotest_common.sh@819 -- # '[' -z 1084263 ']' 00:07:26.038 16:31:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:26.038 16:31:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:26.038 16:31:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:26.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:26.038 16:31:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:26.038 16:31:51 -- common/autotest_common.sh@10 -- # set +x 00:07:26.038 [2024-10-13 16:31:51.462094] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:26.038 [2024-10-13 16:31:51.462198] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084263 ] 00:07:26.038 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.038 [2024-10-13 16:31:51.519181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.295 [2024-10-13 16:31:51.607749] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:26.295 [2024-10-13 16:31:51.607917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.230 16:31:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:27.230 16:31:52 -- common/autotest_common.sh@852 -- # return 0 00:07:27.230 16:31:52 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1084403 00:07:27.230 16:31:52 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:27.230 16:31:52 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1084403 /var/tmp/spdk2.sock 00:07:27.230 16:31:52 -- common/autotest_common.sh@640 -- # local es=0 00:07:27.230 16:31:52 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1084403 /var/tmp/spdk2.sock 00:07:27.230 16:31:52 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:07:27.230 16:31:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:27.230 16:31:52 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:07:27.230 16:31:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:27.230 16:31:52 -- common/autotest_common.sh@643 -- # waitforlisten 1084403 /var/tmp/spdk2.sock 00:07:27.230 16:31:52 -- common/autotest_common.sh@819 -- # '[' -z 1084403 ']' 00:07:27.230 16:31:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:27.230 16:31:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:27.230 16:31:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:27.230 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:27.230 16:31:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:27.230 16:31:52 -- common/autotest_common.sh@10 -- # set +x 00:07:27.230 [2024-10-13 16:31:52.474211] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:27.230 [2024-10-13 16:31:52.474299] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084403 ] 00:07:27.230 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.230 [2024-10-13 16:31:52.565209] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1084263 has claimed it. 00:07:27.230 [2024-10-13 16:31:52.565259] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:27.795 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1084403) - No such process 00:07:27.795 ERROR: process (pid: 1084403) is no longer running 00:07:27.795 16:31:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:27.795 16:31:53 -- common/autotest_common.sh@852 -- # return 1 00:07:27.795 16:31:53 -- common/autotest_common.sh@643 -- # es=1 00:07:27.795 16:31:53 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:27.795 16:31:53 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:27.795 16:31:53 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:27.795 16:31:53 -- event/cpu_locks.sh@122 -- # locks_exist 1084263 00:07:27.795 16:31:53 -- event/cpu_locks.sh@22 -- # lslocks -p 1084263 00:07:27.795 16:31:53 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:28.360 lslocks: write error 00:07:28.360 16:31:53 -- event/cpu_locks.sh@124 -- # killprocess 1084263 00:07:28.360 16:31:53 -- common/autotest_common.sh@926 -- # '[' -z 1084263 ']' 00:07:28.360 16:31:53 -- common/autotest_common.sh@930 -- # kill -0 1084263 00:07:28.360 16:31:53 -- common/autotest_common.sh@931 -- # uname 00:07:28.360 16:31:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:28.360 16:31:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1084263 00:07:28.360 16:31:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:28.360 16:31:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:28.360 16:31:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1084263' 00:07:28.360 killing process with pid 1084263 00:07:28.360 16:31:53 -- common/autotest_common.sh@945 -- # kill 1084263 00:07:28.360 16:31:53 -- common/autotest_common.sh@950 -- # wait 1084263 00:07:28.618 00:07:28.618 real 0m2.617s 00:07:28.618 user 0m3.024s 00:07:28.618 sys 0m0.654s 00:07:28.618 16:31:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:28.618 16:31:54 -- common/autotest_common.sh@10 -- # set +x 00:07:28.618 ************************************ 00:07:28.618 END TEST locking_app_on_locked_coremask 00:07:28.618 ************************************ 00:07:28.618 16:31:54 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:28.618 16:31:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:28.618 16:31:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:28.618 16:31:54 -- common/autotest_common.sh@10 -- # set +x 00:07:28.618 ************************************ 00:07:28.618 START TEST locking_overlapped_coremask 00:07:28.618 ************************************ 00:07:28.618 16:31:54 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:07:28.618 16:31:54 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1084574 00:07:28.618 16:31:54 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:28.618 16:31:54 -- event/cpu_locks.sh@133 -- # waitforlisten 1084574 /var/tmp/spdk.sock 00:07:28.618 16:31:54 -- common/autotest_common.sh@819 -- # '[' -z 1084574 ']' 00:07:28.618 16:31:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.618 16:31:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:28.618 16:31:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.618 16:31:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:28.618 16:31:54 -- common/autotest_common.sh@10 -- # set +x 00:07:28.618 [2024-10-13 16:31:54.109705] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:28.618 [2024-10-13 16:31:54.109801] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084574 ] 00:07:28.876 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.876 [2024-10-13 16:31:54.174583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:28.876 [2024-10-13 16:31:54.266677] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:28.876 [2024-10-13 16:31:54.266919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:28.876 [2024-10-13 16:31:54.267001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:28.876 [2024-10-13 16:31:54.267003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.809 16:31:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:29.809 16:31:55 -- common/autotest_common.sh@852 -- # return 0 00:07:29.809 16:31:55 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1084715 00:07:29.809 16:31:55 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:29.809 16:31:55 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1084715 /var/tmp/spdk2.sock 00:07:29.809 16:31:55 -- common/autotest_common.sh@640 -- # local es=0 00:07:29.809 16:31:55 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1084715 /var/tmp/spdk2.sock 00:07:29.809 16:31:55 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:07:29.809 16:31:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:29.809 16:31:55 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:07:29.809 16:31:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:29.809 16:31:55 -- common/autotest_common.sh@643 -- # waitforlisten 1084715 /var/tmp/spdk2.sock 00:07:29.809 16:31:55 -- common/autotest_common.sh@819 -- # '[' -z 1084715 ']' 00:07:29.809 16:31:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:29.809 16:31:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:29.809 16:31:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:29.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:29.809 16:31:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:29.809 16:31:55 -- common/autotest_common.sh@10 -- # set +x 00:07:29.809 [2024-10-13 16:31:55.111165] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:29.809 [2024-10-13 16:31:55.111248] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084715 ] 00:07:29.809 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.809 [2024-10-13 16:31:55.200676] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1084574 has claimed it. 00:07:29.809 [2024-10-13 16:31:55.200751] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:30.374 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1084715) - No such process 00:07:30.374 ERROR: process (pid: 1084715) is no longer running 00:07:30.374 16:31:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:30.374 16:31:55 -- common/autotest_common.sh@852 -- # return 1 00:07:30.374 16:31:55 -- common/autotest_common.sh@643 -- # es=1 00:07:30.374 16:31:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:30.374 16:31:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:30.374 16:31:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:30.374 16:31:55 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:30.374 16:31:55 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:30.374 16:31:55 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:30.374 16:31:55 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:30.374 16:31:55 -- event/cpu_locks.sh@141 -- # killprocess 1084574 00:07:30.374 16:31:55 -- common/autotest_common.sh@926 -- # '[' -z 1084574 ']' 00:07:30.374 16:31:55 -- common/autotest_common.sh@930 -- # kill -0 1084574 00:07:30.374 16:31:55 -- common/autotest_common.sh@931 -- # uname 00:07:30.374 16:31:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:30.374 16:31:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1084574 00:07:30.374 16:31:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:30.374 16:31:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:30.374 16:31:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1084574' 00:07:30.374 killing process with pid 1084574 00:07:30.374 16:31:55 -- common/autotest_common.sh@945 -- # kill 1084574 00:07:30.374 16:31:55 -- common/autotest_common.sh@950 -- # wait 1084574 00:07:30.940 00:07:30.940 real 0m2.210s 00:07:30.940 user 0m6.344s 00:07:30.940 sys 0m0.514s 00:07:30.940 16:31:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:30.940 16:31:56 -- common/autotest_common.sh@10 -- # set +x 00:07:30.940 ************************************ 00:07:30.940 END TEST locking_overlapped_coremask 00:07:30.940 ************************************ 00:07:30.940 16:31:56 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:30.940 16:31:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:30.940 16:31:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:30.940 16:31:56 -- common/autotest_common.sh@10 -- # set +x 00:07:30.940 ************************************ 00:07:30.940 START TEST locking_overlapped_coremask_via_rpc 00:07:30.940 ************************************ 00:07:30.940 16:31:56 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:07:30.940 16:31:56 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1084882 00:07:30.940 16:31:56 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:30.940 16:31:56 -- event/cpu_locks.sh@149 -- # waitforlisten 1084882 /var/tmp/spdk.sock 00:07:30.940 16:31:56 -- common/autotest_common.sh@819 -- # '[' -z 1084882 ']' 00:07:30.940 16:31:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:30.940 16:31:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:30.940 16:31:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:30.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:30.940 16:31:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:30.940 16:31:56 -- common/autotest_common.sh@10 -- # set +x 00:07:30.940 [2024-10-13 16:31:56.346544] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:30.940 [2024-10-13 16:31:56.346628] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084882 ] 00:07:30.940 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.940 [2024-10-13 16:31:56.410230] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:30.940 [2024-10-13 16:31:56.410273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:31.198 [2024-10-13 16:31:56.505084] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:31.198 [2024-10-13 16:31:56.505316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:31.198 [2024-10-13 16:31:56.505378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:31.198 [2024-10-13 16:31:56.505381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.131 16:31:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:32.131 16:31:57 -- common/autotest_common.sh@852 -- # return 0 00:07:32.131 16:31:57 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1085021 00:07:32.131 16:31:57 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:32.131 16:31:57 -- event/cpu_locks.sh@153 -- # waitforlisten 1085021 /var/tmp/spdk2.sock 00:07:32.131 16:31:57 -- common/autotest_common.sh@819 -- # '[' -z 1085021 ']' 00:07:32.131 16:31:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:32.131 16:31:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:32.131 16:31:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:32.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:32.131 16:31:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:32.131 16:31:57 -- common/autotest_common.sh@10 -- # set +x 00:07:32.131 [2024-10-13 16:31:57.341236] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:32.131 [2024-10-13 16:31:57.341331] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085021 ] 00:07:32.131 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.131 [2024-10-13 16:31:57.431829] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:32.131 [2024-10-13 16:31:57.431869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:32.131 [2024-10-13 16:31:57.602367] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:32.131 [2024-10-13 16:31:57.602617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:32.131 [2024-10-13 16:31:57.606497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:07:32.131 [2024-10-13 16:31:57.606499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:33.065 16:31:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:33.065 16:31:58 -- common/autotest_common.sh@852 -- # return 0 00:07:33.065 16:31:58 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:33.065 16:31:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.065 16:31:58 -- common/autotest_common.sh@10 -- # set +x 00:07:33.065 16:31:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.065 16:31:58 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:33.065 16:31:58 -- common/autotest_common.sh@640 -- # local es=0 00:07:33.065 16:31:58 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:33.065 16:31:58 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:07:33.065 16:31:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:33.065 16:31:58 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:07:33.065 16:31:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:33.065 16:31:58 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:33.065 16:31:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.065 16:31:58 -- common/autotest_common.sh@10 -- # set +x 00:07:33.065 [2024-10-13 16:31:58.323493] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1084882 has claimed it. 00:07:33.065 request: 00:07:33.065 { 00:07:33.065 "method": "framework_enable_cpumask_locks", 00:07:33.065 "req_id": 1 00:07:33.065 } 00:07:33.065 Got JSON-RPC error response 00:07:33.065 response: 00:07:33.065 { 00:07:33.065 "code": -32603, 00:07:33.065 "message": "Failed to claim CPU core: 2" 00:07:33.065 } 00:07:33.065 16:31:58 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:07:33.065 16:31:58 -- common/autotest_common.sh@643 -- # es=1 00:07:33.065 16:31:58 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:33.065 16:31:58 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:33.065 16:31:58 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:33.065 16:31:58 -- event/cpu_locks.sh@158 -- # waitforlisten 1084882 /var/tmp/spdk.sock 00:07:33.065 16:31:58 -- common/autotest_common.sh@819 -- # '[' -z 1084882 ']' 00:07:33.065 16:31:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.065 16:31:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:33.065 16:31:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.065 16:31:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:33.065 16:31:58 -- common/autotest_common.sh@10 -- # set +x 00:07:33.323 16:31:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:33.323 16:31:58 -- common/autotest_common.sh@852 -- # return 0 00:07:33.323 16:31:58 -- event/cpu_locks.sh@159 -- # waitforlisten 1085021 /var/tmp/spdk2.sock 00:07:33.323 16:31:58 -- common/autotest_common.sh@819 -- # '[' -z 1085021 ']' 00:07:33.323 16:31:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:33.323 16:31:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:33.323 16:31:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:33.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:33.323 16:31:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:33.323 16:31:58 -- common/autotest_common.sh@10 -- # set +x 00:07:33.580 16:31:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:33.580 16:31:58 -- common/autotest_common.sh@852 -- # return 0 00:07:33.580 16:31:58 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:33.580 16:31:58 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:33.580 16:31:58 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:33.581 16:31:58 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:33.581 00:07:33.581 real 0m2.567s 00:07:33.581 user 0m1.268s 00:07:33.581 sys 0m0.226s 00:07:33.581 16:31:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:33.581 16:31:58 -- common/autotest_common.sh@10 -- # set +x 00:07:33.581 ************************************ 00:07:33.581 END TEST locking_overlapped_coremask_via_rpc 00:07:33.581 ************************************ 00:07:33.581 16:31:58 -- event/cpu_locks.sh@174 -- # cleanup 00:07:33.581 16:31:58 -- event/cpu_locks.sh@15 -- # [[ -z 1084882 ]] 00:07:33.581 16:31:58 -- event/cpu_locks.sh@15 -- # killprocess 1084882 00:07:33.581 16:31:58 -- common/autotest_common.sh@926 -- # '[' -z 1084882 ']' 00:07:33.581 16:31:58 -- common/autotest_common.sh@930 -- # kill -0 1084882 00:07:33.581 16:31:58 -- common/autotest_common.sh@931 -- # uname 00:07:33.581 16:31:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:33.581 16:31:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1084882 00:07:33.581 16:31:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:33.581 16:31:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:33.581 16:31:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1084882' 00:07:33.581 killing process with pid 1084882 00:07:33.581 16:31:58 -- common/autotest_common.sh@945 -- # kill 1084882 00:07:33.581 16:31:58 -- common/autotest_common.sh@950 -- # wait 1084882 00:07:33.838 16:31:59 -- event/cpu_locks.sh@16 -- # [[ -z 1085021 ]] 00:07:33.838 16:31:59 -- event/cpu_locks.sh@16 -- # killprocess 1085021 00:07:33.838 16:31:59 -- common/autotest_common.sh@926 -- # '[' -z 1085021 ']' 00:07:33.838 16:31:59 -- common/autotest_common.sh@930 -- # kill -0 1085021 00:07:34.096 16:31:59 -- common/autotest_common.sh@931 -- # uname 00:07:34.096 16:31:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:34.096 16:31:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1085021 00:07:34.096 16:31:59 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:07:34.096 16:31:59 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:07:34.096 16:31:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1085021' 00:07:34.096 killing process with pid 1085021 00:07:34.096 16:31:59 -- common/autotest_common.sh@945 -- # kill 1085021 00:07:34.096 16:31:59 -- common/autotest_common.sh@950 -- # wait 1085021 00:07:34.354 16:31:59 -- event/cpu_locks.sh@18 -- # rm -f 00:07:34.354 16:31:59 -- event/cpu_locks.sh@1 -- # cleanup 00:07:34.354 16:31:59 -- event/cpu_locks.sh@15 -- # [[ -z 1084882 ]] 00:07:34.354 16:31:59 -- event/cpu_locks.sh@15 -- # killprocess 1084882 00:07:34.354 16:31:59 -- common/autotest_common.sh@926 -- # '[' -z 1084882 ']' 00:07:34.354 16:31:59 -- common/autotest_common.sh@930 -- # kill -0 1084882 00:07:34.354 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1084882) - No such process 00:07:34.354 16:31:59 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1084882 is not found' 00:07:34.354 Process with pid 1084882 is not found 00:07:34.354 16:31:59 -- event/cpu_locks.sh@16 -- # [[ -z 1085021 ]] 00:07:34.354 16:31:59 -- event/cpu_locks.sh@16 -- # killprocess 1085021 00:07:34.354 16:31:59 -- common/autotest_common.sh@926 -- # '[' -z 1085021 ']' 00:07:34.354 16:31:59 -- common/autotest_common.sh@930 -- # kill -0 1085021 00:07:34.354 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1085021) - No such process 00:07:34.354 16:31:59 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1085021 is not found' 00:07:34.354 Process with pid 1085021 is not found 00:07:34.354 16:31:59 -- event/cpu_locks.sh@18 -- # rm -f 00:07:34.354 00:07:34.354 real 0m19.560s 00:07:34.354 user 0m35.552s 00:07:34.354 sys 0m5.522s 00:07:34.354 16:31:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:34.354 16:31:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.354 ************************************ 00:07:34.354 END TEST cpu_locks 00:07:34.354 ************************************ 00:07:34.354 00:07:34.354 real 0m46.057s 00:07:34.354 user 1m29.157s 00:07:34.354 sys 0m9.402s 00:07:34.354 16:31:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:34.354 16:31:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.354 ************************************ 00:07:34.354 END TEST event 00:07:34.354 ************************************ 00:07:34.354 16:31:59 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:34.354 16:31:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:34.354 16:31:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:34.354 16:31:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.354 ************************************ 00:07:34.354 START TEST thread 00:07:34.354 ************************************ 00:07:34.354 16:31:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:34.635 * Looking for test storage... 00:07:34.635 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:07:34.635 16:31:59 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:34.635 16:31:59 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:07:34.635 16:31:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:34.635 16:31:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.635 ************************************ 00:07:34.635 START TEST thread_poller_perf 00:07:34.635 ************************************ 00:07:34.635 16:31:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:34.635 [2024-10-13 16:31:59.880500] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:34.635 [2024-10-13 16:31:59.880589] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085519 ] 00:07:34.635 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.635 [2024-10-13 16:31:59.937981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.635 [2024-10-13 16:32:00.026285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.635 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:35.652 [2024-10-13T14:32:01.153Z] ====================================== 00:07:35.652 [2024-10-13T14:32:01.153Z] busy:2709629800 (cyc) 00:07:35.652 [2024-10-13T14:32:01.153Z] total_run_count: 282000 00:07:35.652 [2024-10-13T14:32:01.153Z] tsc_hz: 2700000000 (cyc) 00:07:35.652 [2024-10-13T14:32:01.153Z] ====================================== 00:07:35.652 [2024-10-13T14:32:01.153Z] poller_cost: 9608 (cyc), 3558 (nsec) 00:07:35.652 00:07:35.652 real 0m1.246s 00:07:35.652 user 0m1.161s 00:07:35.652 sys 0m0.078s 00:07:35.652 16:32:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:35.652 16:32:01 -- common/autotest_common.sh@10 -- # set +x 00:07:35.652 ************************************ 00:07:35.652 END TEST thread_poller_perf 00:07:35.652 ************************************ 00:07:35.652 16:32:01 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:35.652 16:32:01 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:07:35.652 16:32:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:35.652 16:32:01 -- common/autotest_common.sh@10 -- # set +x 00:07:35.652 ************************************ 00:07:35.652 START TEST thread_poller_perf 00:07:35.652 ************************************ 00:07:35.652 16:32:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:35.910 [2024-10-13 16:32:01.155837] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:35.910 [2024-10-13 16:32:01.155924] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085678 ] 00:07:35.910 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.910 [2024-10-13 16:32:01.220327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.910 [2024-10-13 16:32:01.309869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.910 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:37.282 [2024-10-13T14:32:02.783Z] ====================================== 00:07:37.282 [2024-10-13T14:32:02.783Z] busy:2703400421 (cyc) 00:07:37.282 [2024-10-13T14:32:02.783Z] total_run_count: 3827000 00:07:37.282 [2024-10-13T14:32:02.783Z] tsc_hz: 2700000000 (cyc) 00:07:37.282 [2024-10-13T14:32:02.783Z] ====================================== 00:07:37.282 [2024-10-13T14:32:02.783Z] poller_cost: 706 (cyc), 261 (nsec) 00:07:37.282 00:07:37.282 real 0m1.253s 00:07:37.282 user 0m1.161s 00:07:37.282 sys 0m0.085s 00:07:37.282 16:32:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:37.282 16:32:02 -- common/autotest_common.sh@10 -- # set +x 00:07:37.282 ************************************ 00:07:37.282 END TEST thread_poller_perf 00:07:37.282 ************************************ 00:07:37.282 16:32:02 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:37.282 00:07:37.282 real 0m2.601s 00:07:37.282 user 0m2.357s 00:07:37.282 sys 0m0.244s 00:07:37.282 16:32:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:37.282 16:32:02 -- common/autotest_common.sh@10 -- # set +x 00:07:37.282 ************************************ 00:07:37.282 END TEST thread 00:07:37.282 ************************************ 00:07:37.282 16:32:02 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:37.282 16:32:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:37.282 16:32:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:37.282 16:32:02 -- common/autotest_common.sh@10 -- # set +x 00:07:37.282 ************************************ 00:07:37.282 START TEST accel 00:07:37.282 ************************************ 00:07:37.282 16:32:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:37.282 * Looking for test storage... 00:07:37.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:37.282 16:32:02 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:07:37.282 16:32:02 -- accel/accel.sh@74 -- # get_expected_opcs 00:07:37.282 16:32:02 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:37.282 16:32:02 -- accel/accel.sh@59 -- # spdk_tgt_pid=1085878 00:07:37.282 16:32:02 -- accel/accel.sh@60 -- # waitforlisten 1085878 00:07:37.282 16:32:02 -- common/autotest_common.sh@819 -- # '[' -z 1085878 ']' 00:07:37.282 16:32:02 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:37.282 16:32:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:37.282 16:32:02 -- accel/accel.sh@58 -- # build_accel_config 00:07:37.282 16:32:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:37.282 16:32:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.282 16:32:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:37.282 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:37.282 16:32:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.282 16:32:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:37.282 16:32:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.282 16:32:02 -- common/autotest_common.sh@10 -- # set +x 00:07:37.282 16:32:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.282 16:32:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.282 16:32:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.282 16:32:02 -- accel/accel.sh@42 -- # jq -r . 00:07:37.282 [2024-10-13 16:32:02.546091] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:37.282 [2024-10-13 16:32:02.546184] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085878 ] 00:07:37.282 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.282 [2024-10-13 16:32:02.606127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.282 [2024-10-13 16:32:02.693373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:37.282 [2024-10-13 16:32:02.693559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.214 16:32:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:38.214 16:32:03 -- common/autotest_common.sh@852 -- # return 0 00:07:38.214 16:32:03 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:38.214 16:32:03 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:07:38.214 16:32:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:38.214 16:32:03 -- common/autotest_common.sh@10 -- # set +x 00:07:38.214 16:32:03 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:38.214 16:32:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.214 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.214 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.214 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # IFS== 00:07:38.215 16:32:03 -- accel/accel.sh@64 -- # read -r opc module 00:07:38.215 16:32:03 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:38.215 16:32:03 -- accel/accel.sh@67 -- # killprocess 1085878 00:07:38.215 16:32:03 -- common/autotest_common.sh@926 -- # '[' -z 1085878 ']' 00:07:38.215 16:32:03 -- common/autotest_common.sh@930 -- # kill -0 1085878 00:07:38.215 16:32:03 -- common/autotest_common.sh@931 -- # uname 00:07:38.215 16:32:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:38.215 16:32:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1085878 00:07:38.215 16:32:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:38.215 16:32:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:38.215 16:32:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1085878' 00:07:38.215 killing process with pid 1085878 00:07:38.215 16:32:03 -- common/autotest_common.sh@945 -- # kill 1085878 00:07:38.215 16:32:03 -- common/autotest_common.sh@950 -- # wait 1085878 00:07:38.780 16:32:03 -- accel/accel.sh@68 -- # trap - ERR 00:07:38.780 16:32:03 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:07:38.780 16:32:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:38.780 16:32:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:38.780 16:32:03 -- common/autotest_common.sh@10 -- # set +x 00:07:38.780 16:32:04 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:07:38.780 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:38.780 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.780 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.780 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.780 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.780 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:38.780 16:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:38.780 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:38.780 16:32:04 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:38.780 16:32:04 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:38.780 16:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:38.780 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:38.780 ************************************ 00:07:38.780 START TEST accel_missing_filename 00:07:38.780 ************************************ 00:07:38.780 16:32:04 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:07:38.780 16:32:04 -- common/autotest_common.sh@640 -- # local es=0 00:07:38.780 16:32:04 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:38.780 16:32:04 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:07:38.780 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:38.780 16:32:04 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:07:38.780 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:38.780 16:32:04 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:07:38.780 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:38.780 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.780 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.780 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.780 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.780 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.780 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:38.780 [2024-10-13 16:32:04.066216] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:38.780 [2024-10-13 16:32:04.066300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086048 ] 00:07:38.780 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.780 [2024-10-13 16:32:04.131695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.780 [2024-10-13 16:32:04.229890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.038 [2024-10-13 16:32:04.289405] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:39.038 [2024-10-13 16:32:04.371059] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:39.038 A filename is required. 00:07:39.038 16:32:04 -- common/autotest_common.sh@643 -- # es=234 00:07:39.038 16:32:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:39.038 16:32:04 -- common/autotest_common.sh@652 -- # es=106 00:07:39.038 16:32:04 -- common/autotest_common.sh@653 -- # case "$es" in 00:07:39.038 16:32:04 -- common/autotest_common.sh@660 -- # es=1 00:07:39.038 16:32:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:39.038 00:07:39.038 real 0m0.397s 00:07:39.038 user 0m0.292s 00:07:39.038 sys 0m0.139s 00:07:39.038 16:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.038 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.038 ************************************ 00:07:39.038 END TEST accel_missing_filename 00:07:39.038 ************************************ 00:07:39.038 16:32:04 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:39.038 16:32:04 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:07:39.038 16:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.038 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.038 ************************************ 00:07:39.038 START TEST accel_compress_verify 00:07:39.038 ************************************ 00:07:39.038 16:32:04 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:39.038 16:32:04 -- common/autotest_common.sh@640 -- # local es=0 00:07:39.038 16:32:04 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:39.038 16:32:04 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:07:39.038 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.038 16:32:04 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:07:39.038 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.038 16:32:04 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:39.038 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:39.038 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.038 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.038 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.039 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.039 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.039 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.039 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.039 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:39.039 [2024-10-13 16:32:04.487630] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:39.039 [2024-10-13 16:32:04.487726] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086202 ] 00:07:39.039 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.296 [2024-10-13 16:32:04.548582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.296 [2024-10-13 16:32:04.639539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.296 [2024-10-13 16:32:04.701463] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:39.296 [2024-10-13 16:32:04.785618] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:39.555 00:07:39.555 Compression does not support the verify option, aborting. 00:07:39.555 16:32:04 -- common/autotest_common.sh@643 -- # es=161 00:07:39.555 16:32:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:39.555 16:32:04 -- common/autotest_common.sh@652 -- # es=33 00:07:39.555 16:32:04 -- common/autotest_common.sh@653 -- # case "$es" in 00:07:39.555 16:32:04 -- common/autotest_common.sh@660 -- # es=1 00:07:39.555 16:32:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:39.555 00:07:39.555 real 0m0.398s 00:07:39.555 user 0m0.287s 00:07:39.555 sys 0m0.144s 00:07:39.555 16:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 END TEST accel_compress_verify 00:07:39.555 ************************************ 00:07:39.555 16:32:04 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:39.555 16:32:04 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:39.555 16:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 START TEST accel_wrong_workload 00:07:39.555 ************************************ 00:07:39.555 16:32:04 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:07:39.555 16:32:04 -- common/autotest_common.sh@640 -- # local es=0 00:07:39.555 16:32:04 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:39.555 16:32:04 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.555 16:32:04 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.555 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.555 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.555 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.555 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:39.555 Unsupported workload type: foobar 00:07:39.555 [2024-10-13 16:32:04.911181] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:39.555 accel_perf options: 00:07:39.555 [-h help message] 00:07:39.555 [-q queue depth per core] 00:07:39.555 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:39.555 [-T number of threads per core 00:07:39.555 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:39.555 [-t time in seconds] 00:07:39.555 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:39.555 [ dif_verify, , dif_generate, dif_generate_copy 00:07:39.555 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:39.555 [-l for compress/decompress workloads, name of uncompressed input file 00:07:39.555 [-S for crc32c workload, use this seed value (default 0) 00:07:39.555 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:39.555 [-f for fill workload, use this BYTE value (default 255) 00:07:39.555 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:39.555 [-y verify result if this switch is on] 00:07:39.555 [-a tasks to allocate per core (default: same value as -q)] 00:07:39.555 Can be used to spread operations across a wider range of memory. 00:07:39.555 16:32:04 -- common/autotest_common.sh@643 -- # es=1 00:07:39.555 16:32:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:39.555 16:32:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:39.555 16:32:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:39.555 00:07:39.555 real 0m0.022s 00:07:39.555 user 0m0.011s 00:07:39.555 sys 0m0.011s 00:07:39.555 16:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 END TEST accel_wrong_workload 00:07:39.555 ************************************ 00:07:39.555 Error: writing output failed: Broken pipe 00:07:39.555 16:32:04 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:39.555 16:32:04 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:07:39.555 16:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 START TEST accel_negative_buffers 00:07:39.555 ************************************ 00:07:39.555 16:32:04 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:39.555 16:32:04 -- common/autotest_common.sh@640 -- # local es=0 00:07:39.555 16:32:04 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:39.555 16:32:04 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:07:39.555 16:32:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:39.555 16:32:04 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.555 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.555 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.555 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.555 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:39.555 -x option must be non-negative. 00:07:39.555 [2024-10-13 16:32:04.962302] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:39.555 accel_perf options: 00:07:39.555 [-h help message] 00:07:39.555 [-q queue depth per core] 00:07:39.555 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:39.555 [-T number of threads per core 00:07:39.555 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:39.555 [-t time in seconds] 00:07:39.555 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:39.555 [ dif_verify, , dif_generate, dif_generate_copy 00:07:39.555 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:39.555 [-l for compress/decompress workloads, name of uncompressed input file 00:07:39.555 [-S for crc32c workload, use this seed value (default 0) 00:07:39.555 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:39.555 [-f for fill workload, use this BYTE value (default 255) 00:07:39.555 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:39.555 [-y verify result if this switch is on] 00:07:39.555 [-a tasks to allocate per core (default: same value as -q)] 00:07:39.555 Can be used to spread operations across a wider range of memory. 00:07:39.555 16:32:04 -- common/autotest_common.sh@643 -- # es=1 00:07:39.555 16:32:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:39.555 16:32:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:39.555 16:32:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:39.555 00:07:39.555 real 0m0.024s 00:07:39.555 user 0m0.014s 00:07:39.555 sys 0m0.010s 00:07:39.555 16:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 END TEST accel_negative_buffers 00:07:39.555 ************************************ 00:07:39.555 Error: writing output failed: Broken pipe 00:07:39.555 16:32:04 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:39.555 16:32:04 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:39.555 16:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.555 16:32:04 -- common/autotest_common.sh@10 -- # set +x 00:07:39.555 ************************************ 00:07:39.555 START TEST accel_crc32c 00:07:39.555 ************************************ 00:07:39.555 16:32:04 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:39.555 16:32:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.555 16:32:04 -- accel/accel.sh@17 -- # local accel_module 00:07:39.555 16:32:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:39.555 16:32:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.555 16:32:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.555 16:32:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.555 16:32:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.555 16:32:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.555 16:32:04 -- accel/accel.sh@42 -- # jq -r . 00:07:39.555 [2024-10-13 16:32:05.006965] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:39.555 [2024-10-13 16:32:05.007030] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086255 ] 00:07:39.555 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.813 [2024-10-13 16:32:05.071378] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.813 [2024-10-13 16:32:05.162231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.185 16:32:06 -- accel/accel.sh@18 -- # out=' 00:07:41.185 SPDK Configuration: 00:07:41.185 Core mask: 0x1 00:07:41.185 00:07:41.185 Accel Perf Configuration: 00:07:41.185 Workload Type: crc32c 00:07:41.185 CRC-32C seed: 32 00:07:41.185 Transfer size: 4096 bytes 00:07:41.185 Vector count 1 00:07:41.185 Module: software 00:07:41.185 Queue depth: 32 00:07:41.185 Allocate depth: 32 00:07:41.185 # threads/core: 1 00:07:41.185 Run time: 1 seconds 00:07:41.185 Verify: Yes 00:07:41.185 00:07:41.185 Running for 1 seconds... 00:07:41.185 00:07:41.185 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:41.185 ------------------------------------------------------------------------------------ 00:07:41.185 0,0 411232/s 1606 MiB/s 0 0 00:07:41.185 ==================================================================================== 00:07:41.185 Total 411232/s 1606 MiB/s 0 0' 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:41.185 16:32:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.185 16:32:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.185 16:32:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.185 16:32:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.185 16:32:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.185 16:32:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.185 16:32:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.185 16:32:06 -- accel/accel.sh@42 -- # jq -r . 00:07:41.185 [2024-10-13 16:32:06.417113] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:41.185 [2024-10-13 16:32:06.417199] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086395 ] 00:07:41.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.185 [2024-10-13 16:32:06.480796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.185 [2024-10-13 16:32:06.573500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=0x1 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=crc32c 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=32 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=software 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=32 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=32 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=1 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val=Yes 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.185 16:32:06 -- accel/accel.sh@21 -- # val= 00:07:41.185 16:32:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.185 16:32:06 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@21 -- # val= 00:07:42.556 16:32:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.556 16:32:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.556 16:32:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:42.556 16:32:07 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:42.556 16:32:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:42.556 00:07:42.556 real 0m2.808s 00:07:42.556 user 0m2.522s 00:07:42.556 sys 0m0.279s 00:07:42.556 16:32:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:42.556 16:32:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.556 ************************************ 00:07:42.556 END TEST accel_crc32c 00:07:42.556 ************************************ 00:07:42.556 16:32:07 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:42.557 16:32:07 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:42.557 16:32:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:42.557 16:32:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.557 ************************************ 00:07:42.557 START TEST accel_crc32c_C2 00:07:42.557 ************************************ 00:07:42.557 16:32:07 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:42.557 16:32:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:42.557 16:32:07 -- accel/accel.sh@17 -- # local accel_module 00:07:42.557 16:32:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:42.557 16:32:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:42.557 16:32:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.557 16:32:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.557 16:32:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.557 16:32:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.557 16:32:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.557 16:32:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.557 16:32:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.557 16:32:07 -- accel/accel.sh@42 -- # jq -r . 00:07:42.557 [2024-10-13 16:32:07.845221] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:42.557 [2024-10-13 16:32:07.845304] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086682 ] 00:07:42.557 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.557 [2024-10-13 16:32:07.902889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.557 [2024-10-13 16:32:07.992855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.928 16:32:09 -- accel/accel.sh@18 -- # out=' 00:07:43.928 SPDK Configuration: 00:07:43.928 Core mask: 0x1 00:07:43.928 00:07:43.928 Accel Perf Configuration: 00:07:43.928 Workload Type: crc32c 00:07:43.928 CRC-32C seed: 0 00:07:43.928 Transfer size: 4096 bytes 00:07:43.928 Vector count 2 00:07:43.928 Module: software 00:07:43.928 Queue depth: 32 00:07:43.928 Allocate depth: 32 00:07:43.928 # threads/core: 1 00:07:43.928 Run time: 1 seconds 00:07:43.928 Verify: Yes 00:07:43.928 00:07:43.928 Running for 1 seconds... 00:07:43.928 00:07:43.928 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.928 ------------------------------------------------------------------------------------ 00:07:43.928 0,0 310912/s 2429 MiB/s 0 0 00:07:43.928 ==================================================================================== 00:07:43.928 Total 310912/s 1214 MiB/s 0 0' 00:07:43.928 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:43.928 16:32:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:43.928 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:43.928 16:32:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:43.928 16:32:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.928 16:32:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.928 16:32:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.928 16:32:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.928 16:32:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.928 16:32:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.928 16:32:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.928 16:32:09 -- accel/accel.sh@42 -- # jq -r . 00:07:43.928 [2024-10-13 16:32:09.248848] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:43.928 [2024-10-13 16:32:09.248937] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086824 ] 00:07:43.928 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.928 [2024-10-13 16:32:09.308686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.928 [2024-10-13 16:32:09.398725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.186 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.186 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.186 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=0x1 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=crc32c 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=0 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=software 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=32 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=32 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=1 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val=Yes 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.187 16:32:09 -- accel/accel.sh@21 -- # val= 00:07:44.187 16:32:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.187 16:32:09 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@21 -- # val= 00:07:45.559 16:32:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # IFS=: 00:07:45.559 16:32:10 -- accel/accel.sh@20 -- # read -r var val 00:07:45.559 16:32:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:45.559 16:32:10 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:45.559 16:32:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:45.559 00:07:45.559 real 0m2.809s 00:07:45.559 user 0m2.504s 00:07:45.559 sys 0m0.294s 00:07:45.559 16:32:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:45.559 16:32:10 -- common/autotest_common.sh@10 -- # set +x 00:07:45.559 ************************************ 00:07:45.559 END TEST accel_crc32c_C2 00:07:45.559 ************************************ 00:07:45.559 16:32:10 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:45.559 16:32:10 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:45.559 16:32:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:45.559 16:32:10 -- common/autotest_common.sh@10 -- # set +x 00:07:45.559 ************************************ 00:07:45.559 START TEST accel_copy 00:07:45.559 ************************************ 00:07:45.559 16:32:10 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:07:45.559 16:32:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:45.559 16:32:10 -- accel/accel.sh@17 -- # local accel_module 00:07:45.559 16:32:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:45.559 16:32:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:45.559 16:32:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.559 16:32:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.559 16:32:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.559 16:32:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.559 16:32:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.559 16:32:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.559 16:32:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.559 16:32:10 -- accel/accel.sh@42 -- # jq -r . 00:07:45.559 [2024-10-13 16:32:10.675818] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:45.559 [2024-10-13 16:32:10.675902] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086983 ] 00:07:45.559 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.559 [2024-10-13 16:32:10.736414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.559 [2024-10-13 16:32:10.826619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.932 16:32:12 -- accel/accel.sh@18 -- # out=' 00:07:46.932 SPDK Configuration: 00:07:46.932 Core mask: 0x1 00:07:46.932 00:07:46.932 Accel Perf Configuration: 00:07:46.932 Workload Type: copy 00:07:46.932 Transfer size: 4096 bytes 00:07:46.932 Vector count 1 00:07:46.932 Module: software 00:07:46.932 Queue depth: 32 00:07:46.932 Allocate depth: 32 00:07:46.932 # threads/core: 1 00:07:46.932 Run time: 1 seconds 00:07:46.932 Verify: Yes 00:07:46.932 00:07:46.932 Running for 1 seconds... 00:07:46.932 00:07:46.932 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.932 ------------------------------------------------------------------------------------ 00:07:46.932 0,0 284800/s 1112 MiB/s 0 0 00:07:46.932 ==================================================================================== 00:07:46.932 Total 284800/s 1112 MiB/s 0 0' 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:46.932 16:32:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.932 16:32:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.932 16:32:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.932 16:32:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.932 16:32:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.932 16:32:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.932 16:32:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.932 16:32:12 -- accel/accel.sh@42 -- # jq -r . 00:07:46.932 [2024-10-13 16:32:12.080386] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:46.932 [2024-10-13 16:32:12.080505] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087139 ] 00:07:46.932 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.932 [2024-10-13 16:32:12.140836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.932 [2024-10-13 16:32:12.230295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val=0x1 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val=copy 00:07:46.932 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.932 16:32:12 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.932 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.932 16:32:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val=software 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val=32 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val=32 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val=1 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val=Yes 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:46.933 16:32:12 -- accel/accel.sh@21 -- # val= 00:07:46.933 16:32:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # IFS=: 00:07:46.933 16:32:12 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@21 -- # val= 00:07:48.304 16:32:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # IFS=: 00:07:48.304 16:32:13 -- accel/accel.sh@20 -- # read -r var val 00:07:48.304 16:32:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:48.304 16:32:13 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:48.304 16:32:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:48.304 00:07:48.304 real 0m2.797s 00:07:48.304 user 0m2.499s 00:07:48.304 sys 0m0.287s 00:07:48.304 16:32:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:48.304 16:32:13 -- common/autotest_common.sh@10 -- # set +x 00:07:48.304 ************************************ 00:07:48.304 END TEST accel_copy 00:07:48.304 ************************************ 00:07:48.304 16:32:13 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:48.304 16:32:13 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:48.304 16:32:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:48.304 16:32:13 -- common/autotest_common.sh@10 -- # set +x 00:07:48.304 ************************************ 00:07:48.304 START TEST accel_fill 00:07:48.304 ************************************ 00:07:48.304 16:32:13 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:48.305 16:32:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:48.305 16:32:13 -- accel/accel.sh@17 -- # local accel_module 00:07:48.305 16:32:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:48.305 16:32:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:48.305 16:32:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.305 16:32:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.305 16:32:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.305 16:32:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.305 16:32:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.305 16:32:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.305 16:32:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.305 16:32:13 -- accel/accel.sh@42 -- # jq -r . 00:07:48.305 [2024-10-13 16:32:13.495132] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:48.305 [2024-10-13 16:32:13.495222] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087403 ] 00:07:48.305 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.305 [2024-10-13 16:32:13.555561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.305 [2024-10-13 16:32:13.646027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.676 16:32:14 -- accel/accel.sh@18 -- # out=' 00:07:49.676 SPDK Configuration: 00:07:49.676 Core mask: 0x1 00:07:49.676 00:07:49.676 Accel Perf Configuration: 00:07:49.676 Workload Type: fill 00:07:49.676 Fill pattern: 0x80 00:07:49.676 Transfer size: 4096 bytes 00:07:49.676 Vector count 1 00:07:49.676 Module: software 00:07:49.676 Queue depth: 64 00:07:49.676 Allocate depth: 64 00:07:49.676 # threads/core: 1 00:07:49.676 Run time: 1 seconds 00:07:49.676 Verify: Yes 00:07:49.676 00:07:49.676 Running for 1 seconds... 00:07:49.676 00:07:49.676 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:49.676 ------------------------------------------------------------------------------------ 00:07:49.676 0,0 413312/s 1614 MiB/s 0 0 00:07:49.676 ==================================================================================== 00:07:49.676 Total 413312/s 1614 MiB/s 0 0' 00:07:49.676 16:32:14 -- accel/accel.sh@20 -- # IFS=: 00:07:49.676 16:32:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:49.676 16:32:14 -- accel/accel.sh@20 -- # read -r var val 00:07:49.676 16:32:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:49.676 16:32:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:49.676 16:32:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:49.676 16:32:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:49.676 16:32:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:49.676 16:32:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:49.676 16:32:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:49.676 16:32:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:49.676 16:32:14 -- accel/accel.sh@42 -- # jq -r . 00:07:49.676 [2024-10-13 16:32:14.896588] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:49.676 [2024-10-13 16:32:14.896669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087551 ] 00:07:49.676 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.677 [2024-10-13 16:32:14.957535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.677 [2024-10-13 16:32:15.047695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=0x1 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=fill 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=0x80 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=software 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=64 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=64 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=1 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val=Yes 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:49.677 16:32:15 -- accel/accel.sh@21 -- # val= 00:07:49.677 16:32:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # IFS=: 00:07:49.677 16:32:15 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@21 -- # val= 00:07:51.049 16:32:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # IFS=: 00:07:51.049 16:32:16 -- accel/accel.sh@20 -- # read -r var val 00:07:51.049 16:32:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:51.049 16:32:16 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:51.049 16:32:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:51.049 00:07:51.049 real 0m2.808s 00:07:51.049 user 0m2.517s 00:07:51.049 sys 0m0.282s 00:07:51.049 16:32:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:51.049 16:32:16 -- common/autotest_common.sh@10 -- # set +x 00:07:51.049 ************************************ 00:07:51.049 END TEST accel_fill 00:07:51.049 ************************************ 00:07:51.049 16:32:16 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:51.049 16:32:16 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:51.049 16:32:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:51.049 16:32:16 -- common/autotest_common.sh@10 -- # set +x 00:07:51.049 ************************************ 00:07:51.049 START TEST accel_copy_crc32c 00:07:51.049 ************************************ 00:07:51.049 16:32:16 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:07:51.049 16:32:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:51.049 16:32:16 -- accel/accel.sh@17 -- # local accel_module 00:07:51.049 16:32:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:51.049 16:32:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:51.049 16:32:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.049 16:32:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.049 16:32:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.049 16:32:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.049 16:32:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.049 16:32:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.049 16:32:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.049 16:32:16 -- accel/accel.sh@42 -- # jq -r . 00:07:51.049 [2024-10-13 16:32:16.325918] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:51.049 [2024-10-13 16:32:16.326001] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087704 ] 00:07:51.049 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.049 [2024-10-13 16:32:16.387263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.049 [2024-10-13 16:32:16.477787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.421 16:32:17 -- accel/accel.sh@18 -- # out=' 00:07:52.421 SPDK Configuration: 00:07:52.421 Core mask: 0x1 00:07:52.421 00:07:52.421 Accel Perf Configuration: 00:07:52.421 Workload Type: copy_crc32c 00:07:52.421 CRC-32C seed: 0 00:07:52.421 Vector size: 4096 bytes 00:07:52.421 Transfer size: 4096 bytes 00:07:52.421 Vector count 1 00:07:52.421 Module: software 00:07:52.421 Queue depth: 32 00:07:52.421 Allocate depth: 32 00:07:52.421 # threads/core: 1 00:07:52.421 Run time: 1 seconds 00:07:52.422 Verify: Yes 00:07:52.422 00:07:52.422 Running for 1 seconds... 00:07:52.422 00:07:52.422 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:52.422 ------------------------------------------------------------------------------------ 00:07:52.422 0,0 223136/s 871 MiB/s 0 0 00:07:52.422 ==================================================================================== 00:07:52.422 Total 223136/s 871 MiB/s 0 0' 00:07:52.422 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.422 16:32:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:52.422 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.422 16:32:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:52.422 16:32:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:52.422 16:32:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:52.422 16:32:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:52.422 16:32:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:52.422 16:32:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:52.422 16:32:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:52.422 16:32:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:52.422 16:32:17 -- accel/accel.sh@42 -- # jq -r . 00:07:52.422 [2024-10-13 16:32:17.731242] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:52.422 [2024-10-13 16:32:17.731331] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087850 ] 00:07:52.422 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.422 [2024-10-13 16:32:17.793864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:52.422 [2024-10-13 16:32:17.884801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=0x1 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=0 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=software 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=32 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=32 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=1 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val=Yes 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:52.679 16:32:17 -- accel/accel.sh@21 -- # val= 00:07:52.679 16:32:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # IFS=: 00:07:52.679 16:32:17 -- accel/accel.sh@20 -- # read -r var val 00:07:54.050 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.050 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.050 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.050 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.050 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.050 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.050 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.050 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.050 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.051 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.051 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.051 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.051 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.051 16:32:19 -- accel/accel.sh@21 -- # val= 00:07:54.051 16:32:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.051 16:32:19 -- accel/accel.sh@20 -- # IFS=: 00:07:54.051 16:32:19 -- accel/accel.sh@20 -- # read -r var val 00:07:54.051 16:32:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:54.051 16:32:19 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:54.051 16:32:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:54.051 00:07:54.051 real 0m2.807s 00:07:54.051 user 0m2.520s 00:07:54.051 sys 0m0.277s 00:07:54.051 16:32:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:54.051 16:32:19 -- common/autotest_common.sh@10 -- # set +x 00:07:54.051 ************************************ 00:07:54.051 END TEST accel_copy_crc32c 00:07:54.051 ************************************ 00:07:54.051 16:32:19 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:54.051 16:32:19 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:54.051 16:32:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:54.051 16:32:19 -- common/autotest_common.sh@10 -- # set +x 00:07:54.051 ************************************ 00:07:54.051 START TEST accel_copy_crc32c_C2 00:07:54.051 ************************************ 00:07:54.051 16:32:19 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:54.051 16:32:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:54.051 16:32:19 -- accel/accel.sh@17 -- # local accel_module 00:07:54.051 16:32:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:54.051 16:32:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:54.051 16:32:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.051 16:32:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:54.051 16:32:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.051 16:32:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.051 16:32:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:54.051 16:32:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:54.051 16:32:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:54.051 16:32:19 -- accel/accel.sh@42 -- # jq -r . 00:07:54.051 [2024-10-13 16:32:19.154863] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:54.051 [2024-10-13 16:32:19.154945] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088124 ] 00:07:54.051 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.051 [2024-10-13 16:32:19.212779] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.051 [2024-10-13 16:32:19.309678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.424 16:32:20 -- accel/accel.sh@18 -- # out=' 00:07:55.424 SPDK Configuration: 00:07:55.424 Core mask: 0x1 00:07:55.424 00:07:55.424 Accel Perf Configuration: 00:07:55.424 Workload Type: copy_crc32c 00:07:55.424 CRC-32C seed: 0 00:07:55.424 Vector size: 4096 bytes 00:07:55.424 Transfer size: 8192 bytes 00:07:55.424 Vector count 2 00:07:55.424 Module: software 00:07:55.424 Queue depth: 32 00:07:55.424 Allocate depth: 32 00:07:55.424 # threads/core: 1 00:07:55.424 Run time: 1 seconds 00:07:55.424 Verify: Yes 00:07:55.424 00:07:55.424 Running for 1 seconds... 00:07:55.424 00:07:55.424 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:55.424 ------------------------------------------------------------------------------------ 00:07:55.424 0,0 155136/s 1212 MiB/s 0 0 00:07:55.424 ==================================================================================== 00:07:55.424 Total 155136/s 606 MiB/s 0 0' 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:55.424 16:32:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:55.424 16:32:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.424 16:32:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:55.424 16:32:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.424 16:32:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.424 16:32:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:55.424 16:32:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:55.424 16:32:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:55.424 16:32:20 -- accel/accel.sh@42 -- # jq -r . 00:07:55.424 [2024-10-13 16:32:20.550751] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:55.424 [2024-10-13 16:32:20.550835] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088272 ] 00:07:55.424 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.424 [2024-10-13 16:32:20.610854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.424 [2024-10-13 16:32:20.700941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=0x1 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=0 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=software 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=32 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=32 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=1 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val=Yes 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:55.424 16:32:20 -- accel/accel.sh@21 -- # val= 00:07:55.424 16:32:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # IFS=: 00:07:55.424 16:32:20 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@21 -- # val= 00:07:56.797 16:32:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # IFS=: 00:07:56.797 16:32:21 -- accel/accel.sh@20 -- # read -r var val 00:07:56.797 16:32:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:56.797 16:32:21 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:56.797 16:32:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:56.797 00:07:56.797 real 0m2.796s 00:07:56.797 user 0m2.510s 00:07:56.797 sys 0m0.276s 00:07:56.797 16:32:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:56.797 16:32:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.797 ************************************ 00:07:56.797 END TEST accel_copy_crc32c_C2 00:07:56.797 ************************************ 00:07:56.797 16:32:21 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:56.797 16:32:21 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:56.797 16:32:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:56.797 16:32:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.797 ************************************ 00:07:56.797 START TEST accel_dualcast 00:07:56.797 ************************************ 00:07:56.797 16:32:21 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:07:56.797 16:32:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:56.797 16:32:21 -- accel/accel.sh@17 -- # local accel_module 00:07:56.797 16:32:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:56.797 16:32:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:56.797 16:32:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:56.797 16:32:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:56.797 16:32:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:56.797 16:32:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:56.797 16:32:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:56.797 16:32:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:56.797 16:32:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:56.797 16:32:21 -- accel/accel.sh@42 -- # jq -r . 00:07:56.797 [2024-10-13 16:32:21.975111] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:56.797 [2024-10-13 16:32:21.975198] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088431 ] 00:07:56.797 EAL: No free 2048 kB hugepages reported on node 1 00:07:56.797 [2024-10-13 16:32:22.036025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.797 [2024-10-13 16:32:22.126942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.170 16:32:23 -- accel/accel.sh@18 -- # out=' 00:07:58.170 SPDK Configuration: 00:07:58.170 Core mask: 0x1 00:07:58.170 00:07:58.170 Accel Perf Configuration: 00:07:58.170 Workload Type: dualcast 00:07:58.170 Transfer size: 4096 bytes 00:07:58.170 Vector count 1 00:07:58.170 Module: software 00:07:58.170 Queue depth: 32 00:07:58.170 Allocate depth: 32 00:07:58.170 # threads/core: 1 00:07:58.170 Run time: 1 seconds 00:07:58.170 Verify: Yes 00:07:58.170 00:07:58.170 Running for 1 seconds... 00:07:58.170 00:07:58.170 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:58.170 ------------------------------------------------------------------------------------ 00:07:58.170 0,0 300288/s 1173 MiB/s 0 0 00:07:58.170 ==================================================================================== 00:07:58.170 Total 300288/s 1173 MiB/s 0 0' 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:58.170 16:32:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:58.170 16:32:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:58.170 16:32:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:58.170 16:32:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:58.170 16:32:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:58.170 16:32:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:58.170 16:32:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:58.170 16:32:23 -- accel/accel.sh@42 -- # jq -r . 00:07:58.170 [2024-10-13 16:32:23.377291] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:58.170 [2024-10-13 16:32:23.377377] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088571 ] 00:07:58.170 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.170 [2024-10-13 16:32:23.437728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.170 [2024-10-13 16:32:23.528182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=0x1 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=dualcast 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=software 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=32 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=32 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=1 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val=Yes 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:58.170 16:32:23 -- accel/accel.sh@21 -- # val= 00:07:58.170 16:32:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # IFS=: 00:07:58.170 16:32:23 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@21 -- # val= 00:07:59.543 16:32:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # IFS=: 00:07:59.543 16:32:24 -- accel/accel.sh@20 -- # read -r var val 00:07:59.543 16:32:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:59.543 16:32:24 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:59.543 16:32:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:59.543 00:07:59.543 real 0m2.787s 00:07:59.543 user 0m2.487s 00:07:59.543 sys 0m0.290s 00:07:59.543 16:32:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:59.543 16:32:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.543 ************************************ 00:07:59.543 END TEST accel_dualcast 00:07:59.543 ************************************ 00:07:59.543 16:32:24 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:59.543 16:32:24 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:59.543 16:32:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:59.543 16:32:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.543 ************************************ 00:07:59.543 START TEST accel_compare 00:07:59.543 ************************************ 00:07:59.543 16:32:24 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:07:59.543 16:32:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:59.543 16:32:24 -- accel/accel.sh@17 -- # local accel_module 00:07:59.543 16:32:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:59.543 16:32:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:59.543 16:32:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:59.543 16:32:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:59.543 16:32:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:59.543 16:32:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:59.543 16:32:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:59.543 16:32:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:59.543 16:32:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:59.543 16:32:24 -- accel/accel.sh@42 -- # jq -r . 00:07:59.544 [2024-10-13 16:32:24.785324] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:07:59.544 [2024-10-13 16:32:24.785415] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088849 ] 00:07:59.544 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.544 [2024-10-13 16:32:24.844864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:59.544 [2024-10-13 16:32:24.937307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.916 16:32:26 -- accel/accel.sh@18 -- # out=' 00:08:00.916 SPDK Configuration: 00:08:00.916 Core mask: 0x1 00:08:00.916 00:08:00.916 Accel Perf Configuration: 00:08:00.916 Workload Type: compare 00:08:00.916 Transfer size: 4096 bytes 00:08:00.916 Vector count 1 00:08:00.916 Module: software 00:08:00.916 Queue depth: 32 00:08:00.916 Allocate depth: 32 00:08:00.916 # threads/core: 1 00:08:00.916 Run time: 1 seconds 00:08:00.916 Verify: Yes 00:08:00.916 00:08:00.916 Running for 1 seconds... 00:08:00.916 00:08:00.917 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:00.917 ------------------------------------------------------------------------------------ 00:08:00.917 0,0 400768/s 1565 MiB/s 0 0 00:08:00.917 ==================================================================================== 00:08:00.917 Total 400768/s 1565 MiB/s 0 0' 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:08:00.917 16:32:26 -- accel/accel.sh@12 -- # build_accel_config 00:08:00.917 16:32:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:00.917 16:32:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:00.917 16:32:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:00.917 16:32:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:00.917 16:32:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:00.917 16:32:26 -- accel/accel.sh@41 -- # local IFS=, 00:08:00.917 16:32:26 -- accel/accel.sh@42 -- # jq -r . 00:08:00.917 [2024-10-13 16:32:26.169850] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:00.917 [2024-10-13 16:32:26.169946] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088998 ] 00:08:00.917 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.917 [2024-10-13 16:32:26.232098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:00.917 [2024-10-13 16:32:26.322184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=0x1 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=compare 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@24 -- # accel_opc=compare 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=software 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@23 -- # accel_module=software 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=32 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=32 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=1 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val=Yes 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:00.917 16:32:26 -- accel/accel.sh@21 -- # val= 00:08:00.917 16:32:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # IFS=: 00:08:00.917 16:32:26 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@21 -- # val= 00:08:02.290 16:32:27 -- accel/accel.sh@22 -- # case "$var" in 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # IFS=: 00:08:02.290 16:32:27 -- accel/accel.sh@20 -- # read -r var val 00:08:02.290 16:32:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:02.290 16:32:27 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:08:02.290 16:32:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:02.290 00:08:02.290 real 0m2.792s 00:08:02.290 user 0m2.501s 00:08:02.290 sys 0m0.281s 00:08:02.290 16:32:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:02.290 16:32:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.290 ************************************ 00:08:02.290 END TEST accel_compare 00:08:02.290 ************************************ 00:08:02.290 16:32:27 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:08:02.290 16:32:27 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:08:02.290 16:32:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:02.290 16:32:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.290 ************************************ 00:08:02.290 START TEST accel_xor 00:08:02.291 ************************************ 00:08:02.291 16:32:27 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:08:02.291 16:32:27 -- accel/accel.sh@16 -- # local accel_opc 00:08:02.291 16:32:27 -- accel/accel.sh@17 -- # local accel_module 00:08:02.291 16:32:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:08:02.291 16:32:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:08:02.291 16:32:27 -- accel/accel.sh@12 -- # build_accel_config 00:08:02.291 16:32:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:02.291 16:32:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:02.291 16:32:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:02.291 16:32:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:02.291 16:32:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:02.291 16:32:27 -- accel/accel.sh@41 -- # local IFS=, 00:08:02.291 16:32:27 -- accel/accel.sh@42 -- # jq -r . 00:08:02.291 [2024-10-13 16:32:27.599269] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:02.291 [2024-10-13 16:32:27.599356] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089152 ] 00:08:02.291 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.291 [2024-10-13 16:32:27.661007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:02.291 [2024-10-13 16:32:27.751510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.663 16:32:28 -- accel/accel.sh@18 -- # out=' 00:08:03.663 SPDK Configuration: 00:08:03.663 Core mask: 0x1 00:08:03.663 00:08:03.663 Accel Perf Configuration: 00:08:03.663 Workload Type: xor 00:08:03.663 Source buffers: 2 00:08:03.663 Transfer size: 4096 bytes 00:08:03.663 Vector count 1 00:08:03.663 Module: software 00:08:03.663 Queue depth: 32 00:08:03.663 Allocate depth: 32 00:08:03.663 # threads/core: 1 00:08:03.663 Run time: 1 seconds 00:08:03.663 Verify: Yes 00:08:03.663 00:08:03.663 Running for 1 seconds... 00:08:03.663 00:08:03.663 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:03.663 ------------------------------------------------------------------------------------ 00:08:03.663 0,0 191072/s 746 MiB/s 0 0 00:08:03.663 ==================================================================================== 00:08:03.663 Total 191072/s 746 MiB/s 0 0' 00:08:03.663 16:32:28 -- accel/accel.sh@20 -- # IFS=: 00:08:03.663 16:32:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:08:03.663 16:32:28 -- accel/accel.sh@20 -- # read -r var val 00:08:03.663 16:32:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:08:03.663 16:32:28 -- accel/accel.sh@12 -- # build_accel_config 00:08:03.663 16:32:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:03.663 16:32:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:03.663 16:32:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:03.663 16:32:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:03.663 16:32:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:03.663 16:32:28 -- accel/accel.sh@41 -- # local IFS=, 00:08:03.663 16:32:28 -- accel/accel.sh@42 -- # jq -r . 00:08:03.663 [2024-10-13 16:32:29.006135] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:03.663 [2024-10-13 16:32:29.006222] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089296 ] 00:08:03.663 EAL: No free 2048 kB hugepages reported on node 1 00:08:03.663 [2024-10-13 16:32:29.066890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:03.663 [2024-10-13 16:32:29.156882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.921 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.921 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.921 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.921 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.921 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.921 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=0x1 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=xor 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@24 -- # accel_opc=xor 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=2 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=software 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@23 -- # accel_module=software 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=32 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=32 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=1 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val=Yes 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:03.922 16:32:29 -- accel/accel.sh@21 -- # val= 00:08:03.922 16:32:29 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # IFS=: 00:08:03.922 16:32:29 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@21 -- # val= 00:08:05.294 16:32:30 -- accel/accel.sh@22 -- # case "$var" in 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # IFS=: 00:08:05.294 16:32:30 -- accel/accel.sh@20 -- # read -r var val 00:08:05.294 16:32:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:05.294 16:32:30 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:08:05.294 16:32:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:05.294 00:08:05.294 real 0m2.802s 00:08:05.294 user 0m2.499s 00:08:05.294 sys 0m0.292s 00:08:05.294 16:32:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:05.294 16:32:30 -- common/autotest_common.sh@10 -- # set +x 00:08:05.294 ************************************ 00:08:05.294 END TEST accel_xor 00:08:05.295 ************************************ 00:08:05.295 16:32:30 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:08:05.295 16:32:30 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:08:05.295 16:32:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:05.295 16:32:30 -- common/autotest_common.sh@10 -- # set +x 00:08:05.295 ************************************ 00:08:05.295 START TEST accel_xor 00:08:05.295 ************************************ 00:08:05.295 16:32:30 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:08:05.295 16:32:30 -- accel/accel.sh@16 -- # local accel_opc 00:08:05.295 16:32:30 -- accel/accel.sh@17 -- # local accel_module 00:08:05.295 16:32:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:08:05.295 16:32:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:08:05.295 16:32:30 -- accel/accel.sh@12 -- # build_accel_config 00:08:05.295 16:32:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:05.295 16:32:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:05.295 16:32:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:05.295 16:32:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:05.295 16:32:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:05.295 16:32:30 -- accel/accel.sh@41 -- # local IFS=, 00:08:05.295 16:32:30 -- accel/accel.sh@42 -- # jq -r . 00:08:05.295 [2024-10-13 16:32:30.425334] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:05.295 [2024-10-13 16:32:30.425428] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089570 ] 00:08:05.295 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.295 [2024-10-13 16:32:30.487842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.295 [2024-10-13 16:32:30.577715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:06.667 16:32:31 -- accel/accel.sh@18 -- # out=' 00:08:06.667 SPDK Configuration: 00:08:06.667 Core mask: 0x1 00:08:06.667 00:08:06.667 Accel Perf Configuration: 00:08:06.667 Workload Type: xor 00:08:06.667 Source buffers: 3 00:08:06.667 Transfer size: 4096 bytes 00:08:06.667 Vector count 1 00:08:06.667 Module: software 00:08:06.667 Queue depth: 32 00:08:06.667 Allocate depth: 32 00:08:06.667 # threads/core: 1 00:08:06.667 Run time: 1 seconds 00:08:06.667 Verify: Yes 00:08:06.667 00:08:06.667 Running for 1 seconds... 00:08:06.667 00:08:06.667 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:06.667 ------------------------------------------------------------------------------------ 00:08:06.667 0,0 183744/s 717 MiB/s 0 0 00:08:06.667 ==================================================================================== 00:08:06.667 Total 183744/s 717 MiB/s 0 0' 00:08:06.667 16:32:31 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:08:06.667 16:32:31 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:08:06.667 16:32:31 -- accel/accel.sh@12 -- # build_accel_config 00:08:06.667 16:32:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:06.667 16:32:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:06.667 16:32:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:06.667 16:32:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:06.667 16:32:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:06.667 16:32:31 -- accel/accel.sh@41 -- # local IFS=, 00:08:06.667 16:32:31 -- accel/accel.sh@42 -- # jq -r . 00:08:06.667 [2024-10-13 16:32:31.820592] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:06.667 [2024-10-13 16:32:31.820669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089716 ] 00:08:06.667 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.667 [2024-10-13 16:32:31.883075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:06.667 [2024-10-13 16:32:31.970873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=0x1 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=xor 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@24 -- # accel_opc=xor 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=3 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=software 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@23 -- # accel_module=software 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=32 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=32 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=1 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:06.667 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.667 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.667 16:32:32 -- accel/accel.sh@21 -- # val=Yes 00:08:06.668 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.668 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.668 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:06.668 16:32:32 -- accel/accel.sh@21 -- # val= 00:08:06.668 16:32:32 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # IFS=: 00:08:06.668 16:32:32 -- accel/accel.sh@20 -- # read -r var val 00:08:08.040 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@21 -- # val= 00:08:08.041 16:32:33 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # IFS=: 00:08:08.041 16:32:33 -- accel/accel.sh@20 -- # read -r var val 00:08:08.041 16:32:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:08.041 16:32:33 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:08:08.041 16:32:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:08.041 00:08:08.041 real 0m2.795s 00:08:08.041 user 0m2.500s 00:08:08.041 sys 0m0.283s 00:08:08.041 16:32:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:08.041 16:32:33 -- common/autotest_common.sh@10 -- # set +x 00:08:08.041 ************************************ 00:08:08.041 END TEST accel_xor 00:08:08.041 ************************************ 00:08:08.041 16:32:33 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:08:08.041 16:32:33 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:08:08.041 16:32:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:08.041 16:32:33 -- common/autotest_common.sh@10 -- # set +x 00:08:08.041 ************************************ 00:08:08.041 START TEST accel_dif_verify 00:08:08.041 ************************************ 00:08:08.041 16:32:33 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:08:08.041 16:32:33 -- accel/accel.sh@16 -- # local accel_opc 00:08:08.041 16:32:33 -- accel/accel.sh@17 -- # local accel_module 00:08:08.041 16:32:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:08:08.041 16:32:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:08:08.041 16:32:33 -- accel/accel.sh@12 -- # build_accel_config 00:08:08.041 16:32:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:08.041 16:32:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:08.041 16:32:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:08.041 16:32:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:08.041 16:32:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:08.041 16:32:33 -- accel/accel.sh@41 -- # local IFS=, 00:08:08.041 16:32:33 -- accel/accel.sh@42 -- # jq -r . 00:08:08.041 [2024-10-13 16:32:33.242495] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:08.041 [2024-10-13 16:32:33.242576] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089879 ] 00:08:08.041 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.041 [2024-10-13 16:32:33.303466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:08.041 [2024-10-13 16:32:33.394202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:09.413 16:32:34 -- accel/accel.sh@18 -- # out=' 00:08:09.413 SPDK Configuration: 00:08:09.413 Core mask: 0x1 00:08:09.413 00:08:09.413 Accel Perf Configuration: 00:08:09.413 Workload Type: dif_verify 00:08:09.413 Vector size: 4096 bytes 00:08:09.413 Transfer size: 4096 bytes 00:08:09.413 Block size: 512 bytes 00:08:09.413 Metadata size: 8 bytes 00:08:09.413 Vector count 1 00:08:09.413 Module: software 00:08:09.413 Queue depth: 32 00:08:09.413 Allocate depth: 32 00:08:09.413 # threads/core: 1 00:08:09.413 Run time: 1 seconds 00:08:09.413 Verify: No 00:08:09.413 00:08:09.413 Running for 1 seconds... 00:08:09.413 00:08:09.413 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:09.413 ------------------------------------------------------------------------------------ 00:08:09.413 0,0 81792/s 324 MiB/s 0 0 00:08:09.413 ==================================================================================== 00:08:09.413 Total 81792/s 319 MiB/s 0 0' 00:08:09.413 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.413 16:32:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:08:09.413 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:08:09.414 16:32:34 -- accel/accel.sh@12 -- # build_accel_config 00:08:09.414 16:32:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:09.414 16:32:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:09.414 16:32:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:09.414 16:32:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:09.414 16:32:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:09.414 16:32:34 -- accel/accel.sh@41 -- # local IFS=, 00:08:09.414 16:32:34 -- accel/accel.sh@42 -- # jq -r . 00:08:09.414 [2024-10-13 16:32:34.650077] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:09.414 [2024-10-13 16:32:34.650162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090017 ] 00:08:09.414 EAL: No free 2048 kB hugepages reported on node 1 00:08:09.414 [2024-10-13 16:32:34.711032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:09.414 [2024-10-13 16:32:34.801402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=0x1 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=dif_verify 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val='512 bytes' 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val='8 bytes' 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=software 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@23 -- # accel_module=software 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=32 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=32 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=1 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val=No 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:09.414 16:32:34 -- accel/accel.sh@21 -- # val= 00:08:09.414 16:32:34 -- accel/accel.sh@22 -- # case "$var" in 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # IFS=: 00:08:09.414 16:32:34 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@21 -- # val= 00:08:10.865 16:32:36 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # IFS=: 00:08:10.865 16:32:36 -- accel/accel.sh@20 -- # read -r var val 00:08:10.865 16:32:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:10.865 16:32:36 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:08:10.865 16:32:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:10.865 00:08:10.865 real 0m2.809s 00:08:10.865 user 0m2.507s 00:08:10.865 sys 0m0.294s 00:08:10.865 16:32:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:10.865 16:32:36 -- common/autotest_common.sh@10 -- # set +x 00:08:10.865 ************************************ 00:08:10.865 END TEST accel_dif_verify 00:08:10.865 ************************************ 00:08:10.865 16:32:36 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:08:10.865 16:32:36 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:08:10.865 16:32:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:10.865 16:32:36 -- common/autotest_common.sh@10 -- # set +x 00:08:10.865 ************************************ 00:08:10.865 START TEST accel_dif_generate 00:08:10.865 ************************************ 00:08:10.865 16:32:36 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:08:10.865 16:32:36 -- accel/accel.sh@16 -- # local accel_opc 00:08:10.865 16:32:36 -- accel/accel.sh@17 -- # local accel_module 00:08:10.865 16:32:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:08:10.865 16:32:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:08:10.865 16:32:36 -- accel/accel.sh@12 -- # build_accel_config 00:08:10.865 16:32:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:10.865 16:32:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:10.865 16:32:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:10.865 16:32:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:10.865 16:32:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:10.865 16:32:36 -- accel/accel.sh@41 -- # local IFS=, 00:08:10.865 16:32:36 -- accel/accel.sh@42 -- # jq -r . 00:08:10.865 [2024-10-13 16:32:36.076450] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:10.865 [2024-10-13 16:32:36.076539] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090289 ] 00:08:10.865 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.865 [2024-10-13 16:32:36.137266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:10.865 [2024-10-13 16:32:36.228142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:12.239 16:32:37 -- accel/accel.sh@18 -- # out=' 00:08:12.239 SPDK Configuration: 00:08:12.239 Core mask: 0x1 00:08:12.239 00:08:12.239 Accel Perf Configuration: 00:08:12.239 Workload Type: dif_generate 00:08:12.239 Vector size: 4096 bytes 00:08:12.239 Transfer size: 4096 bytes 00:08:12.239 Block size: 512 bytes 00:08:12.239 Metadata size: 8 bytes 00:08:12.239 Vector count 1 00:08:12.239 Module: software 00:08:12.239 Queue depth: 32 00:08:12.239 Allocate depth: 32 00:08:12.239 # threads/core: 1 00:08:12.239 Run time: 1 seconds 00:08:12.239 Verify: No 00:08:12.239 00:08:12.239 Running for 1 seconds... 00:08:12.239 00:08:12.239 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:12.239 ------------------------------------------------------------------------------------ 00:08:12.239 0,0 95392/s 378 MiB/s 0 0 00:08:12.239 ==================================================================================== 00:08:12.239 Total 95392/s 372 MiB/s 0 0' 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:08:12.239 16:32:37 -- accel/accel.sh@12 -- # build_accel_config 00:08:12.239 16:32:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:12.239 16:32:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:12.239 16:32:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:12.239 16:32:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:12.239 16:32:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:12.239 16:32:37 -- accel/accel.sh@41 -- # local IFS=, 00:08:12.239 16:32:37 -- accel/accel.sh@42 -- # jq -r . 00:08:12.239 [2024-10-13 16:32:37.476089] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:12.239 [2024-10-13 16:32:37.476176] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090442 ] 00:08:12.239 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.239 [2024-10-13 16:32:37.536740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:12.239 [2024-10-13 16:32:37.625149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val=0x1 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val=dif_generate 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.239 16:32:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:12.239 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.239 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val='512 bytes' 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val='8 bytes' 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val=software 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@23 -- # accel_module=software 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val=32 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val=32 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val=1 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val=No 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:12.240 16:32:37 -- accel/accel.sh@21 -- # val= 00:08:12.240 16:32:37 -- accel/accel.sh@22 -- # case "$var" in 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # IFS=: 00:08:12.240 16:32:37 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@21 -- # val= 00:08:13.613 16:32:38 -- accel/accel.sh@22 -- # case "$var" in 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # IFS=: 00:08:13.613 16:32:38 -- accel/accel.sh@20 -- # read -r var val 00:08:13.613 16:32:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:13.613 16:32:38 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:08:13.613 16:32:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:13.613 00:08:13.613 real 0m2.781s 00:08:13.613 user 0m2.493s 00:08:13.613 sys 0m0.281s 00:08:13.613 16:32:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:13.613 16:32:38 -- common/autotest_common.sh@10 -- # set +x 00:08:13.613 ************************************ 00:08:13.613 END TEST accel_dif_generate 00:08:13.613 ************************************ 00:08:13.613 16:32:38 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:08:13.613 16:32:38 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:08:13.613 16:32:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:13.613 16:32:38 -- common/autotest_common.sh@10 -- # set +x 00:08:13.613 ************************************ 00:08:13.613 START TEST accel_dif_generate_copy 00:08:13.613 ************************************ 00:08:13.613 16:32:38 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:08:13.613 16:32:38 -- accel/accel.sh@16 -- # local accel_opc 00:08:13.613 16:32:38 -- accel/accel.sh@17 -- # local accel_module 00:08:13.613 16:32:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:08:13.613 16:32:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:08:13.613 16:32:38 -- accel/accel.sh@12 -- # build_accel_config 00:08:13.613 16:32:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:13.613 16:32:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:13.613 16:32:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:13.613 16:32:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:13.613 16:32:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:13.613 16:32:38 -- accel/accel.sh@41 -- # local IFS=, 00:08:13.613 16:32:38 -- accel/accel.sh@42 -- # jq -r . 00:08:13.613 [2024-10-13 16:32:38.881871] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:13.613 [2024-10-13 16:32:38.881957] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090605 ] 00:08:13.613 EAL: No free 2048 kB hugepages reported on node 1 00:08:13.613 [2024-10-13 16:32:38.942141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:13.613 [2024-10-13 16:32:39.033428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:14.988 16:32:40 -- accel/accel.sh@18 -- # out=' 00:08:14.988 SPDK Configuration: 00:08:14.988 Core mask: 0x1 00:08:14.988 00:08:14.988 Accel Perf Configuration: 00:08:14.988 Workload Type: dif_generate_copy 00:08:14.988 Vector size: 4096 bytes 00:08:14.988 Transfer size: 4096 bytes 00:08:14.988 Vector count 1 00:08:14.988 Module: software 00:08:14.988 Queue depth: 32 00:08:14.988 Allocate depth: 32 00:08:14.988 # threads/core: 1 00:08:14.988 Run time: 1 seconds 00:08:14.988 Verify: No 00:08:14.988 00:08:14.988 Running for 1 seconds... 00:08:14.988 00:08:14.988 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:14.988 ------------------------------------------------------------------------------------ 00:08:14.988 0,0 76192/s 302 MiB/s 0 0 00:08:14.988 ==================================================================================== 00:08:14.988 Total 76192/s 297 MiB/s 0 0' 00:08:14.988 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:14.988 16:32:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:08:14.988 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:14.988 16:32:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:08:14.988 16:32:40 -- accel/accel.sh@12 -- # build_accel_config 00:08:14.988 16:32:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:14.988 16:32:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:14.988 16:32:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:14.988 16:32:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:14.988 16:32:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:14.988 16:32:40 -- accel/accel.sh@41 -- # local IFS=, 00:08:14.988 16:32:40 -- accel/accel.sh@42 -- # jq -r . 00:08:14.988 [2024-10-13 16:32:40.286316] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:14.988 [2024-10-13 16:32:40.286523] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090749 ] 00:08:14.988 EAL: No free 2048 kB hugepages reported on node 1 00:08:14.988 [2024-10-13 16:32:40.347286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:14.988 [2024-10-13 16:32:40.437402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.246 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.246 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val=0x1 00:08:15.246 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.246 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.246 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.246 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.246 16:32:40 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val=software 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@23 -- # accel_module=software 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val=32 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val=32 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val=1 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val=No 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:15.247 16:32:40 -- accel/accel.sh@21 -- # val= 00:08:15.247 16:32:40 -- accel/accel.sh@22 -- # case "$var" in 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # IFS=: 00:08:15.247 16:32:40 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@21 -- # val= 00:08:16.180 16:32:41 -- accel/accel.sh@22 -- # case "$var" in 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # IFS=: 00:08:16.180 16:32:41 -- accel/accel.sh@20 -- # read -r var val 00:08:16.180 16:32:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:16.180 16:32:41 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:08:16.180 16:32:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:16.180 00:08:16.180 real 0m2.804s 00:08:16.180 user 0m2.511s 00:08:16.180 sys 0m0.284s 00:08:16.180 16:32:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:16.180 16:32:41 -- common/autotest_common.sh@10 -- # set +x 00:08:16.180 ************************************ 00:08:16.180 END TEST accel_dif_generate_copy 00:08:16.180 ************************************ 00:08:16.438 16:32:41 -- accel/accel.sh@107 -- # [[ y == y ]] 00:08:16.438 16:32:41 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:16.438 16:32:41 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:08:16.438 16:32:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:16.438 16:32:41 -- common/autotest_common.sh@10 -- # set +x 00:08:16.438 ************************************ 00:08:16.438 START TEST accel_comp 00:08:16.438 ************************************ 00:08:16.438 16:32:41 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:16.438 16:32:41 -- accel/accel.sh@16 -- # local accel_opc 00:08:16.438 16:32:41 -- accel/accel.sh@17 -- # local accel_module 00:08:16.438 16:32:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:16.438 16:32:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:16.438 16:32:41 -- accel/accel.sh@12 -- # build_accel_config 00:08:16.438 16:32:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:16.438 16:32:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:16.438 16:32:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:16.438 16:32:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:16.438 16:32:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:16.438 16:32:41 -- accel/accel.sh@41 -- # local IFS=, 00:08:16.438 16:32:41 -- accel/accel.sh@42 -- # jq -r . 00:08:16.438 [2024-10-13 16:32:41.710616] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:16.438 [2024-10-13 16:32:41.710693] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090953 ] 00:08:16.438 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.438 [2024-10-13 16:32:41.770484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:16.438 [2024-10-13 16:32:41.861330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:17.811 16:32:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:17.811 00:08:17.811 SPDK Configuration: 00:08:17.811 Core mask: 0x1 00:08:17.811 00:08:17.811 Accel Perf Configuration: 00:08:17.811 Workload Type: compress 00:08:17.811 Transfer size: 4096 bytes 00:08:17.811 Vector count 1 00:08:17.811 Module: software 00:08:17.811 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:17.811 Queue depth: 32 00:08:17.811 Allocate depth: 32 00:08:17.811 # threads/core: 1 00:08:17.811 Run time: 1 seconds 00:08:17.811 Verify: No 00:08:17.811 00:08:17.811 Running for 1 seconds... 00:08:17.811 00:08:17.811 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:17.811 ------------------------------------------------------------------------------------ 00:08:17.811 0,0 31456/s 131 MiB/s 0 0 00:08:17.811 ==================================================================================== 00:08:17.811 Total 31456/s 122 MiB/s 0 0' 00:08:17.811 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:17.811 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:17.811 16:32:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:17.811 16:32:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:17.811 16:32:43 -- accel/accel.sh@12 -- # build_accel_config 00:08:17.811 16:32:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:17.811 16:32:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:17.811 16:32:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:17.811 16:32:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:17.811 16:32:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:17.811 16:32:43 -- accel/accel.sh@41 -- # local IFS=, 00:08:17.811 16:32:43 -- accel/accel.sh@42 -- # jq -r . 00:08:17.811 [2024-10-13 16:32:43.121699] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:17.811 [2024-10-13 16:32:43.121789] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091167 ] 00:08:17.811 EAL: No free 2048 kB hugepages reported on node 1 00:08:17.811 [2024-10-13 16:32:43.185053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:17.811 [2024-10-13 16:32:43.271485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=0x1 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=compress 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@24 -- # accel_opc=compress 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=software 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@23 -- # accel_module=software 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=32 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=32 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=1 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val=No 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:18.069 16:32:43 -- accel/accel.sh@21 -- # val= 00:08:18.069 16:32:43 -- accel/accel.sh@22 -- # case "$var" in 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # IFS=: 00:08:18.069 16:32:43 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@21 -- # val= 00:08:19.002 16:32:44 -- accel/accel.sh@22 -- # case "$var" in 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # IFS=: 00:08:19.002 16:32:44 -- accel/accel.sh@20 -- # read -r var val 00:08:19.002 16:32:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:19.002 16:32:44 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:08:19.002 16:32:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:19.002 00:08:19.002 real 0m2.807s 00:08:19.002 user 0m2.506s 00:08:19.002 sys 0m0.291s 00:08:19.002 16:32:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:19.002 16:32:44 -- common/autotest_common.sh@10 -- # set +x 00:08:19.002 ************************************ 00:08:19.002 END TEST accel_comp 00:08:19.002 ************************************ 00:08:19.260 16:32:44 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:19.260 16:32:44 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:08:19.260 16:32:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:19.260 16:32:44 -- common/autotest_common.sh@10 -- # set +x 00:08:19.260 ************************************ 00:08:19.260 START TEST accel_decomp 00:08:19.260 ************************************ 00:08:19.260 16:32:44 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:19.260 16:32:44 -- accel/accel.sh@16 -- # local accel_opc 00:08:19.260 16:32:44 -- accel/accel.sh@17 -- # local accel_module 00:08:19.260 16:32:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:19.260 16:32:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:19.260 16:32:44 -- accel/accel.sh@12 -- # build_accel_config 00:08:19.260 16:32:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:19.260 16:32:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:19.260 16:32:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:19.260 16:32:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:19.260 16:32:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:19.260 16:32:44 -- accel/accel.sh@41 -- # local IFS=, 00:08:19.260 16:32:44 -- accel/accel.sh@42 -- # jq -r . 00:08:19.260 [2024-10-13 16:32:44.540598] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:19.260 [2024-10-13 16:32:44.540685] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091331 ] 00:08:19.260 EAL: No free 2048 kB hugepages reported on node 1 00:08:19.260 [2024-10-13 16:32:44.603969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:19.260 [2024-10-13 16:32:44.694434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:20.634 16:32:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:20.634 00:08:20.634 SPDK Configuration: 00:08:20.634 Core mask: 0x1 00:08:20.634 00:08:20.634 Accel Perf Configuration: 00:08:20.634 Workload Type: decompress 00:08:20.634 Transfer size: 4096 bytes 00:08:20.634 Vector count 1 00:08:20.634 Module: software 00:08:20.634 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:20.634 Queue depth: 32 00:08:20.634 Allocate depth: 32 00:08:20.634 # threads/core: 1 00:08:20.635 Run time: 1 seconds 00:08:20.635 Verify: Yes 00:08:20.635 00:08:20.635 Running for 1 seconds... 00:08:20.635 00:08:20.635 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:20.635 ------------------------------------------------------------------------------------ 00:08:20.635 0,0 55296/s 101 MiB/s 0 0 00:08:20.635 ==================================================================================== 00:08:20.635 Total 55296/s 216 MiB/s 0 0' 00:08:20.635 16:32:45 -- accel/accel.sh@20 -- # IFS=: 00:08:20.635 16:32:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:20.635 16:32:45 -- accel/accel.sh@20 -- # read -r var val 00:08:20.635 16:32:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:08:20.635 16:32:45 -- accel/accel.sh@12 -- # build_accel_config 00:08:20.635 16:32:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:20.635 16:32:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:20.635 16:32:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:20.635 16:32:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:20.635 16:32:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:20.635 16:32:45 -- accel/accel.sh@41 -- # local IFS=, 00:08:20.635 16:32:45 -- accel/accel.sh@42 -- # jq -r . 00:08:20.635 [2024-10-13 16:32:45.946783] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:20.635 [2024-10-13 16:32:45.946870] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091470 ] 00:08:20.635 EAL: No free 2048 kB hugepages reported on node 1 00:08:20.635 [2024-10-13 16:32:46.007773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:20.635 [2024-10-13 16:32:46.097506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=0x1 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=decompress 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=software 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@23 -- # accel_module=software 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=32 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=32 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=1 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val=Yes 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:20.893 16:32:46 -- accel/accel.sh@21 -- # val= 00:08:20.893 16:32:46 -- accel/accel.sh@22 -- # case "$var" in 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # IFS=: 00:08:20.893 16:32:46 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@21 -- # val= 00:08:22.266 16:32:47 -- accel/accel.sh@22 -- # case "$var" in 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # IFS=: 00:08:22.266 16:32:47 -- accel/accel.sh@20 -- # read -r var val 00:08:22.266 16:32:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:22.266 16:32:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:22.266 16:32:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:22.266 00:08:22.266 real 0m2.812s 00:08:22.266 user 0m2.506s 00:08:22.266 sys 0m0.295s 00:08:22.266 16:32:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:22.266 16:32:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.266 ************************************ 00:08:22.266 END TEST accel_decomp 00:08:22.266 ************************************ 00:08:22.266 16:32:47 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:22.266 16:32:47 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:08:22.266 16:32:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:22.266 16:32:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.266 ************************************ 00:08:22.266 START TEST accel_decmop_full 00:08:22.266 ************************************ 00:08:22.267 16:32:47 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:22.267 16:32:47 -- accel/accel.sh@16 -- # local accel_opc 00:08:22.267 16:32:47 -- accel/accel.sh@17 -- # local accel_module 00:08:22.267 16:32:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:22.267 16:32:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:22.267 16:32:47 -- accel/accel.sh@12 -- # build_accel_config 00:08:22.267 16:32:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:22.267 16:32:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:22.267 16:32:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:22.267 16:32:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:22.267 16:32:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:22.267 16:32:47 -- accel/accel.sh@41 -- # local IFS=, 00:08:22.267 16:32:47 -- accel/accel.sh@42 -- # jq -r . 00:08:22.267 [2024-10-13 16:32:47.376363] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:22.267 [2024-10-13 16:32:47.376496] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091675 ] 00:08:22.267 EAL: No free 2048 kB hugepages reported on node 1 00:08:22.267 [2024-10-13 16:32:47.436569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:22.267 [2024-10-13 16:32:47.527083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:23.639 16:32:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:23.639 00:08:23.639 SPDK Configuration: 00:08:23.639 Core mask: 0x1 00:08:23.639 00:08:23.639 Accel Perf Configuration: 00:08:23.639 Workload Type: decompress 00:08:23.639 Transfer size: 111250 bytes 00:08:23.639 Vector count 1 00:08:23.639 Module: software 00:08:23.639 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:23.639 Queue depth: 32 00:08:23.639 Allocate depth: 32 00:08:23.639 # threads/core: 1 00:08:23.639 Run time: 1 seconds 00:08:23.639 Verify: Yes 00:08:23.639 00:08:23.639 Running for 1 seconds... 00:08:23.639 00:08:23.639 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:23.639 ------------------------------------------------------------------------------------ 00:08:23.639 0,0 3808/s 157 MiB/s 0 0 00:08:23.639 ==================================================================================== 00:08:23.639 Total 3808/s 404 MiB/s 0 0' 00:08:23.639 16:32:48 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:23.639 16:32:48 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:23.639 16:32:48 -- accel/accel.sh@12 -- # build_accel_config 00:08:23.639 16:32:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:23.639 16:32:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:23.639 16:32:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:23.639 16:32:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:23.639 16:32:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:23.639 16:32:48 -- accel/accel.sh@41 -- # local IFS=, 00:08:23.639 16:32:48 -- accel/accel.sh@42 -- # jq -r . 00:08:23.639 [2024-10-13 16:32:48.797062] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:23.639 [2024-10-13 16:32:48.797143] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091888 ] 00:08:23.639 EAL: No free 2048 kB hugepages reported on node 1 00:08:23.639 [2024-10-13 16:32:48.858811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:23.639 [2024-10-13 16:32:48.948735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=0x1 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=decompress 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=software 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@23 -- # accel_module=software 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=32 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=32 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=1 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val=Yes 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:23.639 16:32:49 -- accel/accel.sh@21 -- # val= 00:08:23.639 16:32:49 -- accel/accel.sh@22 -- # case "$var" in 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # IFS=: 00:08:23.639 16:32:49 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@21 -- # val= 00:08:25.010 16:32:50 -- accel/accel.sh@22 -- # case "$var" in 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # IFS=: 00:08:25.010 16:32:50 -- accel/accel.sh@20 -- # read -r var val 00:08:25.010 16:32:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:25.010 16:32:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:25.010 16:32:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:25.010 00:08:25.010 real 0m2.827s 00:08:25.010 user 0m2.531s 00:08:25.010 sys 0m0.285s 00:08:25.010 16:32:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:25.010 16:32:50 -- common/autotest_common.sh@10 -- # set +x 00:08:25.010 ************************************ 00:08:25.010 END TEST accel_decmop_full 00:08:25.010 ************************************ 00:08:25.010 16:32:50 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:25.010 16:32:50 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:08:25.010 16:32:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:25.010 16:32:50 -- common/autotest_common.sh@10 -- # set +x 00:08:25.010 ************************************ 00:08:25.010 START TEST accel_decomp_mcore 00:08:25.010 ************************************ 00:08:25.010 16:32:50 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:25.010 16:32:50 -- accel/accel.sh@16 -- # local accel_opc 00:08:25.010 16:32:50 -- accel/accel.sh@17 -- # local accel_module 00:08:25.010 16:32:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:25.010 16:32:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:25.010 16:32:50 -- accel/accel.sh@12 -- # build_accel_config 00:08:25.010 16:32:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:25.010 16:32:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:25.010 16:32:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:25.010 16:32:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:25.010 16:32:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:25.010 16:32:50 -- accel/accel.sh@41 -- # local IFS=, 00:08:25.010 16:32:50 -- accel/accel.sh@42 -- # jq -r . 00:08:25.010 [2024-10-13 16:32:50.225557] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:25.010 [2024-10-13 16:32:50.225636] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092053 ] 00:08:25.010 EAL: No free 2048 kB hugepages reported on node 1 00:08:25.010 [2024-10-13 16:32:50.286076] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:25.010 [2024-10-13 16:32:50.386041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:25.010 [2024-10-13 16:32:50.386101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:25.010 [2024-10-13 16:32:50.386166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:25.010 [2024-10-13 16:32:50.386168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:26.381 16:32:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:26.381 00:08:26.381 SPDK Configuration: 00:08:26.381 Core mask: 0xf 00:08:26.381 00:08:26.381 Accel Perf Configuration: 00:08:26.381 Workload Type: decompress 00:08:26.381 Transfer size: 4096 bytes 00:08:26.381 Vector count 1 00:08:26.381 Module: software 00:08:26.381 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:26.381 Queue depth: 32 00:08:26.381 Allocate depth: 32 00:08:26.381 # threads/core: 1 00:08:26.381 Run time: 1 seconds 00:08:26.381 Verify: Yes 00:08:26.381 00:08:26.381 Running for 1 seconds... 00:08:26.381 00:08:26.381 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:26.381 ------------------------------------------------------------------------------------ 00:08:26.381 0,0 56768/s 104 MiB/s 0 0 00:08:26.382 3,0 57600/s 106 MiB/s 0 0 00:08:26.382 2,0 57568/s 106 MiB/s 0 0 00:08:26.382 1,0 57440/s 105 MiB/s 0 0 00:08:26.382 ==================================================================================== 00:08:26.382 Total 229376/s 896 MiB/s 0 0' 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:26.382 16:32:51 -- accel/accel.sh@12 -- # build_accel_config 00:08:26.382 16:32:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:26.382 16:32:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:26.382 16:32:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:26.382 16:32:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:26.382 16:32:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:26.382 16:32:51 -- accel/accel.sh@41 -- # local IFS=, 00:08:26.382 16:32:51 -- accel/accel.sh@42 -- # jq -r . 00:08:26.382 [2024-10-13 16:32:51.635534] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:26.382 [2024-10-13 16:32:51.635615] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092200 ] 00:08:26.382 EAL: No free 2048 kB hugepages reported on node 1 00:08:26.382 [2024-10-13 16:32:51.696405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:26.382 [2024-10-13 16:32:51.789726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:26.382 [2024-10-13 16:32:51.789778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:26.382 [2024-10-13 16:32:51.789897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:26.382 [2024-10-13 16:32:51.789895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=0xf 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=decompress 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=software 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@23 -- # accel_module=software 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=32 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=32 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=1 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val=Yes 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:26.382 16:32:51 -- accel/accel.sh@21 -- # val= 00:08:26.382 16:32:51 -- accel/accel.sh@22 -- # case "$var" in 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # IFS=: 00:08:26.382 16:32:51 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@21 -- # val= 00:08:27.756 16:32:53 -- accel/accel.sh@22 -- # case "$var" in 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # IFS=: 00:08:27.756 16:32:53 -- accel/accel.sh@20 -- # read -r var val 00:08:27.756 16:32:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:27.756 16:32:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:27.756 16:32:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:27.756 00:08:27.756 real 0m2.823s 00:08:27.756 user 0m9.375s 00:08:27.756 sys 0m0.315s 00:08:27.756 16:32:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:27.756 16:32:53 -- common/autotest_common.sh@10 -- # set +x 00:08:27.756 ************************************ 00:08:27.756 END TEST accel_decomp_mcore 00:08:27.756 ************************************ 00:08:27.756 16:32:53 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:27.756 16:32:53 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:08:27.756 16:32:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:27.756 16:32:53 -- common/autotest_common.sh@10 -- # set +x 00:08:27.756 ************************************ 00:08:27.756 START TEST accel_decomp_full_mcore 00:08:27.756 ************************************ 00:08:27.756 16:32:53 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:27.756 16:32:53 -- accel/accel.sh@16 -- # local accel_opc 00:08:27.756 16:32:53 -- accel/accel.sh@17 -- # local accel_module 00:08:27.756 16:32:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:27.756 16:32:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:27.756 16:32:53 -- accel/accel.sh@12 -- # build_accel_config 00:08:27.756 16:32:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:27.756 16:32:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:27.756 16:32:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:27.756 16:32:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:27.756 16:32:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:27.756 16:32:53 -- accel/accel.sh@41 -- # local IFS=, 00:08:27.756 16:32:53 -- accel/accel.sh@42 -- # jq -r . 00:08:27.756 [2024-10-13 16:32:53.076952] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:27.756 [2024-10-13 16:32:53.077036] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092418 ] 00:08:27.756 EAL: No free 2048 kB hugepages reported on node 1 00:08:27.756 [2024-10-13 16:32:53.139974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:27.756 [2024-10-13 16:32:53.234579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:27.756 [2024-10-13 16:32:53.234672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:27.756 [2024-10-13 16:32:53.234674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:27.756 [2024-10-13 16:32:53.234614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:29.128 16:32:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:29.128 00:08:29.128 SPDK Configuration: 00:08:29.128 Core mask: 0xf 00:08:29.128 00:08:29.129 Accel Perf Configuration: 00:08:29.129 Workload Type: decompress 00:08:29.129 Transfer size: 111250 bytes 00:08:29.129 Vector count 1 00:08:29.129 Module: software 00:08:29.129 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:29.129 Queue depth: 32 00:08:29.129 Allocate depth: 32 00:08:29.129 # threads/core: 1 00:08:29.129 Run time: 1 seconds 00:08:29.129 Verify: Yes 00:08:29.129 00:08:29.129 Running for 1 seconds... 00:08:29.129 00:08:29.129 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:29.129 ------------------------------------------------------------------------------------ 00:08:29.129 0,0 4288/s 177 MiB/s 0 0 00:08:29.129 3,0 4288/s 177 MiB/s 0 0 00:08:29.129 2,0 4288/s 177 MiB/s 0 0 00:08:29.129 1,0 4288/s 177 MiB/s 0 0 00:08:29.129 ==================================================================================== 00:08:29.129 Total 17152/s 1819 MiB/s 0 0' 00:08:29.129 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.129 16:32:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:29.129 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.129 16:32:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:29.129 16:32:54 -- accel/accel.sh@12 -- # build_accel_config 00:08:29.129 16:32:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:29.129 16:32:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:29.129 16:32:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:29.129 16:32:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:29.129 16:32:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:29.129 16:32:54 -- accel/accel.sh@41 -- # local IFS=, 00:08:29.129 16:32:54 -- accel/accel.sh@42 -- # jq -r . 00:08:29.129 [2024-10-13 16:32:54.506210] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:29.129 [2024-10-13 16:32:54.506298] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092624 ] 00:08:29.129 EAL: No free 2048 kB hugepages reported on node 1 00:08:29.129 [2024-10-13 16:32:54.567587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:29.387 [2024-10-13 16:32:54.662122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:29.387 [2024-10-13 16:32:54.662189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:29.387 [2024-10-13 16:32:54.662283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:29.387 [2024-10-13 16:32:54.662285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=0xf 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=decompress 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=software 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@23 -- # accel_module=software 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=32 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=32 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=1 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val=Yes 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:29.387 16:32:54 -- accel/accel.sh@21 -- # val= 00:08:29.387 16:32:54 -- accel/accel.sh@22 -- # case "$var" in 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # IFS=: 00:08:29.387 16:32:54 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@21 -- # val= 00:08:30.760 16:32:55 -- accel/accel.sh@22 -- # case "$var" in 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # IFS=: 00:08:30.760 16:32:55 -- accel/accel.sh@20 -- # read -r var val 00:08:30.760 16:32:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:30.760 16:32:55 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:30.760 16:32:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:30.760 00:08:30.760 real 0m2.849s 00:08:30.760 user 0m9.475s 00:08:30.760 sys 0m0.326s 00:08:30.760 16:32:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:30.760 16:32:55 -- common/autotest_common.sh@10 -- # set +x 00:08:30.760 ************************************ 00:08:30.761 END TEST accel_decomp_full_mcore 00:08:30.761 ************************************ 00:08:30.761 16:32:55 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:30.761 16:32:55 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:08:30.761 16:32:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:30.761 16:32:55 -- common/autotest_common.sh@10 -- # set +x 00:08:30.761 ************************************ 00:08:30.761 START TEST accel_decomp_mthread 00:08:30.761 ************************************ 00:08:30.761 16:32:55 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:30.761 16:32:55 -- accel/accel.sh@16 -- # local accel_opc 00:08:30.761 16:32:55 -- accel/accel.sh@17 -- # local accel_module 00:08:30.761 16:32:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:30.761 16:32:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:30.761 16:32:55 -- accel/accel.sh@12 -- # build_accel_config 00:08:30.761 16:32:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:30.761 16:32:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:30.761 16:32:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:30.761 16:32:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:30.761 16:32:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:30.761 16:32:55 -- accel/accel.sh@41 -- # local IFS=, 00:08:30.761 16:32:55 -- accel/accel.sh@42 -- # jq -r . 00:08:30.761 [2024-10-13 16:32:55.948457] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:30.761 [2024-10-13 16:32:55.948541] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092784 ] 00:08:30.761 EAL: No free 2048 kB hugepages reported on node 1 00:08:30.761 [2024-10-13 16:32:56.008452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:30.761 [2024-10-13 16:32:56.096360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:32.133 16:32:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:32.133 00:08:32.133 SPDK Configuration: 00:08:32.133 Core mask: 0x1 00:08:32.133 00:08:32.133 Accel Perf Configuration: 00:08:32.133 Workload Type: decompress 00:08:32.133 Transfer size: 4096 bytes 00:08:32.133 Vector count 1 00:08:32.133 Module: software 00:08:32.133 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:32.133 Queue depth: 32 00:08:32.133 Allocate depth: 32 00:08:32.133 # threads/core: 2 00:08:32.133 Run time: 1 seconds 00:08:32.133 Verify: Yes 00:08:32.133 00:08:32.133 Running for 1 seconds... 00:08:32.133 00:08:32.133 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:32.133 ------------------------------------------------------------------------------------ 00:08:32.133 0,1 27936/s 51 MiB/s 0 0 00:08:32.133 0,0 27776/s 51 MiB/s 0 0 00:08:32.133 ==================================================================================== 00:08:32.133 Total 55712/s 217 MiB/s 0 0' 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:32.133 16:32:57 -- accel/accel.sh@12 -- # build_accel_config 00:08:32.133 16:32:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:32.133 16:32:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:32.133 16:32:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:32.133 16:32:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:32.133 16:32:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:32.133 16:32:57 -- accel/accel.sh@41 -- # local IFS=, 00:08:32.133 16:32:57 -- accel/accel.sh@42 -- # jq -r . 00:08:32.133 [2024-10-13 16:32:57.340800] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:32.133 [2024-10-13 16:32:57.340883] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092936 ] 00:08:32.133 EAL: No free 2048 kB hugepages reported on node 1 00:08:32.133 [2024-10-13 16:32:57.401163] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:32.133 [2024-10-13 16:32:57.491268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val=0x1 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val=decompress 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.133 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.133 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.133 16:32:57 -- accel/accel.sh@21 -- # val=software 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@23 -- # accel_module=software 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val=32 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val=32 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val=2 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val=Yes 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:32.134 16:32:57 -- accel/accel.sh@21 -- # val= 00:08:32.134 16:32:57 -- accel/accel.sh@22 -- # case "$var" in 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # IFS=: 00:08:32.134 16:32:57 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@21 -- # val= 00:08:33.506 16:32:58 -- accel/accel.sh@22 -- # case "$var" in 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # IFS=: 00:08:33.506 16:32:58 -- accel/accel.sh@20 -- # read -r var val 00:08:33.506 16:32:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:33.506 16:32:58 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:33.506 16:32:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:33.506 00:08:33.506 real 0m2.799s 00:08:33.506 user 0m2.508s 00:08:33.506 sys 0m0.283s 00:08:33.506 16:32:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:33.506 16:32:58 -- common/autotest_common.sh@10 -- # set +x 00:08:33.506 ************************************ 00:08:33.506 END TEST accel_decomp_mthread 00:08:33.506 ************************************ 00:08:33.506 16:32:58 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:33.506 16:32:58 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:08:33.506 16:32:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:33.506 16:32:58 -- common/autotest_common.sh@10 -- # set +x 00:08:33.506 ************************************ 00:08:33.506 START TEST accel_deomp_full_mthread 00:08:33.506 ************************************ 00:08:33.506 16:32:58 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:33.506 16:32:58 -- accel/accel.sh@16 -- # local accel_opc 00:08:33.506 16:32:58 -- accel/accel.sh@17 -- # local accel_module 00:08:33.506 16:32:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:33.506 16:32:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:33.506 16:32:58 -- accel/accel.sh@12 -- # build_accel_config 00:08:33.506 16:32:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:33.506 16:32:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:33.506 16:32:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:33.506 16:32:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:33.506 16:32:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:33.506 16:32:58 -- accel/accel.sh@41 -- # local IFS=, 00:08:33.506 16:32:58 -- accel/accel.sh@42 -- # jq -r . 00:08:33.507 [2024-10-13 16:32:58.774592] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:33.507 [2024-10-13 16:32:58.774666] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093156 ] 00:08:33.507 EAL: No free 2048 kB hugepages reported on node 1 00:08:33.507 [2024-10-13 16:32:58.837665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:33.507 [2024-10-13 16:32:58.928774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.880 16:33:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:34.880 00:08:34.880 SPDK Configuration: 00:08:34.880 Core mask: 0x1 00:08:34.880 00:08:34.880 Accel Perf Configuration: 00:08:34.880 Workload Type: decompress 00:08:34.880 Transfer size: 111250 bytes 00:08:34.880 Vector count 1 00:08:34.880 Module: software 00:08:34.880 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:34.880 Queue depth: 32 00:08:34.880 Allocate depth: 32 00:08:34.880 # threads/core: 2 00:08:34.880 Run time: 1 seconds 00:08:34.880 Verify: Yes 00:08:34.880 00:08:34.880 Running for 1 seconds... 00:08:34.880 00:08:34.880 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:34.880 ------------------------------------------------------------------------------------ 00:08:34.880 0,1 1984/s 81 MiB/s 0 0 00:08:34.880 0,0 1952/s 80 MiB/s 0 0 00:08:34.880 ==================================================================================== 00:08:34.880 Total 3936/s 417 MiB/s 0 0' 00:08:34.880 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:34.880 16:33:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:34.880 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:34.880 16:33:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:34.880 16:33:00 -- accel/accel.sh@12 -- # build_accel_config 00:08:34.880 16:33:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:34.880 16:33:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:34.880 16:33:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:34.880 16:33:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:34.880 16:33:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:34.880 16:33:00 -- accel/accel.sh@41 -- # local IFS=, 00:08:34.880 16:33:00 -- accel/accel.sh@42 -- # jq -r . 00:08:34.880 [2024-10-13 16:33:00.205348] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:34.880 [2024-10-13 16:33:00.205447] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093374 ] 00:08:34.880 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.880 [2024-10-13 16:33:00.270373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:34.880 [2024-10-13 16:33:00.358909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=0x1 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=decompress 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=software 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@23 -- # accel_module=software 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=32 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=32 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=2 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val=Yes 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:35.139 16:33:00 -- accel/accel.sh@21 -- # val= 00:08:35.139 16:33:00 -- accel/accel.sh@22 -- # case "$var" in 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # IFS=: 00:08:35.139 16:33:00 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.512 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.512 16:33:01 -- accel/accel.sh@21 -- # val= 00:08:36.512 16:33:01 -- accel/accel.sh@22 -- # case "$var" in 00:08:36.513 16:33:01 -- accel/accel.sh@20 -- # IFS=: 00:08:36.513 16:33:01 -- accel/accel.sh@20 -- # read -r var val 00:08:36.513 16:33:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:36.513 16:33:01 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:36.513 16:33:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:36.513 00:08:36.513 real 0m2.869s 00:08:36.513 user 0m2.568s 00:08:36.513 sys 0m0.292s 00:08:36.513 16:33:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:36.513 16:33:01 -- common/autotest_common.sh@10 -- # set +x 00:08:36.513 ************************************ 00:08:36.513 END TEST accel_deomp_full_mthread 00:08:36.513 ************************************ 00:08:36.513 16:33:01 -- accel/accel.sh@116 -- # [[ n == y ]] 00:08:36.513 16:33:01 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:36.513 16:33:01 -- accel/accel.sh@129 -- # build_accel_config 00:08:36.513 16:33:01 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:36.513 16:33:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:36.513 16:33:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:36.513 16:33:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:36.513 16:33:01 -- common/autotest_common.sh@10 -- # set +x 00:08:36.513 16:33:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:36.513 16:33:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:36.513 16:33:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:36.513 16:33:01 -- accel/accel.sh@41 -- # local IFS=, 00:08:36.513 16:33:01 -- accel/accel.sh@42 -- # jq -r . 00:08:36.513 ************************************ 00:08:36.513 START TEST accel_dif_functional_tests 00:08:36.513 ************************************ 00:08:36.513 16:33:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:36.513 [2024-10-13 16:33:01.695845] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:36.513 [2024-10-13 16:33:01.695934] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093613 ] 00:08:36.513 EAL: No free 2048 kB hugepages reported on node 1 00:08:36.513 [2024-10-13 16:33:01.758536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:36.513 [2024-10-13 16:33:01.854665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:36.513 [2024-10-13 16:33:01.854716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:36.513 [2024-10-13 16:33:01.854734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:36.513 00:08:36.513 00:08:36.513 CUnit - A unit testing framework for C - Version 2.1-3 00:08:36.513 http://cunit.sourceforge.net/ 00:08:36.513 00:08:36.513 00:08:36.513 Suite: accel_dif 00:08:36.513 Test: verify: DIF generated, GUARD check ...passed 00:08:36.513 Test: verify: DIF generated, APPTAG check ...passed 00:08:36.513 Test: verify: DIF generated, REFTAG check ...passed 00:08:36.513 Test: verify: DIF not generated, GUARD check ...[2024-10-13 16:33:01.941194] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:36.513 [2024-10-13 16:33:01.941281] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:36.513 passed 00:08:36.513 Test: verify: DIF not generated, APPTAG check ...[2024-10-13 16:33:01.941317] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:36.513 [2024-10-13 16:33:01.941344] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:36.513 passed 00:08:36.513 Test: verify: DIF not generated, REFTAG check ...[2024-10-13 16:33:01.941373] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:36.513 [2024-10-13 16:33:01.941417] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:36.513 passed 00:08:36.513 Test: verify: APPTAG correct, APPTAG check ...passed 00:08:36.513 Test: verify: APPTAG incorrect, APPTAG check ...[2024-10-13 16:33:01.941488] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:08:36.513 passed 00:08:36.513 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:08:36.513 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:08:36.513 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:08:36.513 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-10-13 16:33:01.941624] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:08:36.513 passed 00:08:36.513 Test: generate copy: DIF generated, GUARD check ...passed 00:08:36.513 Test: generate copy: DIF generated, APTTAG check ...passed 00:08:36.513 Test: generate copy: DIF generated, REFTAG check ...passed 00:08:36.513 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:08:36.513 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:08:36.513 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:08:36.513 Test: generate copy: iovecs-len validate ...[2024-10-13 16:33:01.941850] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:08:36.513 passed 00:08:36.513 Test: generate copy: buffer alignment validate ...passed 00:08:36.513 00:08:36.513 Run Summary: Type Total Ran Passed Failed Inactive 00:08:36.513 suites 1 1 n/a 0 0 00:08:36.513 tests 20 20 20 0 0 00:08:36.513 asserts 204 204 204 0 n/a 00:08:36.513 00:08:36.513 Elapsed time = 0.002 seconds 00:08:36.771 00:08:36.771 real 0m0.496s 00:08:36.771 user 0m0.765s 00:08:36.771 sys 0m0.180s 00:08:36.771 16:33:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:36.771 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:36.771 ************************************ 00:08:36.771 END TEST accel_dif_functional_tests 00:08:36.771 ************************************ 00:08:36.771 00:08:36.771 real 0m59.732s 00:08:36.771 user 1m7.467s 00:08:36.771 sys 0m7.211s 00:08:36.771 16:33:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:36.771 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:36.771 ************************************ 00:08:36.771 END TEST accel 00:08:36.771 ************************************ 00:08:36.771 16:33:02 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:36.771 16:33:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:08:36.771 16:33:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:36.771 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:36.771 ************************************ 00:08:36.771 START TEST accel_rpc 00:08:36.771 ************************************ 00:08:36.771 16:33:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:36.771 * Looking for test storage... 00:08:36.771 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:08:36.771 16:33:02 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:36.771 16:33:02 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1093817 00:08:36.771 16:33:02 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:36.771 16:33:02 -- accel/accel_rpc.sh@15 -- # waitforlisten 1093817 00:08:36.771 16:33:02 -- common/autotest_common.sh@819 -- # '[' -z 1093817 ']' 00:08:36.771 16:33:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:36.771 16:33:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:36.771 16:33:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:36.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:36.771 16:33:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:36.771 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.029 [2024-10-13 16:33:02.302911] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:37.029 [2024-10-13 16:33:02.302992] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1093817 ] 00:08:37.029 EAL: No free 2048 kB hugepages reported on node 1 00:08:37.029 [2024-10-13 16:33:02.364344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:37.029 [2024-10-13 16:33:02.453727] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:37.029 [2024-10-13 16:33:02.453904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:37.029 16:33:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:37.029 16:33:02 -- common/autotest_common.sh@852 -- # return 0 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:37.029 16:33:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:08:37.029 16:33:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:37.029 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.029 ************************************ 00:08:37.029 START TEST accel_assign_opcode 00:08:37.029 ************************************ 00:08:37.029 16:33:02 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:37.029 16:33:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:37.029 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.029 [2024-10-13 16:33:02.518493] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:37.029 16:33:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:37.029 16:33:02 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:37.029 16:33:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:37.029 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.029 [2024-10-13 16:33:02.526490] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:37.287 16:33:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:37.287 16:33:02 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:37.287 16:33:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:37.287 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.287 16:33:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:37.287 16:33:02 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:37.287 16:33:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:37.287 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.287 16:33:02 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:37.287 16:33:02 -- accel/accel_rpc.sh@42 -- # grep software 00:08:37.287 16:33:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:37.546 software 00:08:37.546 00:08:37.546 real 0m0.299s 00:08:37.546 user 0m0.038s 00:08:37.546 sys 0m0.010s 00:08:37.546 16:33:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:37.546 16:33:02 -- common/autotest_common.sh@10 -- # set +x 00:08:37.546 ************************************ 00:08:37.546 END TEST accel_assign_opcode 00:08:37.546 ************************************ 00:08:37.546 16:33:02 -- accel/accel_rpc.sh@55 -- # killprocess 1093817 00:08:37.546 16:33:02 -- common/autotest_common.sh@926 -- # '[' -z 1093817 ']' 00:08:37.546 16:33:02 -- common/autotest_common.sh@930 -- # kill -0 1093817 00:08:37.546 16:33:02 -- common/autotest_common.sh@931 -- # uname 00:08:37.546 16:33:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:37.546 16:33:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1093817 00:08:37.546 16:33:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:37.546 16:33:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:37.546 16:33:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1093817' 00:08:37.546 killing process with pid 1093817 00:08:37.546 16:33:02 -- common/autotest_common.sh@945 -- # kill 1093817 00:08:37.546 16:33:02 -- common/autotest_common.sh@950 -- # wait 1093817 00:08:37.804 00:08:37.804 real 0m1.053s 00:08:37.804 user 0m0.984s 00:08:37.804 sys 0m0.420s 00:08:37.804 16:33:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:37.804 16:33:03 -- common/autotest_common.sh@10 -- # set +x 00:08:37.804 ************************************ 00:08:37.804 END TEST accel_rpc 00:08:37.804 ************************************ 00:08:37.804 16:33:03 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:37.804 16:33:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:08:37.804 16:33:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:37.804 16:33:03 -- common/autotest_common.sh@10 -- # set +x 00:08:37.804 ************************************ 00:08:37.804 START TEST app_cmdline 00:08:37.804 ************************************ 00:08:37.804 16:33:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:38.063 * Looking for test storage... 00:08:38.063 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:38.063 16:33:03 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:38.063 16:33:03 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1094011 00:08:38.063 16:33:03 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:38.063 16:33:03 -- app/cmdline.sh@18 -- # waitforlisten 1094011 00:08:38.063 16:33:03 -- common/autotest_common.sh@819 -- # '[' -z 1094011 ']' 00:08:38.063 16:33:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.063 16:33:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:38.063 16:33:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.063 16:33:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:38.063 16:33:03 -- common/autotest_common.sh@10 -- # set +x 00:08:38.063 [2024-10-13 16:33:03.385651] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:38.063 [2024-10-13 16:33:03.385748] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1094011 ] 00:08:38.063 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.063 [2024-10-13 16:33:03.442664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:38.063 [2024-10-13 16:33:03.525886] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.063 [2024-10-13 16:33:03.526054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.996 16:33:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:38.996 16:33:04 -- common/autotest_common.sh@852 -- # return 0 00:08:38.996 16:33:04 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:39.254 { 00:08:39.254 "version": "SPDK v24.01.1-pre git sha1 726a04d70", 00:08:39.254 "fields": { 00:08:39.254 "major": 24, 00:08:39.254 "minor": 1, 00:08:39.254 "patch": 1, 00:08:39.254 "suffix": "-pre", 00:08:39.254 "commit": "726a04d70" 00:08:39.254 } 00:08:39.254 } 00:08:39.254 16:33:04 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:39.254 16:33:04 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:39.254 16:33:04 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:39.254 16:33:04 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:39.254 16:33:04 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:39.254 16:33:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.254 16:33:04 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:39.254 16:33:04 -- common/autotest_common.sh@10 -- # set +x 00:08:39.254 16:33:04 -- app/cmdline.sh@26 -- # sort 00:08:39.254 16:33:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.254 16:33:04 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:39.254 16:33:04 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:39.254 16:33:04 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:39.254 16:33:04 -- common/autotest_common.sh@640 -- # local es=0 00:08:39.254 16:33:04 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:39.254 16:33:04 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:39.254 16:33:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:08:39.254 16:33:04 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:39.254 16:33:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:08:39.254 16:33:04 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:39.254 16:33:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:08:39.254 16:33:04 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:39.254 16:33:04 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:08:39.254 16:33:04 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:39.511 request: 00:08:39.511 { 00:08:39.511 "method": "env_dpdk_get_mem_stats", 00:08:39.511 "req_id": 1 00:08:39.511 } 00:08:39.511 Got JSON-RPC error response 00:08:39.511 response: 00:08:39.511 { 00:08:39.511 "code": -32601, 00:08:39.511 "message": "Method not found" 00:08:39.511 } 00:08:39.511 16:33:04 -- common/autotest_common.sh@643 -- # es=1 00:08:39.512 16:33:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:08:39.512 16:33:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:08:39.512 16:33:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:08:39.512 16:33:04 -- app/cmdline.sh@1 -- # killprocess 1094011 00:08:39.512 16:33:04 -- common/autotest_common.sh@926 -- # '[' -z 1094011 ']' 00:08:39.512 16:33:04 -- common/autotest_common.sh@930 -- # kill -0 1094011 00:08:39.512 16:33:04 -- common/autotest_common.sh@931 -- # uname 00:08:39.512 16:33:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:39.512 16:33:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1094011 00:08:39.512 16:33:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:39.512 16:33:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:39.512 16:33:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1094011' 00:08:39.512 killing process with pid 1094011 00:08:39.512 16:33:04 -- common/autotest_common.sh@945 -- # kill 1094011 00:08:39.512 16:33:04 -- common/autotest_common.sh@950 -- # wait 1094011 00:08:40.077 00:08:40.077 real 0m2.051s 00:08:40.077 user 0m2.579s 00:08:40.077 sys 0m0.520s 00:08:40.077 16:33:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:40.077 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.077 ************************************ 00:08:40.077 END TEST app_cmdline 00:08:40.077 ************************************ 00:08:40.077 16:33:05 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:40.077 16:33:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:08:40.077 16:33:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:40.077 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.077 ************************************ 00:08:40.077 START TEST version 00:08:40.077 ************************************ 00:08:40.077 16:33:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:40.077 * Looking for test storage... 00:08:40.077 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:40.077 16:33:05 -- app/version.sh@17 -- # get_header_version major 00:08:40.077 16:33:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:40.077 16:33:05 -- app/version.sh@14 -- # cut -f2 00:08:40.077 16:33:05 -- app/version.sh@14 -- # tr -d '"' 00:08:40.077 16:33:05 -- app/version.sh@17 -- # major=24 00:08:40.077 16:33:05 -- app/version.sh@18 -- # get_header_version minor 00:08:40.077 16:33:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:40.077 16:33:05 -- app/version.sh@14 -- # cut -f2 00:08:40.077 16:33:05 -- app/version.sh@14 -- # tr -d '"' 00:08:40.077 16:33:05 -- app/version.sh@18 -- # minor=1 00:08:40.077 16:33:05 -- app/version.sh@19 -- # get_header_version patch 00:08:40.077 16:33:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:40.077 16:33:05 -- app/version.sh@14 -- # cut -f2 00:08:40.077 16:33:05 -- app/version.sh@14 -- # tr -d '"' 00:08:40.077 16:33:05 -- app/version.sh@19 -- # patch=1 00:08:40.077 16:33:05 -- app/version.sh@20 -- # get_header_version suffix 00:08:40.077 16:33:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:40.077 16:33:05 -- app/version.sh@14 -- # cut -f2 00:08:40.077 16:33:05 -- app/version.sh@14 -- # tr -d '"' 00:08:40.077 16:33:05 -- app/version.sh@20 -- # suffix=-pre 00:08:40.077 16:33:05 -- app/version.sh@22 -- # version=24.1 00:08:40.077 16:33:05 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:40.077 16:33:05 -- app/version.sh@25 -- # version=24.1.1 00:08:40.077 16:33:05 -- app/version.sh@28 -- # version=24.1.1rc0 00:08:40.077 16:33:05 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:40.077 16:33:05 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:40.077 16:33:05 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:08:40.077 16:33:05 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:08:40.077 00:08:40.077 real 0m0.093s 00:08:40.077 user 0m0.054s 00:08:40.077 sys 0m0.059s 00:08:40.077 16:33:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:40.077 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.077 ************************************ 00:08:40.077 END TEST version 00:08:40.077 ************************************ 00:08:40.077 16:33:05 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:08:40.077 16:33:05 -- spdk/autotest.sh@204 -- # uname -s 00:08:40.078 16:33:05 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:08:40.078 16:33:05 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:08:40.078 16:33:05 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:08:40.078 16:33:05 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@268 -- # timing_exit lib 00:08:40.078 16:33:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:40.078 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.078 16:33:05 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:08:40.078 16:33:05 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:08:40.078 16:33:05 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:40.078 16:33:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:40.078 16:33:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:40.078 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.078 ************************************ 00:08:40.078 START TEST nvmf_tcp 00:08:40.078 ************************************ 00:08:40.078 16:33:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:40.078 * Looking for test storage... 00:08:40.078 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:40.078 16:33:05 -- nvmf/common.sh@7 -- # uname -s 00:08:40.078 16:33:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:40.078 16:33:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:40.078 16:33:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:40.078 16:33:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:40.078 16:33:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:40.078 16:33:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:40.078 16:33:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:40.078 16:33:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:40.078 16:33:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:40.078 16:33:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:40.078 16:33:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:40.078 16:33:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:40.078 16:33:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:40.078 16:33:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:40.078 16:33:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:40.078 16:33:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:40.078 16:33:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:40.078 16:33:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:40.078 16:33:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:40.078 16:33:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.078 16:33:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.078 16:33:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.078 16:33:05 -- paths/export.sh@5 -- # export PATH 00:08:40.078 16:33:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.078 16:33:05 -- nvmf/common.sh@46 -- # : 0 00:08:40.078 16:33:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:40.078 16:33:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:40.078 16:33:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:40.078 16:33:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:40.078 16:33:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:40.078 16:33:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:40.078 16:33:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:40.078 16:33:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:40.078 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:40.078 16:33:05 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:40.078 16:33:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:40.078 16:33:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:40.078 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.078 ************************************ 00:08:40.078 START TEST nvmf_example 00:08:40.078 ************************************ 00:08:40.078 16:33:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:40.337 * Looking for test storage... 00:08:40.337 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:40.337 16:33:05 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:40.337 16:33:05 -- nvmf/common.sh@7 -- # uname -s 00:08:40.337 16:33:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:40.337 16:33:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:40.337 16:33:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:40.337 16:33:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:40.337 16:33:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:40.337 16:33:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:40.337 16:33:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:40.337 16:33:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:40.337 16:33:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:40.337 16:33:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:40.337 16:33:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:40.337 16:33:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:40.337 16:33:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:40.337 16:33:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:40.337 16:33:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:40.337 16:33:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:40.337 16:33:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:40.337 16:33:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:40.337 16:33:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:40.337 16:33:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.337 16:33:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.337 16:33:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.337 16:33:05 -- paths/export.sh@5 -- # export PATH 00:08:40.337 16:33:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:40.337 16:33:05 -- nvmf/common.sh@46 -- # : 0 00:08:40.337 16:33:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:40.337 16:33:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:40.337 16:33:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:40.337 16:33:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:40.337 16:33:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:40.337 16:33:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:40.337 16:33:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:40.337 16:33:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:40.337 16:33:05 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:40.337 16:33:05 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:40.337 16:33:05 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:40.337 16:33:05 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:40.337 16:33:05 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:40.337 16:33:05 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:40.337 16:33:05 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:40.337 16:33:05 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:40.337 16:33:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:40.337 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.337 16:33:05 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:40.337 16:33:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:40.337 16:33:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:40.337 16:33:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:40.337 16:33:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:40.337 16:33:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:40.337 16:33:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:40.337 16:33:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:40.337 16:33:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:40.337 16:33:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:40.337 16:33:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:40.337 16:33:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:40.337 16:33:05 -- common/autotest_common.sh@10 -- # set +x 00:08:42.240 16:33:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:42.240 16:33:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:42.240 16:33:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:42.240 16:33:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:42.240 16:33:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:42.240 16:33:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:42.240 16:33:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:42.240 16:33:07 -- nvmf/common.sh@294 -- # net_devs=() 00:08:42.240 16:33:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:42.240 16:33:07 -- nvmf/common.sh@295 -- # e810=() 00:08:42.240 16:33:07 -- nvmf/common.sh@295 -- # local -ga e810 00:08:42.240 16:33:07 -- nvmf/common.sh@296 -- # x722=() 00:08:42.240 16:33:07 -- nvmf/common.sh@296 -- # local -ga x722 00:08:42.240 16:33:07 -- nvmf/common.sh@297 -- # mlx=() 00:08:42.240 16:33:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:42.240 16:33:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:42.240 16:33:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:42.240 16:33:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:42.240 16:33:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:42.240 16:33:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:42.240 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:42.240 16:33:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:42.240 16:33:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:42.240 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:42.240 16:33:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:42.240 16:33:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:42.240 16:33:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:42.240 16:33:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:42.240 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:42.240 16:33:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:42.240 16:33:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:42.240 16:33:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:42.240 16:33:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:42.240 16:33:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:42.240 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:42.240 16:33:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:42.240 16:33:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:42.240 16:33:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:42.240 16:33:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:42.240 16:33:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:42.240 16:33:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:42.240 16:33:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:42.240 16:33:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:42.240 16:33:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:42.240 16:33:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:42.240 16:33:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:42.240 16:33:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:42.240 16:33:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:42.240 16:33:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:42.240 16:33:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:42.240 16:33:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:42.240 16:33:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:42.498 16:33:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:42.498 16:33:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:42.498 16:33:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:42.498 16:33:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:42.498 16:33:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:42.498 16:33:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:42.498 16:33:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:42.498 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:42.499 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:08:42.499 00:08:42.499 --- 10.0.0.2 ping statistics --- 00:08:42.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:42.499 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:08:42.499 16:33:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:42.499 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:42.499 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:08:42.499 00:08:42.499 --- 10.0.0.1 ping statistics --- 00:08:42.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:42.499 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:08:42.499 16:33:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:42.499 16:33:07 -- nvmf/common.sh@410 -- # return 0 00:08:42.499 16:33:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:42.499 16:33:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:42.499 16:33:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:42.499 16:33:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:42.499 16:33:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:42.499 16:33:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:42.499 16:33:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:42.499 16:33:07 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:42.499 16:33:07 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:42.499 16:33:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:42.499 16:33:07 -- common/autotest_common.sh@10 -- # set +x 00:08:42.499 16:33:07 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:42.499 16:33:07 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:42.499 16:33:07 -- target/nvmf_example.sh@34 -- # nvmfpid=1096368 00:08:42.499 16:33:07 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:42.499 16:33:07 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:42.499 16:33:07 -- target/nvmf_example.sh@36 -- # waitforlisten 1096368 00:08:42.499 16:33:07 -- common/autotest_common.sh@819 -- # '[' -z 1096368 ']' 00:08:42.499 16:33:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:42.499 16:33:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:42.499 16:33:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:42.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:42.499 16:33:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:42.499 16:33:07 -- common/autotest_common.sh@10 -- # set +x 00:08:42.757 EAL: No free 2048 kB hugepages reported on node 1 00:08:42.757 16:33:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:42.757 16:33:08 -- common/autotest_common.sh@852 -- # return 0 00:08:42.757 16:33:08 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:42.757 16:33:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:42.757 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:43.015 16:33:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:43.015 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:43.015 16:33:08 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:43.015 16:33:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:43.015 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:43.015 16:33:08 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:43.015 16:33:08 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:43.015 16:33:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:43.015 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:43.015 16:33:08 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:43.015 16:33:08 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:43.015 16:33:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:43.015 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:43.015 16:33:08 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:43.015 16:33:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:43.015 16:33:08 -- common/autotest_common.sh@10 -- # set +x 00:08:43.015 16:33:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:43.015 16:33:08 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:43.015 16:33:08 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:43.015 EAL: No free 2048 kB hugepages reported on node 1 00:08:55.252 Initializing NVMe Controllers 00:08:55.252 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:55.252 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:55.252 Initialization complete. Launching workers. 00:08:55.252 ======================================================== 00:08:55.252 Latency(us) 00:08:55.252 Device Information : IOPS MiB/s Average min max 00:08:55.252 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15344.36 59.94 4170.59 587.80 45058.47 00:08:55.252 ======================================================== 00:08:55.252 Total : 15344.36 59.94 4170.59 587.80 45058.47 00:08:55.252 00:08:55.252 16:33:18 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:55.252 16:33:18 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:55.252 16:33:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:55.252 16:33:18 -- nvmf/common.sh@116 -- # sync 00:08:55.252 16:33:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:55.252 16:33:18 -- nvmf/common.sh@119 -- # set +e 00:08:55.252 16:33:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:55.252 16:33:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:55.252 rmmod nvme_tcp 00:08:55.252 rmmod nvme_fabrics 00:08:55.252 rmmod nvme_keyring 00:08:55.252 16:33:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:55.252 16:33:18 -- nvmf/common.sh@123 -- # set -e 00:08:55.252 16:33:18 -- nvmf/common.sh@124 -- # return 0 00:08:55.252 16:33:18 -- nvmf/common.sh@477 -- # '[' -n 1096368 ']' 00:08:55.252 16:33:18 -- nvmf/common.sh@478 -- # killprocess 1096368 00:08:55.252 16:33:18 -- common/autotest_common.sh@926 -- # '[' -z 1096368 ']' 00:08:55.252 16:33:18 -- common/autotest_common.sh@930 -- # kill -0 1096368 00:08:55.252 16:33:18 -- common/autotest_common.sh@931 -- # uname 00:08:55.252 16:33:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:55.252 16:33:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1096368 00:08:55.252 16:33:18 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:08:55.252 16:33:18 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:08:55.252 16:33:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1096368' 00:08:55.252 killing process with pid 1096368 00:08:55.252 16:33:18 -- common/autotest_common.sh@945 -- # kill 1096368 00:08:55.252 16:33:18 -- common/autotest_common.sh@950 -- # wait 1096368 00:08:55.252 nvmf threads initialize successfully 00:08:55.252 bdev subsystem init successfully 00:08:55.252 created a nvmf target service 00:08:55.252 create targets's poll groups done 00:08:55.252 all subsystems of target started 00:08:55.252 nvmf target is running 00:08:55.252 all subsystems of target stopped 00:08:55.252 destroy targets's poll groups done 00:08:55.252 destroyed the nvmf target service 00:08:55.252 bdev subsystem finish successfully 00:08:55.252 nvmf threads destroy successfully 00:08:55.252 16:33:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:55.252 16:33:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:55.252 16:33:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:55.252 16:33:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:55.252 16:33:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:55.252 16:33:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.252 16:33:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.252 16:33:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:55.512 16:33:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:55.512 16:33:20 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:55.512 16:33:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:55.512 16:33:20 -- common/autotest_common.sh@10 -- # set +x 00:08:55.512 00:08:55.512 real 0m15.386s 00:08:55.512 user 0m41.501s 00:08:55.512 sys 0m3.633s 00:08:55.512 16:33:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:55.512 16:33:20 -- common/autotest_common.sh@10 -- # set +x 00:08:55.512 ************************************ 00:08:55.512 END TEST nvmf_example 00:08:55.512 ************************************ 00:08:55.512 16:33:20 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:55.512 16:33:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:55.512 16:33:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:55.512 16:33:20 -- common/autotest_common.sh@10 -- # set +x 00:08:55.512 ************************************ 00:08:55.512 START TEST nvmf_filesystem 00:08:55.512 ************************************ 00:08:55.512 16:33:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:55.774 * Looking for test storage... 00:08:55.774 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.774 16:33:21 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:55.774 16:33:21 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:55.774 16:33:21 -- common/autotest_common.sh@34 -- # set -e 00:08:55.774 16:33:21 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:55.774 16:33:21 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:55.774 16:33:21 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:55.774 16:33:21 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:55.774 16:33:21 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:55.774 16:33:21 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:55.774 16:33:21 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:55.774 16:33:21 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:55.774 16:33:21 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:55.774 16:33:21 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:55.774 16:33:21 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:55.774 16:33:21 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:55.774 16:33:21 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:55.774 16:33:21 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:55.774 16:33:21 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:55.774 16:33:21 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:55.774 16:33:21 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:55.774 16:33:21 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:55.774 16:33:21 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:55.774 16:33:21 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:55.774 16:33:21 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:55.774 16:33:21 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:55.774 16:33:21 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:55.774 16:33:21 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:55.774 16:33:21 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:55.774 16:33:21 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:55.774 16:33:21 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:55.774 16:33:21 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:55.774 16:33:21 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:55.774 16:33:21 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:55.774 16:33:21 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:55.774 16:33:21 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:55.774 16:33:21 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:55.774 16:33:21 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:55.774 16:33:21 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:55.774 16:33:21 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:55.774 16:33:21 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:55.774 16:33:21 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:55.774 16:33:21 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:55.774 16:33:21 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:55.774 16:33:21 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:55.774 16:33:21 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:55.774 16:33:21 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:55.774 16:33:21 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:55.774 16:33:21 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:55.774 16:33:21 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:55.774 16:33:21 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:55.774 16:33:21 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:55.774 16:33:21 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:55.774 16:33:21 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:55.774 16:33:21 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:55.774 16:33:21 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:55.774 16:33:21 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:55.774 16:33:21 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:55.774 16:33:21 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:55.774 16:33:21 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:55.774 16:33:21 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:55.774 16:33:21 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:55.774 16:33:21 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:55.774 16:33:21 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:55.774 16:33:21 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:55.774 16:33:21 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:55.774 16:33:21 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:55.774 16:33:21 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:55.774 16:33:21 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:55.774 16:33:21 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:55.774 16:33:21 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:55.774 16:33:21 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:55.774 16:33:21 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:55.774 16:33:21 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:55.774 16:33:21 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:55.774 16:33:21 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:55.774 16:33:21 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:55.774 16:33:21 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:55.774 16:33:21 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:55.774 16:33:21 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:55.774 16:33:21 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:55.774 16:33:21 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:55.774 16:33:21 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:55.774 16:33:21 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:55.774 16:33:21 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:55.774 16:33:21 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:55.774 16:33:21 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:55.774 16:33:21 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:55.774 16:33:21 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:55.774 16:33:21 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:55.774 16:33:21 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:55.774 16:33:21 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:55.774 16:33:21 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:55.774 16:33:21 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:55.774 16:33:21 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:55.774 16:33:21 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:55.774 16:33:21 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:55.774 16:33:21 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:55.774 16:33:21 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:55.774 16:33:21 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:55.774 16:33:21 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:55.774 16:33:21 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:55.774 16:33:21 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:55.774 #define SPDK_CONFIG_H 00:08:55.774 #define SPDK_CONFIG_APPS 1 00:08:55.774 #define SPDK_CONFIG_ARCH native 00:08:55.774 #undef SPDK_CONFIG_ASAN 00:08:55.774 #undef SPDK_CONFIG_AVAHI 00:08:55.774 #undef SPDK_CONFIG_CET 00:08:55.774 #define SPDK_CONFIG_COVERAGE 1 00:08:55.774 #define SPDK_CONFIG_CROSS_PREFIX 00:08:55.774 #undef SPDK_CONFIG_CRYPTO 00:08:55.774 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:55.774 #undef SPDK_CONFIG_CUSTOMOCF 00:08:55.774 #undef SPDK_CONFIG_DAOS 00:08:55.774 #define SPDK_CONFIG_DAOS_DIR 00:08:55.774 #define SPDK_CONFIG_DEBUG 1 00:08:55.774 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:55.774 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:55.774 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:55.774 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:55.774 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:55.774 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:55.774 #define SPDK_CONFIG_EXAMPLES 1 00:08:55.774 #undef SPDK_CONFIG_FC 00:08:55.774 #define SPDK_CONFIG_FC_PATH 00:08:55.774 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:55.774 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:55.774 #undef SPDK_CONFIG_FUSE 00:08:55.774 #undef SPDK_CONFIG_FUZZER 00:08:55.774 #define SPDK_CONFIG_FUZZER_LIB 00:08:55.774 #undef SPDK_CONFIG_GOLANG 00:08:55.774 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:55.774 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:55.774 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:55.774 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:55.774 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:55.774 #define SPDK_CONFIG_IDXD 1 00:08:55.774 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:55.774 #undef SPDK_CONFIG_IPSEC_MB 00:08:55.774 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:55.774 #define SPDK_CONFIG_ISAL 1 00:08:55.774 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:55.774 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:55.774 #define SPDK_CONFIG_LIBDIR 00:08:55.774 #undef SPDK_CONFIG_LTO 00:08:55.775 #define SPDK_CONFIG_MAX_LCORES 00:08:55.775 #define SPDK_CONFIG_NVME_CUSE 1 00:08:55.775 #undef SPDK_CONFIG_OCF 00:08:55.775 #define SPDK_CONFIG_OCF_PATH 00:08:55.775 #define SPDK_CONFIG_OPENSSL_PATH 00:08:55.775 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:55.775 #undef SPDK_CONFIG_PGO_USE 00:08:55.775 #define SPDK_CONFIG_PREFIX /usr/local 00:08:55.775 #undef SPDK_CONFIG_RAID5F 00:08:55.775 #undef SPDK_CONFIG_RBD 00:08:55.775 #define SPDK_CONFIG_RDMA 1 00:08:55.775 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:55.775 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:55.775 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:55.775 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:55.775 #define SPDK_CONFIG_SHARED 1 00:08:55.775 #undef SPDK_CONFIG_SMA 00:08:55.775 #define SPDK_CONFIG_TESTS 1 00:08:55.775 #undef SPDK_CONFIG_TSAN 00:08:55.775 #define SPDK_CONFIG_UBLK 1 00:08:55.775 #define SPDK_CONFIG_UBSAN 1 00:08:55.775 #undef SPDK_CONFIG_UNIT_TESTS 00:08:55.775 #undef SPDK_CONFIG_URING 00:08:55.775 #define SPDK_CONFIG_URING_PATH 00:08:55.775 #undef SPDK_CONFIG_URING_ZNS 00:08:55.775 #undef SPDK_CONFIG_USDT 00:08:55.775 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:55.775 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:55.775 #define SPDK_CONFIG_VFIO_USER 1 00:08:55.775 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:55.775 #define SPDK_CONFIG_VHOST 1 00:08:55.775 #define SPDK_CONFIG_VIRTIO 1 00:08:55.775 #undef SPDK_CONFIG_VTUNE 00:08:55.775 #define SPDK_CONFIG_VTUNE_DIR 00:08:55.775 #define SPDK_CONFIG_WERROR 1 00:08:55.775 #define SPDK_CONFIG_WPDK_DIR 00:08:55.775 #undef SPDK_CONFIG_XNVME 00:08:55.775 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:55.775 16:33:21 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:55.775 16:33:21 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:55.775 16:33:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:55.775 16:33:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:55.775 16:33:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:55.775 16:33:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.775 16:33:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.775 16:33:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.775 16:33:21 -- paths/export.sh@5 -- # export PATH 00:08:55.775 16:33:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.775 16:33:21 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:55.775 16:33:21 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:55.775 16:33:21 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:55.775 16:33:21 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:55.775 16:33:21 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:55.775 16:33:21 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:55.775 16:33:21 -- pm/common@16 -- # TEST_TAG=N/A 00:08:55.775 16:33:21 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:55.775 16:33:21 -- common/autotest_common.sh@52 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:55.775 16:33:21 -- common/autotest_common.sh@56 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:55.775 16:33:21 -- common/autotest_common.sh@58 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:55.775 16:33:21 -- common/autotest_common.sh@60 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:55.775 16:33:21 -- common/autotest_common.sh@62 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:55.775 16:33:21 -- common/autotest_common.sh@64 -- # : 00:08:55.775 16:33:21 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:55.775 16:33:21 -- common/autotest_common.sh@66 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:55.775 16:33:21 -- common/autotest_common.sh@68 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:55.775 16:33:21 -- common/autotest_common.sh@70 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:55.775 16:33:21 -- common/autotest_common.sh@72 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:55.775 16:33:21 -- common/autotest_common.sh@74 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:55.775 16:33:21 -- common/autotest_common.sh@76 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:55.775 16:33:21 -- common/autotest_common.sh@78 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:55.775 16:33:21 -- common/autotest_common.sh@80 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:55.775 16:33:21 -- common/autotest_common.sh@82 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:55.775 16:33:21 -- common/autotest_common.sh@84 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:55.775 16:33:21 -- common/autotest_common.sh@86 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:55.775 16:33:21 -- common/autotest_common.sh@88 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:55.775 16:33:21 -- common/autotest_common.sh@90 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:55.775 16:33:21 -- common/autotest_common.sh@92 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:55.775 16:33:21 -- common/autotest_common.sh@94 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:55.775 16:33:21 -- common/autotest_common.sh@96 -- # : tcp 00:08:55.775 16:33:21 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:55.775 16:33:21 -- common/autotest_common.sh@98 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:55.775 16:33:21 -- common/autotest_common.sh@100 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:55.775 16:33:21 -- common/autotest_common.sh@102 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:55.775 16:33:21 -- common/autotest_common.sh@104 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:55.775 16:33:21 -- common/autotest_common.sh@106 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:55.775 16:33:21 -- common/autotest_common.sh@108 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:55.775 16:33:21 -- common/autotest_common.sh@110 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:55.775 16:33:21 -- common/autotest_common.sh@112 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:55.775 16:33:21 -- common/autotest_common.sh@114 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:55.775 16:33:21 -- common/autotest_common.sh@116 -- # : 1 00:08:55.775 16:33:21 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:55.775 16:33:21 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:55.775 16:33:21 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:55.775 16:33:21 -- common/autotest_common.sh@120 -- # : 0 00:08:55.775 16:33:21 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:55.776 16:33:21 -- common/autotest_common.sh@122 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:55.776 16:33:21 -- common/autotest_common.sh@124 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:55.776 16:33:21 -- common/autotest_common.sh@126 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:55.776 16:33:21 -- common/autotest_common.sh@128 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:55.776 16:33:21 -- common/autotest_common.sh@130 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:55.776 16:33:21 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:55.776 16:33:21 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:55.776 16:33:21 -- common/autotest_common.sh@134 -- # : true 00:08:55.776 16:33:21 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:55.776 16:33:21 -- common/autotest_common.sh@136 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:55.776 16:33:21 -- common/autotest_common.sh@138 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:55.776 16:33:21 -- common/autotest_common.sh@140 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:55.776 16:33:21 -- common/autotest_common.sh@142 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:55.776 16:33:21 -- common/autotest_common.sh@144 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:55.776 16:33:21 -- common/autotest_common.sh@146 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:55.776 16:33:21 -- common/autotest_common.sh@148 -- # : e810 00:08:55.776 16:33:21 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:55.776 16:33:21 -- common/autotest_common.sh@150 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:55.776 16:33:21 -- common/autotest_common.sh@152 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:55.776 16:33:21 -- common/autotest_common.sh@154 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:55.776 16:33:21 -- common/autotest_common.sh@156 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:55.776 16:33:21 -- common/autotest_common.sh@158 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:55.776 16:33:21 -- common/autotest_common.sh@160 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:55.776 16:33:21 -- common/autotest_common.sh@163 -- # : 00:08:55.776 16:33:21 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:55.776 16:33:21 -- common/autotest_common.sh@165 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:55.776 16:33:21 -- common/autotest_common.sh@167 -- # : 0 00:08:55.776 16:33:21 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:55.776 16:33:21 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:55.776 16:33:21 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:55.776 16:33:21 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:55.776 16:33:21 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:55.776 16:33:21 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:55.776 16:33:21 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:55.776 16:33:21 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:55.776 16:33:21 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:55.776 16:33:21 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:55.776 16:33:21 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:55.776 16:33:21 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:55.776 16:33:21 -- common/autotest_common.sh@196 -- # cat 00:08:55.776 16:33:21 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:55.776 16:33:21 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:55.776 16:33:21 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:55.776 16:33:21 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:55.776 16:33:21 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:55.776 16:33:21 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:55.776 16:33:21 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:55.776 16:33:21 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:55.776 16:33:21 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:55.776 16:33:21 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:55.776 16:33:21 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:55.776 16:33:21 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:55.776 16:33:21 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:55.776 16:33:21 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:55.776 16:33:21 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:55.776 16:33:21 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:55.776 16:33:21 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:55.776 16:33:21 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:08:55.776 16:33:21 -- common/autotest_common.sh@249 -- # export valgrind= 00:08:55.776 16:33:21 -- common/autotest_common.sh@249 -- # valgrind= 00:08:55.776 16:33:21 -- common/autotest_common.sh@255 -- # uname -s 00:08:55.776 16:33:21 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:08:55.776 16:33:21 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:08:55.776 16:33:21 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:08:55.776 16:33:21 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:08:55.776 16:33:21 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:08:55.776 16:33:21 -- common/autotest_common.sh@265 -- # MAKE=make 00:08:55.776 16:33:21 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:08:55.776 16:33:21 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:08:55.776 16:33:21 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:08:55.776 16:33:21 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:55.776 16:33:21 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:08:55.776 16:33:21 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:08:55.776 16:33:21 -- common/autotest_common.sh@291 -- # for i in "$@" 00:08:55.776 16:33:21 -- common/autotest_common.sh@292 -- # case "$i" in 00:08:55.776 16:33:21 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:08:55.776 16:33:21 -- common/autotest_common.sh@309 -- # [[ -z 1098179 ]] 00:08:55.776 16:33:21 -- common/autotest_common.sh@309 -- # kill -0 1098179 00:08:55.776 16:33:21 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:08:55.776 16:33:21 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:08:55.776 16:33:21 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:08:55.776 16:33:21 -- common/autotest_common.sh@322 -- # local mount target_dir 00:08:55.776 16:33:21 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:08:55.776 16:33:21 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:08:55.776 16:33:21 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:08:55.776 16:33:21 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:08:55.777 16:33:21 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.KDcQ5u 00:08:55.777 16:33:21 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:55.777 16:33:21 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.KDcQ5u/tests/target /tmp/spdk.KDcQ5u 00:08:55.777 16:33:21 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@318 -- # df -T 00:08:55.777 16:33:21 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=4096 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=5284425728 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=53970636800 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61988528128 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=8017891328 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=30993006592 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994264064 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=1257472 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=12388921344 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12397707264 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=8785920 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=30993903616 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994264064 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=360448 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # avails["$mount"]=6198837248 00:08:55.777 16:33:21 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6198849536 00:08:55.777 16:33:21 -- common/autotest_common.sh@354 -- # uses["$mount"]=12288 00:08:55.777 16:33:21 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:55.777 16:33:21 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:08:55.777 * Looking for test storage... 00:08:55.777 16:33:21 -- common/autotest_common.sh@359 -- # local target_space new_size 00:08:55.777 16:33:21 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:08:55.777 16:33:21 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.777 16:33:21 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:55.777 16:33:21 -- common/autotest_common.sh@363 -- # mount=/ 00:08:55.777 16:33:21 -- common/autotest_common.sh@365 -- # target_space=53970636800 00:08:55.777 16:33:21 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:08:55.777 16:33:21 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:08:55.777 16:33:21 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@372 -- # new_size=10232483840 00:08:55.777 16:33:21 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:55.777 16:33:21 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.777 16:33:21 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.777 16:33:21 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.777 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:55.777 16:33:21 -- common/autotest_common.sh@380 -- # return 0 00:08:55.777 16:33:21 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:08:55.777 16:33:21 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:08:55.777 16:33:21 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:55.777 16:33:21 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:55.777 16:33:21 -- common/autotest_common.sh@1672 -- # true 00:08:55.777 16:33:21 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:08:55.777 16:33:21 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:55.777 16:33:21 -- common/autotest_common.sh@27 -- # exec 00:08:55.777 16:33:21 -- common/autotest_common.sh@29 -- # exec 00:08:55.777 16:33:21 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:55.777 16:33:21 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:55.777 16:33:21 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:55.777 16:33:21 -- common/autotest_common.sh@18 -- # set -x 00:08:55.777 16:33:21 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:55.777 16:33:21 -- nvmf/common.sh@7 -- # uname -s 00:08:55.777 16:33:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:55.777 16:33:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:55.777 16:33:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:55.777 16:33:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:55.777 16:33:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:55.777 16:33:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:55.777 16:33:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:55.777 16:33:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:55.777 16:33:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:55.777 16:33:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:55.777 16:33:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:55.777 16:33:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:55.777 16:33:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:55.777 16:33:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:55.777 16:33:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:55.777 16:33:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:55.777 16:33:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:55.777 16:33:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:55.777 16:33:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:55.777 16:33:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.777 16:33:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.777 16:33:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.777 16:33:21 -- paths/export.sh@5 -- # export PATH 00:08:55.777 16:33:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:55.777 16:33:21 -- nvmf/common.sh@46 -- # : 0 00:08:55.777 16:33:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:55.777 16:33:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:55.777 16:33:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:55.777 16:33:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:55.777 16:33:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:55.777 16:33:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:55.777 16:33:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:55.777 16:33:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:55.777 16:33:21 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:55.777 16:33:21 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:55.777 16:33:21 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:55.777 16:33:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:55.777 16:33:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:55.777 16:33:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:55.777 16:33:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:55.778 16:33:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:55.778 16:33:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.778 16:33:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.778 16:33:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:55.778 16:33:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:55.778 16:33:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:55.778 16:33:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:55.778 16:33:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.681 16:33:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:57.681 16:33:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:57.681 16:33:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:57.681 16:33:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:57.681 16:33:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:57.681 16:33:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:57.681 16:33:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:57.681 16:33:23 -- nvmf/common.sh@294 -- # net_devs=() 00:08:57.681 16:33:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:57.681 16:33:23 -- nvmf/common.sh@295 -- # e810=() 00:08:57.681 16:33:23 -- nvmf/common.sh@295 -- # local -ga e810 00:08:57.681 16:33:23 -- nvmf/common.sh@296 -- # x722=() 00:08:57.681 16:33:23 -- nvmf/common.sh@296 -- # local -ga x722 00:08:57.681 16:33:23 -- nvmf/common.sh@297 -- # mlx=() 00:08:57.681 16:33:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:57.681 16:33:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:57.681 16:33:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:57.681 16:33:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:57.681 16:33:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:57.681 16:33:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:57.681 16:33:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:57.681 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:57.681 16:33:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:57.681 16:33:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:57.681 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:57.681 16:33:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:57.681 16:33:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:57.681 16:33:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.681 16:33:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:57.681 16:33:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.681 16:33:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:57.681 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:57.681 16:33:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.681 16:33:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:57.681 16:33:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.681 16:33:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:57.681 16:33:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.681 16:33:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:57.681 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:57.681 16:33:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.681 16:33:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:57.681 16:33:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:57.681 16:33:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:57.681 16:33:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:57.682 16:33:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:57.682 16:33:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:57.682 16:33:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:57.682 16:33:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:57.682 16:33:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:57.682 16:33:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:57.682 16:33:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:57.682 16:33:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:57.682 16:33:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:57.682 16:33:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:57.682 16:33:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:57.682 16:33:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:57.682 16:33:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:57.940 16:33:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:57.940 16:33:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:57.940 16:33:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:57.940 16:33:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:57.940 16:33:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:57.940 16:33:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:57.940 16:33:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:57.940 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:57.940 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:08:57.940 00:08:57.940 --- 10.0.0.2 ping statistics --- 00:08:57.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:57.940 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:08:57.940 16:33:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:57.940 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:57.940 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:08:57.940 00:08:57.940 --- 10.0.0.1 ping statistics --- 00:08:57.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:57.940 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:08:57.940 16:33:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:57.940 16:33:23 -- nvmf/common.sh@410 -- # return 0 00:08:57.940 16:33:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:57.940 16:33:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:57.940 16:33:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:57.940 16:33:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:57.940 16:33:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:57.940 16:33:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:57.940 16:33:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:57.940 16:33:23 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:57.940 16:33:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:57.940 16:33:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:57.940 16:33:23 -- common/autotest_common.sh@10 -- # set +x 00:08:57.940 ************************************ 00:08:57.940 START TEST nvmf_filesystem_no_in_capsule 00:08:57.940 ************************************ 00:08:57.940 16:33:23 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:08:57.940 16:33:23 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:57.940 16:33:23 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:57.940 16:33:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:57.940 16:33:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:57.940 16:33:23 -- common/autotest_common.sh@10 -- # set +x 00:08:57.940 16:33:23 -- nvmf/common.sh@469 -- # nvmfpid=1099805 00:08:57.940 16:33:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:57.940 16:33:23 -- nvmf/common.sh@470 -- # waitforlisten 1099805 00:08:57.940 16:33:23 -- common/autotest_common.sh@819 -- # '[' -z 1099805 ']' 00:08:57.940 16:33:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:57.940 16:33:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:57.940 16:33:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:57.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:57.940 16:33:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:57.940 16:33:23 -- common/autotest_common.sh@10 -- # set +x 00:08:57.940 [2024-10-13 16:33:23.323334] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:08:57.940 [2024-10-13 16:33:23.323437] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:57.940 EAL: No free 2048 kB hugepages reported on node 1 00:08:57.940 [2024-10-13 16:33:23.391049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:58.199 [2024-10-13 16:33:23.481989] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:58.199 [2024-10-13 16:33:23.482150] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:58.199 [2024-10-13 16:33:23.482171] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:58.199 [2024-10-13 16:33:23.482185] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:58.199 [2024-10-13 16:33:23.482247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:58.199 [2024-10-13 16:33:23.482329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:58.199 [2024-10-13 16:33:23.482429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:58.199 [2024-10-13 16:33:23.482426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:59.133 16:33:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:59.133 16:33:24 -- common/autotest_common.sh@852 -- # return 0 00:08:59.133 16:33:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:59.133 16:33:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 16:33:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:59.133 16:33:24 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:59.133 16:33:24 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 [2024-10-13 16:33:24.307980] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 [2024-10-13 16:33:24.495855] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@1358 -- # local bdev_info 00:08:59.133 16:33:24 -- common/autotest_common.sh@1359 -- # local bs 00:08:59.133 16:33:24 -- common/autotest_common.sh@1360 -- # local nb 00:08:59.133 16:33:24 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:59.133 16:33:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:59.133 16:33:24 -- common/autotest_common.sh@10 -- # set +x 00:08:59.133 16:33:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:59.133 16:33:24 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:08:59.133 { 00:08:59.133 "name": "Malloc1", 00:08:59.133 "aliases": [ 00:08:59.133 "a16eeba2-9f57-4ae6-8b3a-8aa7b0f24e3c" 00:08:59.133 ], 00:08:59.133 "product_name": "Malloc disk", 00:08:59.133 "block_size": 512, 00:08:59.133 "num_blocks": 1048576, 00:08:59.133 "uuid": "a16eeba2-9f57-4ae6-8b3a-8aa7b0f24e3c", 00:08:59.133 "assigned_rate_limits": { 00:08:59.133 "rw_ios_per_sec": 0, 00:08:59.133 "rw_mbytes_per_sec": 0, 00:08:59.133 "r_mbytes_per_sec": 0, 00:08:59.133 "w_mbytes_per_sec": 0 00:08:59.133 }, 00:08:59.133 "claimed": true, 00:08:59.133 "claim_type": "exclusive_write", 00:08:59.133 "zoned": false, 00:08:59.133 "supported_io_types": { 00:08:59.133 "read": true, 00:08:59.133 "write": true, 00:08:59.133 "unmap": true, 00:08:59.133 "write_zeroes": true, 00:08:59.133 "flush": true, 00:08:59.133 "reset": true, 00:08:59.133 "compare": false, 00:08:59.133 "compare_and_write": false, 00:08:59.133 "abort": true, 00:08:59.133 "nvme_admin": false, 00:08:59.133 "nvme_io": false 00:08:59.133 }, 00:08:59.133 "memory_domains": [ 00:08:59.133 { 00:08:59.133 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:59.133 "dma_device_type": 2 00:08:59.133 } 00:08:59.133 ], 00:08:59.133 "driver_specific": {} 00:08:59.133 } 00:08:59.133 ]' 00:08:59.133 16:33:24 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:08:59.133 16:33:24 -- common/autotest_common.sh@1362 -- # bs=512 00:08:59.133 16:33:24 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:08:59.133 16:33:24 -- common/autotest_common.sh@1363 -- # nb=1048576 00:08:59.133 16:33:24 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:08:59.133 16:33:24 -- common/autotest_common.sh@1367 -- # echo 512 00:08:59.133 16:33:24 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:59.133 16:33:24 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:09:00.067 16:33:25 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:09:00.067 16:33:25 -- common/autotest_common.sh@1177 -- # local i=0 00:09:00.067 16:33:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:09:00.067 16:33:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:09:00.067 16:33:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:09:01.965 16:33:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:09:01.965 16:33:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:09:01.965 16:33:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:09:01.965 16:33:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:09:01.965 16:33:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:09:01.965 16:33:27 -- common/autotest_common.sh@1187 -- # return 0 00:09:01.965 16:33:27 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:09:01.965 16:33:27 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:09:01.965 16:33:27 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:09:01.965 16:33:27 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:09:01.965 16:33:27 -- setup/common.sh@76 -- # local dev=nvme0n1 00:09:01.965 16:33:27 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:09:01.965 16:33:27 -- setup/common.sh@80 -- # echo 536870912 00:09:01.965 16:33:27 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:09:01.965 16:33:27 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:09:01.965 16:33:27 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:09:01.965 16:33:27 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:09:02.223 16:33:27 -- target/filesystem.sh@69 -- # partprobe 00:09:02.481 16:33:27 -- target/filesystem.sh@70 -- # sleep 1 00:09:03.853 16:33:28 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:09:03.853 16:33:28 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:09:03.853 16:33:28 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:03.853 16:33:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:03.853 16:33:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.853 ************************************ 00:09:03.853 START TEST filesystem_ext4 00:09:03.853 ************************************ 00:09:03.853 16:33:28 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:09:03.853 16:33:28 -- target/filesystem.sh@18 -- # fstype=ext4 00:09:03.853 16:33:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:03.853 16:33:28 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:09:03.853 16:33:28 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:09:03.853 16:33:28 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:03.853 16:33:28 -- common/autotest_common.sh@904 -- # local i=0 00:09:03.853 16:33:28 -- common/autotest_common.sh@905 -- # local force 00:09:03.853 16:33:28 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:09:03.853 16:33:28 -- common/autotest_common.sh@908 -- # force=-F 00:09:03.853 16:33:28 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:09:03.853 mke2fs 1.47.0 (5-Feb-2023) 00:09:03.853 Discarding device blocks: 0/522240 done 00:09:03.853 Creating filesystem with 522240 1k blocks and 130560 inodes 00:09:03.853 Filesystem UUID: b62153e5-8c18-463e-93a0-975f71439470 00:09:03.853 Superblock backups stored on blocks: 00:09:03.853 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:09:03.853 00:09:03.853 Allocating group tables: 0/64 done 00:09:03.853 Writing inode tables: 0/64 done 00:09:04.786 Creating journal (8192 blocks): done 00:09:04.786 Writing superblocks and filesystem accounting information: 0/64 done 00:09:04.786 00:09:04.786 16:33:30 -- common/autotest_common.sh@921 -- # return 0 00:09:04.786 16:33:30 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:10.045 16:33:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:10.045 16:33:35 -- target/filesystem.sh@25 -- # sync 00:09:10.045 16:33:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:10.045 16:33:35 -- target/filesystem.sh@27 -- # sync 00:09:10.045 16:33:35 -- target/filesystem.sh@29 -- # i=0 00:09:10.045 16:33:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:10.303 16:33:35 -- target/filesystem.sh@37 -- # kill -0 1099805 00:09:10.303 16:33:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:10.303 16:33:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:10.303 16:33:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:10.303 16:33:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:10.303 00:09:10.303 real 0m6.675s 00:09:10.303 user 0m0.022s 00:09:10.303 sys 0m0.065s 00:09:10.303 16:33:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:10.303 16:33:35 -- common/autotest_common.sh@10 -- # set +x 00:09:10.303 ************************************ 00:09:10.303 END TEST filesystem_ext4 00:09:10.303 ************************************ 00:09:10.303 16:33:35 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:09:10.303 16:33:35 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:10.303 16:33:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:10.303 16:33:35 -- common/autotest_common.sh@10 -- # set +x 00:09:10.303 ************************************ 00:09:10.303 START TEST filesystem_btrfs 00:09:10.303 ************************************ 00:09:10.303 16:33:35 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:09:10.303 16:33:35 -- target/filesystem.sh@18 -- # fstype=btrfs 00:09:10.303 16:33:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:10.303 16:33:35 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:09:10.303 16:33:35 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:09:10.303 16:33:35 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:10.303 16:33:35 -- common/autotest_common.sh@904 -- # local i=0 00:09:10.303 16:33:35 -- common/autotest_common.sh@905 -- # local force 00:09:10.303 16:33:35 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:09:10.303 16:33:35 -- common/autotest_common.sh@910 -- # force=-f 00:09:10.303 16:33:35 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:09:10.561 btrfs-progs v6.8.1 00:09:10.561 See https://btrfs.readthedocs.io for more information. 00:09:10.561 00:09:10.561 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:09:10.561 NOTE: several default settings have changed in version 5.15, please make sure 00:09:10.561 this does not affect your deployments: 00:09:10.561 - DUP for metadata (-m dup) 00:09:10.561 - enabled no-holes (-O no-holes) 00:09:10.561 - enabled free-space-tree (-R free-space-tree) 00:09:10.561 00:09:10.561 Label: (null) 00:09:10.561 UUID: de91996f-a378-4e51-a64e-ff727db6ffd2 00:09:10.561 Node size: 16384 00:09:10.561 Sector size: 4096 (CPU page size: 4096) 00:09:10.561 Filesystem size: 510.00MiB 00:09:10.561 Block group profiles: 00:09:10.561 Data: single 8.00MiB 00:09:10.561 Metadata: DUP 32.00MiB 00:09:10.561 System: DUP 8.00MiB 00:09:10.561 SSD detected: yes 00:09:10.561 Zoned device: no 00:09:10.561 Features: extref, skinny-metadata, no-holes, free-space-tree 00:09:10.561 Checksum: crc32c 00:09:10.561 Number of devices: 1 00:09:10.561 Devices: 00:09:10.561 ID SIZE PATH 00:09:10.561 1 510.00MiB /dev/nvme0n1p1 00:09:10.561 00:09:10.561 16:33:35 -- common/autotest_common.sh@921 -- # return 0 00:09:10.561 16:33:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:10.819 16:33:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:10.819 16:33:36 -- target/filesystem.sh@25 -- # sync 00:09:10.819 16:33:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:10.819 16:33:36 -- target/filesystem.sh@27 -- # sync 00:09:10.819 16:33:36 -- target/filesystem.sh@29 -- # i=0 00:09:10.819 16:33:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:10.819 16:33:36 -- target/filesystem.sh@37 -- # kill -0 1099805 00:09:10.819 16:33:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:10.819 16:33:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:10.819 16:33:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:10.819 16:33:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:10.819 00:09:10.819 real 0m0.624s 00:09:10.819 user 0m0.019s 00:09:10.819 sys 0m0.100s 00:09:10.819 16:33:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:10.819 16:33:36 -- common/autotest_common.sh@10 -- # set +x 00:09:10.819 ************************************ 00:09:10.819 END TEST filesystem_btrfs 00:09:10.819 ************************************ 00:09:10.819 16:33:36 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:09:10.819 16:33:36 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:10.819 16:33:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:10.819 16:33:36 -- common/autotest_common.sh@10 -- # set +x 00:09:10.819 ************************************ 00:09:10.819 START TEST filesystem_xfs 00:09:10.819 ************************************ 00:09:10.819 16:33:36 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:09:10.819 16:33:36 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:10.819 16:33:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:10.819 16:33:36 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:10.819 16:33:36 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:09:10.819 16:33:36 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:10.819 16:33:36 -- common/autotest_common.sh@904 -- # local i=0 00:09:10.819 16:33:36 -- common/autotest_common.sh@905 -- # local force 00:09:10.819 16:33:36 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:09:10.819 16:33:36 -- common/autotest_common.sh@910 -- # force=-f 00:09:10.819 16:33:36 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:11.077 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:11.077 = sectsz=512 attr=2, projid32bit=1 00:09:11.077 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:11.077 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:11.077 data = bsize=4096 blocks=130560, imaxpct=25 00:09:11.077 = sunit=0 swidth=0 blks 00:09:11.077 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:11.077 log =internal log bsize=4096 blocks=16384, version=2 00:09:11.077 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:11.077 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:11.643 Discarding blocks...Done. 00:09:11.643 16:33:37 -- common/autotest_common.sh@921 -- # return 0 00:09:11.643 16:33:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:13.537 16:33:38 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:13.537 16:33:38 -- target/filesystem.sh@25 -- # sync 00:09:13.537 16:33:38 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:13.537 16:33:38 -- target/filesystem.sh@27 -- # sync 00:09:13.537 16:33:38 -- target/filesystem.sh@29 -- # i=0 00:09:13.537 16:33:38 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:13.537 16:33:38 -- target/filesystem.sh@37 -- # kill -0 1099805 00:09:13.537 16:33:38 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:13.537 16:33:38 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:13.537 16:33:38 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:13.537 16:33:38 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:13.537 00:09:13.537 real 0m2.684s 00:09:13.537 user 0m0.020s 00:09:13.537 sys 0m0.055s 00:09:13.537 16:33:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:13.537 16:33:38 -- common/autotest_common.sh@10 -- # set +x 00:09:13.537 ************************************ 00:09:13.537 END TEST filesystem_xfs 00:09:13.537 ************************************ 00:09:13.537 16:33:38 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:13.537 16:33:38 -- target/filesystem.sh@93 -- # sync 00:09:13.537 16:33:38 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:13.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.795 16:33:39 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:13.795 16:33:39 -- common/autotest_common.sh@1198 -- # local i=0 00:09:13.795 16:33:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:09:13.795 16:33:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:13.795 16:33:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:09:13.795 16:33:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:13.795 16:33:39 -- common/autotest_common.sh@1210 -- # return 0 00:09:13.795 16:33:39 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:13.795 16:33:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:13.795 16:33:39 -- common/autotest_common.sh@10 -- # set +x 00:09:13.795 16:33:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:13.795 16:33:39 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:13.795 16:33:39 -- target/filesystem.sh@101 -- # killprocess 1099805 00:09:13.795 16:33:39 -- common/autotest_common.sh@926 -- # '[' -z 1099805 ']' 00:09:13.795 16:33:39 -- common/autotest_common.sh@930 -- # kill -0 1099805 00:09:13.795 16:33:39 -- common/autotest_common.sh@931 -- # uname 00:09:13.795 16:33:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:09:13.795 16:33:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1099805 00:09:13.795 16:33:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:09:13.795 16:33:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:09:13.795 16:33:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1099805' 00:09:13.795 killing process with pid 1099805 00:09:13.795 16:33:39 -- common/autotest_common.sh@945 -- # kill 1099805 00:09:13.795 16:33:39 -- common/autotest_common.sh@950 -- # wait 1099805 00:09:14.360 16:33:39 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:14.360 00:09:14.360 real 0m16.326s 00:09:14.360 user 1m3.196s 00:09:14.360 sys 0m2.156s 00:09:14.360 16:33:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:14.361 16:33:39 -- common/autotest_common.sh@10 -- # set +x 00:09:14.361 ************************************ 00:09:14.361 END TEST nvmf_filesystem_no_in_capsule 00:09:14.361 ************************************ 00:09:14.361 16:33:39 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:09:14.361 16:33:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:09:14.361 16:33:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:14.361 16:33:39 -- common/autotest_common.sh@10 -- # set +x 00:09:14.361 ************************************ 00:09:14.361 START TEST nvmf_filesystem_in_capsule 00:09:14.361 ************************************ 00:09:14.361 16:33:39 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:09:14.361 16:33:39 -- target/filesystem.sh@47 -- # in_capsule=4096 00:09:14.361 16:33:39 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:09:14.361 16:33:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:14.361 16:33:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:09:14.361 16:33:39 -- common/autotest_common.sh@10 -- # set +x 00:09:14.361 16:33:39 -- nvmf/common.sh@469 -- # nvmfpid=1101963 00:09:14.361 16:33:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:14.361 16:33:39 -- nvmf/common.sh@470 -- # waitforlisten 1101963 00:09:14.361 16:33:39 -- common/autotest_common.sh@819 -- # '[' -z 1101963 ']' 00:09:14.361 16:33:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:14.361 16:33:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:09:14.361 16:33:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:14.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:14.361 16:33:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:09:14.361 16:33:39 -- common/autotest_common.sh@10 -- # set +x 00:09:14.361 [2024-10-13 16:33:39.675789] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:09:14.361 [2024-10-13 16:33:39.675888] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:14.361 EAL: No free 2048 kB hugepages reported on node 1 00:09:14.361 [2024-10-13 16:33:39.741994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:14.361 [2024-10-13 16:33:39.829795] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:14.361 [2024-10-13 16:33:39.829954] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:14.361 [2024-10-13 16:33:39.829973] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:14.361 [2024-10-13 16:33:39.829985] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:14.361 [2024-10-13 16:33:39.830053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:14.361 [2024-10-13 16:33:39.830124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:14.361 [2024-10-13 16:33:39.830184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:14.361 [2024-10-13 16:33:39.830186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:15.294 16:33:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:09:15.294 16:33:40 -- common/autotest_common.sh@852 -- # return 0 00:09:15.294 16:33:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:15.294 16:33:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:09:15.294 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.294 16:33:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:15.294 16:33:40 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:09:15.294 16:33:40 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:09:15.294 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.294 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.294 [2024-10-13 16:33:40.728260] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:15.294 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.294 16:33:40 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:09:15.294 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.294 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.552 Malloc1 00:09:15.552 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.552 16:33:40 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:15.552 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.552 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.552 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.552 16:33:40 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:15.552 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.552 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.552 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.552 16:33:40 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:15.552 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.552 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.552 [2024-10-13 16:33:40.905430] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:15.552 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.552 16:33:40 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:09:15.552 16:33:40 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:09:15.552 16:33:40 -- common/autotest_common.sh@1358 -- # local bdev_info 00:09:15.552 16:33:40 -- common/autotest_common.sh@1359 -- # local bs 00:09:15.552 16:33:40 -- common/autotest_common.sh@1360 -- # local nb 00:09:15.552 16:33:40 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:09:15.552 16:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:15.552 16:33:40 -- common/autotest_common.sh@10 -- # set +x 00:09:15.552 16:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:15.552 16:33:40 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:09:15.552 { 00:09:15.552 "name": "Malloc1", 00:09:15.552 "aliases": [ 00:09:15.552 "c875be4e-2264-41c3-afbd-4a58fc47add6" 00:09:15.552 ], 00:09:15.552 "product_name": "Malloc disk", 00:09:15.552 "block_size": 512, 00:09:15.552 "num_blocks": 1048576, 00:09:15.552 "uuid": "c875be4e-2264-41c3-afbd-4a58fc47add6", 00:09:15.552 "assigned_rate_limits": { 00:09:15.552 "rw_ios_per_sec": 0, 00:09:15.553 "rw_mbytes_per_sec": 0, 00:09:15.553 "r_mbytes_per_sec": 0, 00:09:15.553 "w_mbytes_per_sec": 0 00:09:15.553 }, 00:09:15.553 "claimed": true, 00:09:15.553 "claim_type": "exclusive_write", 00:09:15.553 "zoned": false, 00:09:15.553 "supported_io_types": { 00:09:15.553 "read": true, 00:09:15.553 "write": true, 00:09:15.553 "unmap": true, 00:09:15.553 "write_zeroes": true, 00:09:15.553 "flush": true, 00:09:15.553 "reset": true, 00:09:15.553 "compare": false, 00:09:15.553 "compare_and_write": false, 00:09:15.553 "abort": true, 00:09:15.553 "nvme_admin": false, 00:09:15.553 "nvme_io": false 00:09:15.553 }, 00:09:15.553 "memory_domains": [ 00:09:15.553 { 00:09:15.553 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:09:15.553 "dma_device_type": 2 00:09:15.553 } 00:09:15.553 ], 00:09:15.553 "driver_specific": {} 00:09:15.553 } 00:09:15.553 ]' 00:09:15.553 16:33:40 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:09:15.553 16:33:40 -- common/autotest_common.sh@1362 -- # bs=512 00:09:15.553 16:33:40 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:09:15.553 16:33:41 -- common/autotest_common.sh@1363 -- # nb=1048576 00:09:15.553 16:33:41 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:09:15.553 16:33:41 -- common/autotest_common.sh@1367 -- # echo 512 00:09:15.553 16:33:41 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:09:15.553 16:33:41 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:09:16.485 16:33:41 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:09:16.485 16:33:41 -- common/autotest_common.sh@1177 -- # local i=0 00:09:16.485 16:33:41 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:09:16.485 16:33:41 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:09:16.485 16:33:41 -- common/autotest_common.sh@1184 -- # sleep 2 00:09:18.383 16:33:43 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:09:18.383 16:33:43 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:09:18.383 16:33:43 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:09:18.383 16:33:43 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:09:18.383 16:33:43 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:09:18.383 16:33:43 -- common/autotest_common.sh@1187 -- # return 0 00:09:18.383 16:33:43 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:09:18.383 16:33:43 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:09:18.383 16:33:43 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:09:18.383 16:33:43 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:09:18.383 16:33:43 -- setup/common.sh@76 -- # local dev=nvme0n1 00:09:18.383 16:33:43 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:09:18.383 16:33:43 -- setup/common.sh@80 -- # echo 536870912 00:09:18.383 16:33:43 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:09:18.383 16:33:43 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:09:18.383 16:33:43 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:09:18.383 16:33:43 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:09:18.383 16:33:43 -- target/filesystem.sh@69 -- # partprobe 00:09:19.316 16:33:44 -- target/filesystem.sh@70 -- # sleep 1 00:09:20.248 16:33:45 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:09:20.248 16:33:45 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:09:20.248 16:33:45 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:20.248 16:33:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:20.248 16:33:45 -- common/autotest_common.sh@10 -- # set +x 00:09:20.248 ************************************ 00:09:20.248 START TEST filesystem_in_capsule_ext4 00:09:20.248 ************************************ 00:09:20.248 16:33:45 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:09:20.248 16:33:45 -- target/filesystem.sh@18 -- # fstype=ext4 00:09:20.248 16:33:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:20.248 16:33:45 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:09:20.248 16:33:45 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:09:20.248 16:33:45 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:20.248 16:33:45 -- common/autotest_common.sh@904 -- # local i=0 00:09:20.248 16:33:45 -- common/autotest_common.sh@905 -- # local force 00:09:20.248 16:33:45 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:09:20.248 16:33:45 -- common/autotest_common.sh@908 -- # force=-F 00:09:20.248 16:33:45 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:09:20.248 mke2fs 1.47.0 (5-Feb-2023) 00:09:20.248 Discarding device blocks: 0/522240 done 00:09:20.248 Creating filesystem with 522240 1k blocks and 130560 inodes 00:09:20.248 Filesystem UUID: e9d5639c-03d8-4171-8de5-b272e5870e36 00:09:20.248 Superblock backups stored on blocks: 00:09:20.248 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:09:20.248 00:09:20.248 Allocating group tables: 0/64 done 00:09:20.248 Writing inode tables: 0/64 done 00:09:21.239 Creating journal (8192 blocks): done 00:09:23.180 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:09:23.180 00:09:23.180 16:33:48 -- common/autotest_common.sh@921 -- # return 0 00:09:23.180 16:33:48 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:29.734 16:33:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:29.734 16:33:54 -- target/filesystem.sh@25 -- # sync 00:09:29.734 16:33:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:29.734 16:33:54 -- target/filesystem.sh@27 -- # sync 00:09:29.734 16:33:54 -- target/filesystem.sh@29 -- # i=0 00:09:29.734 16:33:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:29.734 16:33:54 -- target/filesystem.sh@37 -- # kill -0 1101963 00:09:29.734 16:33:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:29.734 16:33:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:29.734 16:33:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:29.734 16:33:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:29.734 00:09:29.734 real 0m8.877s 00:09:29.734 user 0m0.028s 00:09:29.734 sys 0m0.059s 00:09:29.734 16:33:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:29.734 16:33:54 -- common/autotest_common.sh@10 -- # set +x 00:09:29.734 ************************************ 00:09:29.734 END TEST filesystem_in_capsule_ext4 00:09:29.734 ************************************ 00:09:29.734 16:33:54 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:09:29.734 16:33:54 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:29.734 16:33:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:29.734 16:33:54 -- common/autotest_common.sh@10 -- # set +x 00:09:29.734 ************************************ 00:09:29.734 START TEST filesystem_in_capsule_btrfs 00:09:29.734 ************************************ 00:09:29.734 16:33:54 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:09:29.734 16:33:54 -- target/filesystem.sh@18 -- # fstype=btrfs 00:09:29.734 16:33:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:29.734 16:33:54 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:09:29.734 16:33:54 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:09:29.734 16:33:54 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:29.734 16:33:54 -- common/autotest_common.sh@904 -- # local i=0 00:09:29.734 16:33:54 -- common/autotest_common.sh@905 -- # local force 00:09:29.734 16:33:54 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:09:29.734 16:33:54 -- common/autotest_common.sh@910 -- # force=-f 00:09:29.734 16:33:54 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:09:29.734 btrfs-progs v6.8.1 00:09:29.734 See https://btrfs.readthedocs.io for more information. 00:09:29.734 00:09:29.734 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:09:29.734 NOTE: several default settings have changed in version 5.15, please make sure 00:09:29.734 this does not affect your deployments: 00:09:29.734 - DUP for metadata (-m dup) 00:09:29.734 - enabled no-holes (-O no-holes) 00:09:29.734 - enabled free-space-tree (-R free-space-tree) 00:09:29.734 00:09:29.734 Label: (null) 00:09:29.734 UUID: f8804b2e-a36b-4471-8b1e-0e5b95057ef8 00:09:29.734 Node size: 16384 00:09:29.734 Sector size: 4096 (CPU page size: 4096) 00:09:29.734 Filesystem size: 510.00MiB 00:09:29.734 Block group profiles: 00:09:29.734 Data: single 8.00MiB 00:09:29.734 Metadata: DUP 32.00MiB 00:09:29.734 System: DUP 8.00MiB 00:09:29.734 SSD detected: yes 00:09:29.734 Zoned device: no 00:09:29.734 Features: extref, skinny-metadata, no-holes, free-space-tree 00:09:29.734 Checksum: crc32c 00:09:29.734 Number of devices: 1 00:09:29.734 Devices: 00:09:29.734 ID SIZE PATH 00:09:29.734 1 510.00MiB /dev/nvme0n1p1 00:09:29.734 00:09:29.734 16:33:54 -- common/autotest_common.sh@921 -- # return 0 00:09:29.734 16:33:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:29.992 16:33:55 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:29.992 16:33:55 -- target/filesystem.sh@25 -- # sync 00:09:29.992 16:33:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:29.992 16:33:55 -- target/filesystem.sh@27 -- # sync 00:09:29.992 16:33:55 -- target/filesystem.sh@29 -- # i=0 00:09:29.992 16:33:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:29.992 16:33:55 -- target/filesystem.sh@37 -- # kill -0 1101963 00:09:29.993 16:33:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:29.993 16:33:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:29.993 16:33:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:29.993 16:33:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:29.993 00:09:29.993 real 0m0.955s 00:09:29.993 user 0m0.021s 00:09:29.993 sys 0m0.102s 00:09:29.993 16:33:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:29.993 16:33:55 -- common/autotest_common.sh@10 -- # set +x 00:09:29.993 ************************************ 00:09:29.993 END TEST filesystem_in_capsule_btrfs 00:09:29.993 ************************************ 00:09:29.993 16:33:55 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:09:29.993 16:33:55 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:09:29.993 16:33:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:29.993 16:33:55 -- common/autotest_common.sh@10 -- # set +x 00:09:29.993 ************************************ 00:09:29.993 START TEST filesystem_in_capsule_xfs 00:09:29.993 ************************************ 00:09:29.993 16:33:55 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:09:29.993 16:33:55 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:29.993 16:33:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:29.993 16:33:55 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:29.993 16:33:55 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:09:29.993 16:33:55 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:09:29.993 16:33:55 -- common/autotest_common.sh@904 -- # local i=0 00:09:29.993 16:33:55 -- common/autotest_common.sh@905 -- # local force 00:09:29.993 16:33:55 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:09:29.993 16:33:55 -- common/autotest_common.sh@910 -- # force=-f 00:09:29.993 16:33:55 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:30.251 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:30.251 = sectsz=512 attr=2, projid32bit=1 00:09:30.251 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:30.251 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:30.251 data = bsize=4096 blocks=130560, imaxpct=25 00:09:30.251 = sunit=0 swidth=0 blks 00:09:30.251 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:30.251 log =internal log bsize=4096 blocks=16384, version=2 00:09:30.251 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:30.251 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:30.816 Discarding blocks...Done. 00:09:30.816 16:33:56 -- common/autotest_common.sh@921 -- # return 0 00:09:30.816 16:33:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:32.714 16:33:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:32.714 16:33:58 -- target/filesystem.sh@25 -- # sync 00:09:32.714 16:33:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:32.714 16:33:58 -- target/filesystem.sh@27 -- # sync 00:09:32.714 16:33:58 -- target/filesystem.sh@29 -- # i=0 00:09:32.714 16:33:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:32.714 16:33:58 -- target/filesystem.sh@37 -- # kill -0 1101963 00:09:32.714 16:33:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:32.714 16:33:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:32.714 16:33:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:32.714 16:33:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:32.714 00:09:32.714 real 0m2.690s 00:09:32.714 user 0m0.013s 00:09:32.714 sys 0m0.060s 00:09:32.714 16:33:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:32.714 16:33:58 -- common/autotest_common.sh@10 -- # set +x 00:09:32.714 ************************************ 00:09:32.714 END TEST filesystem_in_capsule_xfs 00:09:32.714 ************************************ 00:09:32.714 16:33:58 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:32.714 16:33:58 -- target/filesystem.sh@93 -- # sync 00:09:32.714 16:33:58 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:32.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.714 16:33:58 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:32.714 16:33:58 -- common/autotest_common.sh@1198 -- # local i=0 00:09:32.714 16:33:58 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:09:32.714 16:33:58 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:32.971 16:33:58 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:09:32.971 16:33:58 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:32.971 16:33:58 -- common/autotest_common.sh@1210 -- # return 0 00:09:32.971 16:33:58 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:32.971 16:33:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:32.971 16:33:58 -- common/autotest_common.sh@10 -- # set +x 00:09:32.971 16:33:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:32.971 16:33:58 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:32.971 16:33:58 -- target/filesystem.sh@101 -- # killprocess 1101963 00:09:32.971 16:33:58 -- common/autotest_common.sh@926 -- # '[' -z 1101963 ']' 00:09:32.971 16:33:58 -- common/autotest_common.sh@930 -- # kill -0 1101963 00:09:32.971 16:33:58 -- common/autotest_common.sh@931 -- # uname 00:09:32.971 16:33:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:09:32.971 16:33:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1101963 00:09:32.972 16:33:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:09:32.972 16:33:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:09:32.972 16:33:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1101963' 00:09:32.972 killing process with pid 1101963 00:09:32.972 16:33:58 -- common/autotest_common.sh@945 -- # kill 1101963 00:09:32.972 16:33:58 -- common/autotest_common.sh@950 -- # wait 1101963 00:09:33.230 16:33:58 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:33.230 00:09:33.230 real 0m19.080s 00:09:33.230 user 1m14.136s 00:09:33.230 sys 0m2.279s 00:09:33.230 16:33:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:33.230 16:33:58 -- common/autotest_common.sh@10 -- # set +x 00:09:33.230 ************************************ 00:09:33.230 END TEST nvmf_filesystem_in_capsule 00:09:33.230 ************************************ 00:09:33.489 16:33:58 -- target/filesystem.sh@108 -- # nvmftestfini 00:09:33.489 16:33:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:33.489 16:33:58 -- nvmf/common.sh@116 -- # sync 00:09:33.489 16:33:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:33.489 16:33:58 -- nvmf/common.sh@119 -- # set +e 00:09:33.489 16:33:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:33.489 16:33:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:33.489 rmmod nvme_tcp 00:09:33.489 rmmod nvme_fabrics 00:09:33.489 rmmod nvme_keyring 00:09:33.489 16:33:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:33.489 16:33:58 -- nvmf/common.sh@123 -- # set -e 00:09:33.489 16:33:58 -- nvmf/common.sh@124 -- # return 0 00:09:33.489 16:33:58 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:09:33.489 16:33:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:33.489 16:33:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:33.489 16:33:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:33.489 16:33:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:33.489 16:33:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:33.489 16:33:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:33.489 16:33:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:33.489 16:33:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:35.392 16:34:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:35.392 00:09:35.392 real 0m39.832s 00:09:35.392 user 2m18.235s 00:09:35.392 sys 0m5.974s 00:09:35.392 16:34:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:35.392 16:34:00 -- common/autotest_common.sh@10 -- # set +x 00:09:35.392 ************************************ 00:09:35.392 END TEST nvmf_filesystem 00:09:35.392 ************************************ 00:09:35.392 16:34:00 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:35.392 16:34:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:09:35.392 16:34:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:35.392 16:34:00 -- common/autotest_common.sh@10 -- # set +x 00:09:35.392 ************************************ 00:09:35.392 START TEST nvmf_discovery 00:09:35.392 ************************************ 00:09:35.392 16:34:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:35.651 * Looking for test storage... 00:09:35.651 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:35.651 16:34:00 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:35.651 16:34:00 -- nvmf/common.sh@7 -- # uname -s 00:09:35.651 16:34:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:35.651 16:34:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:35.651 16:34:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:35.651 16:34:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:35.651 16:34:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:35.651 16:34:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:35.651 16:34:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:35.651 16:34:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:35.651 16:34:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:35.651 16:34:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:35.651 16:34:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:35.651 16:34:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:35.651 16:34:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:35.651 16:34:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:35.651 16:34:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:35.651 16:34:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:35.651 16:34:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:35.651 16:34:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:35.651 16:34:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:35.651 16:34:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:35.651 16:34:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:35.651 16:34:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:35.651 16:34:00 -- paths/export.sh@5 -- # export PATH 00:09:35.651 16:34:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:35.651 16:34:00 -- nvmf/common.sh@46 -- # : 0 00:09:35.651 16:34:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:35.651 16:34:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:35.651 16:34:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:35.651 16:34:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:35.651 16:34:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:35.651 16:34:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:35.651 16:34:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:35.651 16:34:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:35.651 16:34:00 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:09:35.651 16:34:00 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:09:35.651 16:34:00 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:09:35.651 16:34:00 -- target/discovery.sh@15 -- # hash nvme 00:09:35.651 16:34:00 -- target/discovery.sh@20 -- # nvmftestinit 00:09:35.651 16:34:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:35.651 16:34:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:35.651 16:34:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:35.651 16:34:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:35.651 16:34:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:35.651 16:34:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:35.651 16:34:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:35.651 16:34:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:35.651 16:34:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:35.651 16:34:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:35.651 16:34:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:35.651 16:34:00 -- common/autotest_common.sh@10 -- # set +x 00:09:37.553 16:34:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:37.553 16:34:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:37.553 16:34:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:37.553 16:34:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:37.553 16:34:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:37.553 16:34:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:37.553 16:34:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:37.553 16:34:02 -- nvmf/common.sh@294 -- # net_devs=() 00:09:37.553 16:34:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:37.553 16:34:02 -- nvmf/common.sh@295 -- # e810=() 00:09:37.553 16:34:02 -- nvmf/common.sh@295 -- # local -ga e810 00:09:37.553 16:34:02 -- nvmf/common.sh@296 -- # x722=() 00:09:37.553 16:34:02 -- nvmf/common.sh@296 -- # local -ga x722 00:09:37.553 16:34:02 -- nvmf/common.sh@297 -- # mlx=() 00:09:37.553 16:34:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:37.553 16:34:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:37.553 16:34:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:37.553 16:34:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:37.553 16:34:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:37.553 16:34:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:37.553 16:34:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:37.553 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:37.553 16:34:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:37.553 16:34:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:37.553 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:37.553 16:34:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:37.553 16:34:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:37.553 16:34:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:37.553 16:34:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:37.553 16:34:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:37.553 16:34:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:37.553 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:37.553 16:34:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:37.553 16:34:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:37.553 16:34:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:37.553 16:34:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:37.553 16:34:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:37.553 16:34:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:37.553 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:37.553 16:34:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:37.553 16:34:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:37.553 16:34:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:37.553 16:34:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:37.553 16:34:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:37.553 16:34:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:37.554 16:34:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:37.554 16:34:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:37.554 16:34:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:37.554 16:34:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:37.554 16:34:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:37.554 16:34:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:37.554 16:34:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:37.554 16:34:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:37.554 16:34:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:37.554 16:34:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:37.554 16:34:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:37.554 16:34:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:37.554 16:34:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:37.554 16:34:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:37.554 16:34:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:37.554 16:34:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:37.554 16:34:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:37.554 16:34:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:37.554 16:34:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:37.554 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:37.554 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:09:37.554 00:09:37.554 --- 10.0.0.2 ping statistics --- 00:09:37.554 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:37.554 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:09:37.554 16:34:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:37.554 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:37.554 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:09:37.554 00:09:37.812 --- 10.0.0.1 ping statistics --- 00:09:37.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:37.812 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:09:37.812 16:34:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:37.812 16:34:03 -- nvmf/common.sh@410 -- # return 0 00:09:37.812 16:34:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:37.812 16:34:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:37.812 16:34:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:37.812 16:34:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:37.812 16:34:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:37.812 16:34:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:37.812 16:34:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:37.812 16:34:03 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:37.812 16:34:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:37.812 16:34:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:09:37.812 16:34:03 -- common/autotest_common.sh@10 -- # set +x 00:09:37.812 16:34:03 -- nvmf/common.sh@469 -- # nvmfpid=1106460 00:09:37.812 16:34:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:37.812 16:34:03 -- nvmf/common.sh@470 -- # waitforlisten 1106460 00:09:37.812 16:34:03 -- common/autotest_common.sh@819 -- # '[' -z 1106460 ']' 00:09:37.812 16:34:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:37.812 16:34:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:09:37.812 16:34:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:37.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:37.812 16:34:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:09:37.812 16:34:03 -- common/autotest_common.sh@10 -- # set +x 00:09:37.812 [2024-10-13 16:34:03.129690] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:09:37.812 [2024-10-13 16:34:03.129771] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:37.812 EAL: No free 2048 kB hugepages reported on node 1 00:09:37.812 [2024-10-13 16:34:03.205092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:37.812 [2024-10-13 16:34:03.302126] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:37.812 [2024-10-13 16:34:03.302286] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:37.812 [2024-10-13 16:34:03.302303] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:37.812 [2024-10-13 16:34:03.302324] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:37.812 [2024-10-13 16:34:03.302387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:37.812 [2024-10-13 16:34:03.302423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:37.812 [2024-10-13 16:34:03.302483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:37.812 [2024-10-13 16:34:03.302486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:38.761 16:34:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:09:38.761 16:34:04 -- common/autotest_common.sh@852 -- # return 0 00:09:38.761 16:34:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:38.761 16:34:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:38.761 16:34:04 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 [2024-10-13 16:34:04.168131] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@26 -- # seq 1 4 00:09:38.761 16:34:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:38.761 16:34:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 Null1 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 [2024-10-13 16:34:04.208428] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:38.761 16:34:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 Null2 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:38.761 16:34:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 Null3 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.761 16:34:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:38.761 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.761 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:38.761 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:38.762 16:34:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:38.762 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:38.762 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:39.019 16:34:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 Null4 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:09:39.019 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.019 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.019 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.019 16:34:04 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:09:39.277 00:09:39.277 Discovery Log Number of Records 6, Generation counter 6 00:09:39.277 =====Discovery Log Entry 0====== 00:09:39.277 trtype: tcp 00:09:39.277 adrfam: ipv4 00:09:39.277 subtype: current discovery subsystem 00:09:39.277 treq: not required 00:09:39.277 portid: 0 00:09:39.277 trsvcid: 4420 00:09:39.278 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: explicit discovery connections, duplicate discovery information 00:09:39.278 sectype: none 00:09:39.278 =====Discovery Log Entry 1====== 00:09:39.278 trtype: tcp 00:09:39.278 adrfam: ipv4 00:09:39.278 subtype: nvme subsystem 00:09:39.278 treq: not required 00:09:39.278 portid: 0 00:09:39.278 trsvcid: 4420 00:09:39.278 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: none 00:09:39.278 sectype: none 00:09:39.278 =====Discovery Log Entry 2====== 00:09:39.278 trtype: tcp 00:09:39.278 adrfam: ipv4 00:09:39.278 subtype: nvme subsystem 00:09:39.278 treq: not required 00:09:39.278 portid: 0 00:09:39.278 trsvcid: 4420 00:09:39.278 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: none 00:09:39.278 sectype: none 00:09:39.278 =====Discovery Log Entry 3====== 00:09:39.278 trtype: tcp 00:09:39.278 adrfam: ipv4 00:09:39.278 subtype: nvme subsystem 00:09:39.278 treq: not required 00:09:39.278 portid: 0 00:09:39.278 trsvcid: 4420 00:09:39.278 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: none 00:09:39.278 sectype: none 00:09:39.278 =====Discovery Log Entry 4====== 00:09:39.278 trtype: tcp 00:09:39.278 adrfam: ipv4 00:09:39.278 subtype: nvme subsystem 00:09:39.278 treq: not required 00:09:39.278 portid: 0 00:09:39.278 trsvcid: 4420 00:09:39.278 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: none 00:09:39.278 sectype: none 00:09:39.278 =====Discovery Log Entry 5====== 00:09:39.278 trtype: tcp 00:09:39.278 adrfam: ipv4 00:09:39.278 subtype: discovery subsystem referral 00:09:39.278 treq: not required 00:09:39.278 portid: 0 00:09:39.278 trsvcid: 4430 00:09:39.278 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:39.278 traddr: 10.0.0.2 00:09:39.278 eflags: none 00:09:39.278 sectype: none 00:09:39.278 16:34:04 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:39.278 Perform nvmf subsystem discovery via RPC 00:09:39.278 16:34:04 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 [2024-10-13 16:34:04.541351] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:39.278 [ 00:09:39.278 { 00:09:39.278 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:39.278 "subtype": "Discovery", 00:09:39.278 "listen_addresses": [ 00:09:39.278 { 00:09:39.278 "transport": "TCP", 00:09:39.278 "trtype": "TCP", 00:09:39.278 "adrfam": "IPv4", 00:09:39.278 "traddr": "10.0.0.2", 00:09:39.278 "trsvcid": "4420" 00:09:39.278 } 00:09:39.278 ], 00:09:39.278 "allow_any_host": true, 00:09:39.278 "hosts": [] 00:09:39.278 }, 00:09:39.278 { 00:09:39.278 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:39.278 "subtype": "NVMe", 00:09:39.278 "listen_addresses": [ 00:09:39.278 { 00:09:39.278 "transport": "TCP", 00:09:39.278 "trtype": "TCP", 00:09:39.278 "adrfam": "IPv4", 00:09:39.278 "traddr": "10.0.0.2", 00:09:39.278 "trsvcid": "4420" 00:09:39.278 } 00:09:39.278 ], 00:09:39.278 "allow_any_host": true, 00:09:39.278 "hosts": [], 00:09:39.278 "serial_number": "SPDK00000000000001", 00:09:39.278 "model_number": "SPDK bdev Controller", 00:09:39.278 "max_namespaces": 32, 00:09:39.278 "min_cntlid": 1, 00:09:39.278 "max_cntlid": 65519, 00:09:39.278 "namespaces": [ 00:09:39.278 { 00:09:39.278 "nsid": 1, 00:09:39.278 "bdev_name": "Null1", 00:09:39.278 "name": "Null1", 00:09:39.278 "nguid": "DB72DF181E1542E18820458C0CCC1B75", 00:09:39.278 "uuid": "db72df18-1e15-42e1-8820-458c0ccc1b75" 00:09:39.278 } 00:09:39.278 ] 00:09:39.278 }, 00:09:39.278 { 00:09:39.278 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:39.278 "subtype": "NVMe", 00:09:39.278 "listen_addresses": [ 00:09:39.278 { 00:09:39.278 "transport": "TCP", 00:09:39.278 "trtype": "TCP", 00:09:39.278 "adrfam": "IPv4", 00:09:39.278 "traddr": "10.0.0.2", 00:09:39.278 "trsvcid": "4420" 00:09:39.278 } 00:09:39.278 ], 00:09:39.278 "allow_any_host": true, 00:09:39.278 "hosts": [], 00:09:39.278 "serial_number": "SPDK00000000000002", 00:09:39.278 "model_number": "SPDK bdev Controller", 00:09:39.278 "max_namespaces": 32, 00:09:39.278 "min_cntlid": 1, 00:09:39.278 "max_cntlid": 65519, 00:09:39.278 "namespaces": [ 00:09:39.278 { 00:09:39.278 "nsid": 1, 00:09:39.278 "bdev_name": "Null2", 00:09:39.278 "name": "Null2", 00:09:39.278 "nguid": "471FF7201C9E4DEDB7F83923BB391128", 00:09:39.278 "uuid": "471ff720-1c9e-4ded-b7f8-3923bb391128" 00:09:39.278 } 00:09:39.278 ] 00:09:39.278 }, 00:09:39.278 { 00:09:39.278 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:39.278 "subtype": "NVMe", 00:09:39.278 "listen_addresses": [ 00:09:39.278 { 00:09:39.278 "transport": "TCP", 00:09:39.278 "trtype": "TCP", 00:09:39.278 "adrfam": "IPv4", 00:09:39.278 "traddr": "10.0.0.2", 00:09:39.278 "trsvcid": "4420" 00:09:39.278 } 00:09:39.278 ], 00:09:39.278 "allow_any_host": true, 00:09:39.278 "hosts": [], 00:09:39.278 "serial_number": "SPDK00000000000003", 00:09:39.278 "model_number": "SPDK bdev Controller", 00:09:39.278 "max_namespaces": 32, 00:09:39.278 "min_cntlid": 1, 00:09:39.278 "max_cntlid": 65519, 00:09:39.278 "namespaces": [ 00:09:39.278 { 00:09:39.278 "nsid": 1, 00:09:39.278 "bdev_name": "Null3", 00:09:39.278 "name": "Null3", 00:09:39.278 "nguid": "DFA76F28EED24E1F8D7931B86A15487B", 00:09:39.278 "uuid": "dfa76f28-eed2-4e1f-8d79-31b86a15487b" 00:09:39.278 } 00:09:39.278 ] 00:09:39.278 }, 00:09:39.278 { 00:09:39.278 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:39.278 "subtype": "NVMe", 00:09:39.278 "listen_addresses": [ 00:09:39.278 { 00:09:39.278 "transport": "TCP", 00:09:39.278 "trtype": "TCP", 00:09:39.278 "adrfam": "IPv4", 00:09:39.278 "traddr": "10.0.0.2", 00:09:39.278 "trsvcid": "4420" 00:09:39.278 } 00:09:39.278 ], 00:09:39.278 "allow_any_host": true, 00:09:39.278 "hosts": [], 00:09:39.278 "serial_number": "SPDK00000000000004", 00:09:39.278 "model_number": "SPDK bdev Controller", 00:09:39.278 "max_namespaces": 32, 00:09:39.278 "min_cntlid": 1, 00:09:39.278 "max_cntlid": 65519, 00:09:39.278 "namespaces": [ 00:09:39.278 { 00:09:39.278 "nsid": 1, 00:09:39.278 "bdev_name": "Null4", 00:09:39.278 "name": "Null4", 00:09:39.278 "nguid": "CC9804807B8D4D50A0B5E901552D76E0", 00:09:39.278 "uuid": "cc980480-7b8d-4d50-a0b5-e901552d76e0" 00:09:39.278 } 00:09:39.278 ] 00:09:39.278 } 00:09:39.278 ] 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@42 -- # seq 1 4 00:09:39.278 16:34:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:39.278 16:34:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:39.278 16:34:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:39.278 16:34:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.278 16:34:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:39.278 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.278 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.278 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.279 16:34:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:39.279 16:34:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:39.279 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.279 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.279 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.279 16:34:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:39.279 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.279 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.279 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.279 16:34:04 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:09:39.279 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.279 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.279 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.279 16:34:04 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:39.279 16:34:04 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:39.279 16:34:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:39.279 16:34:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.279 16:34:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:39.279 16:34:04 -- target/discovery.sh@49 -- # check_bdevs= 00:09:39.279 16:34:04 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:39.279 16:34:04 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:39.279 16:34:04 -- target/discovery.sh@57 -- # nvmftestfini 00:09:39.279 16:34:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:39.279 16:34:04 -- nvmf/common.sh@116 -- # sync 00:09:39.279 16:34:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:39.279 16:34:04 -- nvmf/common.sh@119 -- # set +e 00:09:39.279 16:34:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:39.279 16:34:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:39.279 rmmod nvme_tcp 00:09:39.279 rmmod nvme_fabrics 00:09:39.279 rmmod nvme_keyring 00:09:39.279 16:34:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:39.279 16:34:04 -- nvmf/common.sh@123 -- # set -e 00:09:39.279 16:34:04 -- nvmf/common.sh@124 -- # return 0 00:09:39.279 16:34:04 -- nvmf/common.sh@477 -- # '[' -n 1106460 ']' 00:09:39.279 16:34:04 -- nvmf/common.sh@478 -- # killprocess 1106460 00:09:39.279 16:34:04 -- common/autotest_common.sh@926 -- # '[' -z 1106460 ']' 00:09:39.279 16:34:04 -- common/autotest_common.sh@930 -- # kill -0 1106460 00:09:39.279 16:34:04 -- common/autotest_common.sh@931 -- # uname 00:09:39.279 16:34:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:09:39.279 16:34:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1106460 00:09:39.279 16:34:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:09:39.279 16:34:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:09:39.279 16:34:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1106460' 00:09:39.279 killing process with pid 1106460 00:09:39.279 16:34:04 -- common/autotest_common.sh@945 -- # kill 1106460 00:09:39.279 [2024-10-13 16:34:04.774475] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:39.279 16:34:04 -- common/autotest_common.sh@950 -- # wait 1106460 00:09:39.537 16:34:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:39.537 16:34:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:39.537 16:34:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:39.537 16:34:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:39.537 16:34:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:39.537 16:34:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:39.537 16:34:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:39.537 16:34:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:42.073 16:34:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:42.073 00:09:42.073 real 0m6.194s 00:09:42.073 user 0m7.765s 00:09:42.073 sys 0m1.930s 00:09:42.073 16:34:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:42.073 16:34:07 -- common/autotest_common.sh@10 -- # set +x 00:09:42.073 ************************************ 00:09:42.073 END TEST nvmf_discovery 00:09:42.073 ************************************ 00:09:42.073 16:34:07 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:42.073 16:34:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:09:42.073 16:34:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:42.073 16:34:07 -- common/autotest_common.sh@10 -- # set +x 00:09:42.073 ************************************ 00:09:42.073 START TEST nvmf_referrals 00:09:42.073 ************************************ 00:09:42.073 16:34:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:42.073 * Looking for test storage... 00:09:42.073 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:42.073 16:34:07 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:42.073 16:34:07 -- nvmf/common.sh@7 -- # uname -s 00:09:42.073 16:34:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:42.073 16:34:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:42.073 16:34:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:42.073 16:34:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:42.073 16:34:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:42.073 16:34:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:42.073 16:34:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:42.073 16:34:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:42.073 16:34:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:42.073 16:34:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:42.073 16:34:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:42.073 16:34:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:42.073 16:34:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:42.073 16:34:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:42.073 16:34:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:42.073 16:34:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:42.073 16:34:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:42.073 16:34:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:42.073 16:34:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:42.073 16:34:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.073 16:34:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.073 16:34:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.073 16:34:07 -- paths/export.sh@5 -- # export PATH 00:09:42.073 16:34:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.073 16:34:07 -- nvmf/common.sh@46 -- # : 0 00:09:42.073 16:34:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:42.073 16:34:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:42.073 16:34:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:42.073 16:34:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:42.073 16:34:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:42.073 16:34:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:42.073 16:34:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:42.073 16:34:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:42.073 16:34:07 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:42.073 16:34:07 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:42.073 16:34:07 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:42.073 16:34:07 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:42.073 16:34:07 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:42.073 16:34:07 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:42.073 16:34:07 -- target/referrals.sh@37 -- # nvmftestinit 00:09:42.073 16:34:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:42.073 16:34:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:42.073 16:34:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:42.073 16:34:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:42.073 16:34:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:42.073 16:34:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:42.073 16:34:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:42.073 16:34:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:42.073 16:34:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:42.073 16:34:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:42.073 16:34:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:42.073 16:34:07 -- common/autotest_common.sh@10 -- # set +x 00:09:43.976 16:34:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:43.977 16:34:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:43.977 16:34:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:43.977 16:34:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:43.977 16:34:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:43.977 16:34:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:43.977 16:34:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:43.977 16:34:09 -- nvmf/common.sh@294 -- # net_devs=() 00:09:43.977 16:34:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:43.977 16:34:09 -- nvmf/common.sh@295 -- # e810=() 00:09:43.977 16:34:09 -- nvmf/common.sh@295 -- # local -ga e810 00:09:43.977 16:34:09 -- nvmf/common.sh@296 -- # x722=() 00:09:43.977 16:34:09 -- nvmf/common.sh@296 -- # local -ga x722 00:09:43.977 16:34:09 -- nvmf/common.sh@297 -- # mlx=() 00:09:43.977 16:34:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:43.977 16:34:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:43.977 16:34:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:43.977 16:34:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:43.977 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:43.977 16:34:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:43.977 16:34:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:43.977 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:43.977 16:34:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:43.977 16:34:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:43.977 16:34:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:43.977 16:34:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:43.977 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:43.977 16:34:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:43.977 16:34:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:43.977 16:34:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:43.977 16:34:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:43.977 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:43.977 16:34:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:43.977 16:34:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:43.977 16:34:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:43.977 16:34:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:43.977 16:34:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:43.977 16:34:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:43.977 16:34:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:43.977 16:34:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:43.977 16:34:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:43.977 16:34:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:43.977 16:34:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:43.977 16:34:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:43.977 16:34:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:43.977 16:34:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:43.977 16:34:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:43.977 16:34:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:43.977 16:34:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:43.977 16:34:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:43.977 16:34:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:43.977 16:34:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:43.977 16:34:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:43.977 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:43.977 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:09:43.977 00:09:43.977 --- 10.0.0.2 ping statistics --- 00:09:43.977 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:43.977 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:09:43.977 16:34:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:43.977 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:43.977 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:09:43.977 00:09:43.977 --- 10.0.0.1 ping statistics --- 00:09:43.977 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:43.977 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:09:43.977 16:34:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:43.977 16:34:09 -- nvmf/common.sh@410 -- # return 0 00:09:43.977 16:34:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:43.977 16:34:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:43.977 16:34:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:43.977 16:34:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:43.977 16:34:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:43.977 16:34:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:43.977 16:34:09 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:43.977 16:34:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:43.977 16:34:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:09:43.977 16:34:09 -- common/autotest_common.sh@10 -- # set +x 00:09:43.977 16:34:09 -- nvmf/common.sh@469 -- # nvmfpid=1108574 00:09:43.977 16:34:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:43.977 16:34:09 -- nvmf/common.sh@470 -- # waitforlisten 1108574 00:09:43.977 16:34:09 -- common/autotest_common.sh@819 -- # '[' -z 1108574 ']' 00:09:43.977 16:34:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:43.977 16:34:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:09:43.977 16:34:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:43.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:43.977 16:34:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:09:43.977 16:34:09 -- common/autotest_common.sh@10 -- # set +x 00:09:43.977 [2024-10-13 16:34:09.397558] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:09:43.977 [2024-10-13 16:34:09.397636] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:43.977 EAL: No free 2048 kB hugepages reported on node 1 00:09:43.977 [2024-10-13 16:34:09.462799] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:44.236 [2024-10-13 16:34:09.549103] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:44.236 [2024-10-13 16:34:09.549241] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:44.236 [2024-10-13 16:34:09.549257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:44.236 [2024-10-13 16:34:09.549270] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:44.236 [2024-10-13 16:34:09.549338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:44.236 [2024-10-13 16:34:09.549405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:44.236 [2024-10-13 16:34:09.549465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:44.236 [2024-10-13 16:34:09.549468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:45.168 16:34:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:09:45.168 16:34:10 -- common/autotest_common.sh@852 -- # return 0 00:09:45.168 16:34:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:45.168 16:34:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:45.168 16:34:10 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 [2024-10-13 16:34:10.470461] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 [2024-10-13 16:34:10.482713] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:45.168 16:34:10 -- target/referrals.sh@48 -- # jq length 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:45.168 16:34:10 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:45.168 16:34:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:45.168 16:34:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:45.168 16:34:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:45.168 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.168 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.168 16:34:10 -- target/referrals.sh@21 -- # sort 00:09:45.168 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:45.168 16:34:10 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:45.168 16:34:10 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:45.168 16:34:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:45.168 16:34:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:45.168 16:34:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:45.168 16:34:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:45.168 16:34:10 -- target/referrals.sh@26 -- # sort 00:09:45.426 16:34:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:45.426 16:34:10 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:45.426 16:34:10 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:45.426 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.426 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.426 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.426 16:34:10 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:45.426 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.426 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.426 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.426 16:34:10 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:45.426 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.426 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.426 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.426 16:34:10 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:45.426 16:34:10 -- target/referrals.sh@56 -- # jq length 00:09:45.426 16:34:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.426 16:34:10 -- common/autotest_common.sh@10 -- # set +x 00:09:45.426 16:34:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.426 16:34:10 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:45.426 16:34:10 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:45.426 16:34:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:45.426 16:34:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:45.426 16:34:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:45.426 16:34:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:45.426 16:34:10 -- target/referrals.sh@26 -- # sort 00:09:45.684 16:34:11 -- target/referrals.sh@26 -- # echo 00:09:45.684 16:34:11 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:45.684 16:34:11 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:45.684 16:34:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.684 16:34:11 -- common/autotest_common.sh@10 -- # set +x 00:09:45.684 16:34:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.684 16:34:11 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:45.684 16:34:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.684 16:34:11 -- common/autotest_common.sh@10 -- # set +x 00:09:45.684 16:34:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.684 16:34:11 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:45.684 16:34:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:45.684 16:34:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:45.684 16:34:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:45.684 16:34:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:45.684 16:34:11 -- common/autotest_common.sh@10 -- # set +x 00:09:45.684 16:34:11 -- target/referrals.sh@21 -- # sort 00:09:45.684 16:34:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:45.684 16:34:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:45.684 16:34:11 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:45.684 16:34:11 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:45.684 16:34:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:45.684 16:34:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:45.684 16:34:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:45.684 16:34:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:45.684 16:34:11 -- target/referrals.sh@26 -- # sort 00:09:45.941 16:34:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:45.941 16:34:11 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:45.941 16:34:11 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:45.941 16:34:11 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:45.941 16:34:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:45.941 16:34:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:45.941 16:34:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:45.941 16:34:11 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:45.941 16:34:11 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:45.941 16:34:11 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:45.941 16:34:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:46.199 16:34:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:46.199 16:34:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:46.199 16:34:11 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:46.199 16:34:11 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:46.199 16:34:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:46.199 16:34:11 -- common/autotest_common.sh@10 -- # set +x 00:09:46.199 16:34:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:46.199 16:34:11 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:46.199 16:34:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:46.199 16:34:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:46.199 16:34:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:46.199 16:34:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:46.199 16:34:11 -- common/autotest_common.sh@10 -- # set +x 00:09:46.199 16:34:11 -- target/referrals.sh@21 -- # sort 00:09:46.199 16:34:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:46.199 16:34:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:46.199 16:34:11 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:46.199 16:34:11 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:46.199 16:34:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:46.199 16:34:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:46.199 16:34:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:46.199 16:34:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:46.199 16:34:11 -- target/referrals.sh@26 -- # sort 00:09:46.457 16:34:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:46.457 16:34:11 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:46.457 16:34:11 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:46.457 16:34:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:46.457 16:34:11 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:46.457 16:34:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:46.457 16:34:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:46.714 16:34:12 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:46.714 16:34:12 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:46.714 16:34:12 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:46.714 16:34:12 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:46.714 16:34:12 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:46.714 16:34:12 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:46.714 16:34:12 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:46.715 16:34:12 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:46.715 16:34:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:46.715 16:34:12 -- common/autotest_common.sh@10 -- # set +x 00:09:46.715 16:34:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:46.715 16:34:12 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:46.715 16:34:12 -- target/referrals.sh@82 -- # jq length 00:09:46.715 16:34:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:46.715 16:34:12 -- common/autotest_common.sh@10 -- # set +x 00:09:46.715 16:34:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:46.973 16:34:12 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:46.973 16:34:12 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:46.973 16:34:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:46.973 16:34:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:46.973 16:34:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:46.973 16:34:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:46.973 16:34:12 -- target/referrals.sh@26 -- # sort 00:09:46.973 16:34:12 -- target/referrals.sh@26 -- # echo 00:09:46.973 16:34:12 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:46.973 16:34:12 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:46.973 16:34:12 -- target/referrals.sh@86 -- # nvmftestfini 00:09:46.973 16:34:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:46.973 16:34:12 -- nvmf/common.sh@116 -- # sync 00:09:46.973 16:34:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:46.973 16:34:12 -- nvmf/common.sh@119 -- # set +e 00:09:46.973 16:34:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:46.973 16:34:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:46.973 rmmod nvme_tcp 00:09:46.973 rmmod nvme_fabrics 00:09:47.231 rmmod nvme_keyring 00:09:47.231 16:34:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:47.231 16:34:12 -- nvmf/common.sh@123 -- # set -e 00:09:47.231 16:34:12 -- nvmf/common.sh@124 -- # return 0 00:09:47.231 16:34:12 -- nvmf/common.sh@477 -- # '[' -n 1108574 ']' 00:09:47.231 16:34:12 -- nvmf/common.sh@478 -- # killprocess 1108574 00:09:47.231 16:34:12 -- common/autotest_common.sh@926 -- # '[' -z 1108574 ']' 00:09:47.231 16:34:12 -- common/autotest_common.sh@930 -- # kill -0 1108574 00:09:47.231 16:34:12 -- common/autotest_common.sh@931 -- # uname 00:09:47.231 16:34:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:09:47.231 16:34:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1108574 00:09:47.231 16:34:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:09:47.231 16:34:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:09:47.231 16:34:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1108574' 00:09:47.231 killing process with pid 1108574 00:09:47.231 16:34:12 -- common/autotest_common.sh@945 -- # kill 1108574 00:09:47.231 16:34:12 -- common/autotest_common.sh@950 -- # wait 1108574 00:09:47.490 16:34:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:47.490 16:34:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:47.490 16:34:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:47.490 16:34:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:47.490 16:34:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:47.490 16:34:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:47.490 16:34:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:47.490 16:34:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:49.394 16:34:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:49.394 00:09:49.394 real 0m7.765s 00:09:49.394 user 0m14.533s 00:09:49.394 sys 0m2.307s 00:09:49.394 16:34:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:09:49.394 16:34:14 -- common/autotest_common.sh@10 -- # set +x 00:09:49.394 ************************************ 00:09:49.394 END TEST nvmf_referrals 00:09:49.394 ************************************ 00:09:49.394 16:34:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:49.394 16:34:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:09:49.394 16:34:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:09:49.394 16:34:14 -- common/autotest_common.sh@10 -- # set +x 00:09:49.394 ************************************ 00:09:49.394 START TEST nvmf_connect_disconnect 00:09:49.394 ************************************ 00:09:49.394 16:34:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:49.653 * Looking for test storage... 00:09:49.653 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:49.653 16:34:14 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:49.653 16:34:14 -- nvmf/common.sh@7 -- # uname -s 00:09:49.653 16:34:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:49.653 16:34:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:49.653 16:34:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:49.653 16:34:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:49.653 16:34:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:49.653 16:34:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:49.653 16:34:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:49.653 16:34:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:49.653 16:34:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:49.653 16:34:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:49.653 16:34:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:49.653 16:34:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:49.653 16:34:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:49.653 16:34:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:49.653 16:34:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:49.653 16:34:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:49.653 16:34:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:49.653 16:34:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:49.653 16:34:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:49.653 16:34:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.653 16:34:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.653 16:34:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.653 16:34:14 -- paths/export.sh@5 -- # export PATH 00:09:49.653 16:34:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.653 16:34:14 -- nvmf/common.sh@46 -- # : 0 00:09:49.653 16:34:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:49.653 16:34:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:49.654 16:34:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:49.654 16:34:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:49.654 16:34:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:49.654 16:34:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:49.654 16:34:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:49.654 16:34:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:49.654 16:34:14 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:49.654 16:34:14 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:49.654 16:34:14 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:49.654 16:34:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:49.654 16:34:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:49.654 16:34:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:49.654 16:34:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:49.654 16:34:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:49.654 16:34:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:49.654 16:34:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:49.654 16:34:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:49.654 16:34:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:49.654 16:34:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:49.654 16:34:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:49.654 16:34:14 -- common/autotest_common.sh@10 -- # set +x 00:09:51.554 16:34:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:51.554 16:34:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:51.554 16:34:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:51.554 16:34:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:51.554 16:34:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:51.554 16:34:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:51.554 16:34:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:51.554 16:34:16 -- nvmf/common.sh@294 -- # net_devs=() 00:09:51.554 16:34:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:51.554 16:34:16 -- nvmf/common.sh@295 -- # e810=() 00:09:51.554 16:34:16 -- nvmf/common.sh@295 -- # local -ga e810 00:09:51.554 16:34:16 -- nvmf/common.sh@296 -- # x722=() 00:09:51.554 16:34:16 -- nvmf/common.sh@296 -- # local -ga x722 00:09:51.554 16:34:16 -- nvmf/common.sh@297 -- # mlx=() 00:09:51.554 16:34:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:51.554 16:34:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:51.554 16:34:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:51.554 16:34:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:51.554 16:34:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:51.554 16:34:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:51.555 16:34:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:51.555 16:34:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:51.555 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:51.555 16:34:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:51.555 16:34:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:51.555 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:51.555 16:34:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:51.555 16:34:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:51.555 16:34:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:51.555 16:34:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:51.555 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:51.555 16:34:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:51.555 16:34:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:51.555 16:34:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:51.555 16:34:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:51.555 16:34:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:51.555 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:51.555 16:34:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:51.555 16:34:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:51.555 16:34:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:51.555 16:34:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:51.555 16:34:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:51.555 16:34:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:51.555 16:34:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:51.555 16:34:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:51.555 16:34:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:51.555 16:34:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:51.555 16:34:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:51.555 16:34:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:51.555 16:34:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:51.555 16:34:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:51.555 16:34:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:51.555 16:34:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:51.555 16:34:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:51.555 16:34:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:51.555 16:34:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:51.555 16:34:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:51.555 16:34:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:51.555 16:34:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:51.555 16:34:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:51.555 16:34:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:51.555 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:51.555 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:09:51.555 00:09:51.555 --- 10.0.0.2 ping statistics --- 00:09:51.555 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:51.555 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:09:51.555 16:34:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:51.555 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:51.555 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:09:51.555 00:09:51.555 --- 10.0.0.1 ping statistics --- 00:09:51.555 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:51.555 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:09:51.555 16:34:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:51.555 16:34:17 -- nvmf/common.sh@410 -- # return 0 00:09:51.555 16:34:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:51.555 16:34:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:51.555 16:34:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:51.555 16:34:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:51.555 16:34:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:51.555 16:34:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:51.555 16:34:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:51.555 16:34:17 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:51.555 16:34:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:51.555 16:34:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:09:51.555 16:34:17 -- common/autotest_common.sh@10 -- # set +x 00:09:51.555 16:34:17 -- nvmf/common.sh@469 -- # nvmfpid=1111019 00:09:51.555 16:34:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:51.555 16:34:17 -- nvmf/common.sh@470 -- # waitforlisten 1111019 00:09:51.555 16:34:17 -- common/autotest_common.sh@819 -- # '[' -z 1111019 ']' 00:09:51.555 16:34:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:51.555 16:34:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:09:51.555 16:34:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:51.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:51.555 16:34:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:09:51.555 16:34:17 -- common/autotest_common.sh@10 -- # set +x 00:09:51.814 [2024-10-13 16:34:17.098733] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:09:51.814 [2024-10-13 16:34:17.098831] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:51.814 EAL: No free 2048 kB hugepages reported on node 1 00:09:51.814 [2024-10-13 16:34:17.169122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:51.814 [2024-10-13 16:34:17.263095] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:51.814 [2024-10-13 16:34:17.263270] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:51.814 [2024-10-13 16:34:17.263290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:51.814 [2024-10-13 16:34:17.263304] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:51.814 [2024-10-13 16:34:17.263390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:51.814 [2024-10-13 16:34:17.263447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:51.814 [2024-10-13 16:34:17.263477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:51.814 [2024-10-13 16:34:17.263480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:52.756 16:34:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:09:52.756 16:34:18 -- common/autotest_common.sh@852 -- # return 0 00:09:52.756 16:34:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:52.756 16:34:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 16:34:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:52.756 16:34:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 [2024-10-13 16:34:18.097101] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:52.756 16:34:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:52.756 16:34:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 16:34:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:52.756 16:34:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 16:34:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:52.756 16:34:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 16:34:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:52.756 16:34:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:09:52.756 16:34:18 -- common/autotest_common.sh@10 -- # set +x 00:09:52.756 [2024-10-13 16:34:18.150178] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:52.756 16:34:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:52.756 16:34:18 -- target/connect_disconnect.sh@34 -- # set +x 00:09:55.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.245 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.770 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.192 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.562 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.088 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.044 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.096 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.993 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.470 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.366 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.891 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.416 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.745 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.594 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.605 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.976 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.450 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.403 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.931 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.831 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.311 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.739 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.707 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.604 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.657 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.222 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.119 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.170 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:12.123 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.027 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.554 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.078 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.603 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:28.562 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.471 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:33.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.514 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:40.052 [2024-10-13 16:38:05.039186] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96fbe0 is same with the state(5) to be set 00:13:40.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:41.957 [2024-10-13 16:38:07.422224] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96fbe0 is same with the state(5) to be set 00:13:41.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:44.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:44.493 16:38:09 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:44.493 16:38:09 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:44.493 16:38:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.493 16:38:09 -- nvmf/common.sh@116 -- # sync 00:13:44.493 16:38:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.493 16:38:09 -- nvmf/common.sh@119 -- # set +e 00:13:44.493 16:38:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.493 16:38:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.493 rmmod nvme_tcp 00:13:44.493 rmmod nvme_fabrics 00:13:44.493 rmmod nvme_keyring 00:13:44.493 16:38:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.493 16:38:09 -- nvmf/common.sh@123 -- # set -e 00:13:44.494 16:38:09 -- nvmf/common.sh@124 -- # return 0 00:13:44.494 16:38:09 -- nvmf/common.sh@477 -- # '[' -n 1111019 ']' 00:13:44.494 16:38:09 -- nvmf/common.sh@478 -- # killprocess 1111019 00:13:44.494 16:38:09 -- common/autotest_common.sh@926 -- # '[' -z 1111019 ']' 00:13:44.494 16:38:09 -- common/autotest_common.sh@930 -- # kill -0 1111019 00:13:44.494 16:38:09 -- common/autotest_common.sh@931 -- # uname 00:13:44.494 16:38:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:44.494 16:38:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1111019 00:13:44.494 16:38:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:44.494 16:38:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:44.494 16:38:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1111019' 00:13:44.494 killing process with pid 1111019 00:13:44.494 16:38:09 -- common/autotest_common.sh@945 -- # kill 1111019 00:13:44.494 16:38:09 -- common/autotest_common.sh@950 -- # wait 1111019 00:13:44.754 16:38:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.754 16:38:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.754 16:38:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.754 16:38:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.754 16:38:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.754 16:38:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.754 16:38:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.754 16:38:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.663 16:38:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.663 00:13:46.663 real 3m57.286s 00:13:46.663 user 15m5.487s 00:13:46.663 sys 0m34.824s 00:13:46.663 16:38:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:46.663 16:38:12 -- common/autotest_common.sh@10 -- # set +x 00:13:46.663 ************************************ 00:13:46.663 END TEST nvmf_connect_disconnect 00:13:46.663 ************************************ 00:13:46.923 16:38:12 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:46.923 16:38:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:46.923 16:38:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:46.923 16:38:12 -- common/autotest_common.sh@10 -- # set +x 00:13:46.923 ************************************ 00:13:46.923 START TEST nvmf_multitarget 00:13:46.923 ************************************ 00:13:46.923 16:38:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:46.923 * Looking for test storage... 00:13:46.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.923 16:38:12 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.923 16:38:12 -- nvmf/common.sh@7 -- # uname -s 00:13:46.923 16:38:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.923 16:38:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.923 16:38:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.923 16:38:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.923 16:38:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.923 16:38:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.923 16:38:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.923 16:38:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.923 16:38:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.923 16:38:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.923 16:38:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.923 16:38:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.923 16:38:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.923 16:38:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.923 16:38:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.923 16:38:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.923 16:38:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.923 16:38:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.923 16:38:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.923 16:38:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.923 16:38:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.923 16:38:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.923 16:38:12 -- paths/export.sh@5 -- # export PATH 00:13:46.923 16:38:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.923 16:38:12 -- nvmf/common.sh@46 -- # : 0 00:13:46.923 16:38:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.923 16:38:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.923 16:38:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.923 16:38:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.923 16:38:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.923 16:38:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.923 16:38:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.923 16:38:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.923 16:38:12 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:46.923 16:38:12 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:46.923 16:38:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.923 16:38:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.923 16:38:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.923 16:38:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.923 16:38:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.924 16:38:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.924 16:38:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.924 16:38:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.924 16:38:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.924 16:38:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.924 16:38:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.924 16:38:12 -- common/autotest_common.sh@10 -- # set +x 00:13:49.462 16:38:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:49.462 16:38:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:49.462 16:38:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:49.462 16:38:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:49.462 16:38:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:49.462 16:38:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:49.462 16:38:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:49.462 16:38:14 -- nvmf/common.sh@294 -- # net_devs=() 00:13:49.462 16:38:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:49.462 16:38:14 -- nvmf/common.sh@295 -- # e810=() 00:13:49.462 16:38:14 -- nvmf/common.sh@295 -- # local -ga e810 00:13:49.462 16:38:14 -- nvmf/common.sh@296 -- # x722=() 00:13:49.462 16:38:14 -- nvmf/common.sh@296 -- # local -ga x722 00:13:49.462 16:38:14 -- nvmf/common.sh@297 -- # mlx=() 00:13:49.462 16:38:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:49.462 16:38:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:49.462 16:38:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:49.462 16:38:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:49.462 16:38:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.462 16:38:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:49.462 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:49.462 16:38:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.462 16:38:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:49.462 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:49.462 16:38:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.462 16:38:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.462 16:38:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.462 16:38:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:49.462 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:49.462 16:38:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.462 16:38:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.462 16:38:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.462 16:38:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.462 16:38:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:49.462 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:49.462 16:38:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.462 16:38:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:49.462 16:38:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:49.462 16:38:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:49.462 16:38:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:49.462 16:38:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:49.462 16:38:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:49.462 16:38:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:49.462 16:38:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:49.462 16:38:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:49.462 16:38:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:49.462 16:38:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:49.462 16:38:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:49.462 16:38:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:49.462 16:38:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:49.462 16:38:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:49.462 16:38:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:49.462 16:38:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:49.463 16:38:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:49.463 16:38:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:49.463 16:38:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:49.463 16:38:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:49.463 16:38:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:49.463 16:38:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:49.463 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:49.463 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.323 ms 00:13:49.463 00:13:49.463 --- 10.0.0.2 ping statistics --- 00:13:49.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.463 rtt min/avg/max/mdev = 0.323/0.323/0.323/0.000 ms 00:13:49.463 16:38:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:49.463 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:49.463 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:13:49.463 00:13:49.463 --- 10.0.0.1 ping statistics --- 00:13:49.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.463 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:13:49.463 16:38:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:49.463 16:38:14 -- nvmf/common.sh@410 -- # return 0 00:13:49.463 16:38:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:49.463 16:38:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:49.463 16:38:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:49.463 16:38:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:49.463 16:38:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:49.463 16:38:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:49.463 16:38:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:49.463 16:38:14 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:49.463 16:38:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:49.463 16:38:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:49.463 16:38:14 -- common/autotest_common.sh@10 -- # set +x 00:13:49.463 16:38:14 -- nvmf/common.sh@469 -- # nvmfpid=1143048 00:13:49.463 16:38:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:49.463 16:38:14 -- nvmf/common.sh@470 -- # waitforlisten 1143048 00:13:49.463 16:38:14 -- common/autotest_common.sh@819 -- # '[' -z 1143048 ']' 00:13:49.463 16:38:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.463 16:38:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:49.463 16:38:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.463 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.463 16:38:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:49.463 16:38:14 -- common/autotest_common.sh@10 -- # set +x 00:13:49.463 [2024-10-13 16:38:14.608114] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:13:49.463 [2024-10-13 16:38:14.608207] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.463 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.463 [2024-10-13 16:38:14.673359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:49.463 [2024-10-13 16:38:14.761107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.463 [2024-10-13 16:38:14.761266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.463 [2024-10-13 16:38:14.761293] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.463 [2024-10-13 16:38:14.761306] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.463 [2024-10-13 16:38:14.761360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.463 [2024-10-13 16:38:14.761419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:49.463 [2024-10-13 16:38:14.761485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.463 [2024-10-13 16:38:14.761489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.400 16:38:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:50.400 16:38:15 -- common/autotest_common.sh@852 -- # return 0 00:13:50.400 16:38:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:50.400 16:38:15 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:50.400 16:38:15 -- common/autotest_common.sh@10 -- # set +x 00:13:50.400 16:38:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.400 16:38:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:50.400 16:38:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:50.400 16:38:15 -- target/multitarget.sh@21 -- # jq length 00:13:50.400 16:38:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:50.400 16:38:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:50.400 "nvmf_tgt_1" 00:13:50.400 16:38:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:50.658 "nvmf_tgt_2" 00:13:50.659 16:38:15 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:50.659 16:38:15 -- target/multitarget.sh@28 -- # jq length 00:13:50.659 16:38:16 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:50.659 16:38:16 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:50.917 true 00:13:50.917 16:38:16 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:50.917 true 00:13:50.917 16:38:16 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:50.917 16:38:16 -- target/multitarget.sh@35 -- # jq length 00:13:50.917 16:38:16 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:50.917 16:38:16 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:50.917 16:38:16 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:50.917 16:38:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.917 16:38:16 -- nvmf/common.sh@116 -- # sync 00:13:50.917 16:38:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.917 16:38:16 -- nvmf/common.sh@119 -- # set +e 00:13:50.917 16:38:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.917 16:38:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.917 rmmod nvme_tcp 00:13:51.175 rmmod nvme_fabrics 00:13:51.175 rmmod nvme_keyring 00:13:51.175 16:38:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.175 16:38:16 -- nvmf/common.sh@123 -- # set -e 00:13:51.175 16:38:16 -- nvmf/common.sh@124 -- # return 0 00:13:51.175 16:38:16 -- nvmf/common.sh@477 -- # '[' -n 1143048 ']' 00:13:51.175 16:38:16 -- nvmf/common.sh@478 -- # killprocess 1143048 00:13:51.175 16:38:16 -- common/autotest_common.sh@926 -- # '[' -z 1143048 ']' 00:13:51.175 16:38:16 -- common/autotest_common.sh@930 -- # kill -0 1143048 00:13:51.175 16:38:16 -- common/autotest_common.sh@931 -- # uname 00:13:51.175 16:38:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:51.175 16:38:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1143048 00:13:51.175 16:38:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:51.175 16:38:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:51.175 16:38:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1143048' 00:13:51.175 killing process with pid 1143048 00:13:51.175 16:38:16 -- common/autotest_common.sh@945 -- # kill 1143048 00:13:51.175 16:38:16 -- common/autotest_common.sh@950 -- # wait 1143048 00:13:51.434 16:38:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.434 16:38:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.434 16:38:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.434 16:38:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.434 16:38:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.434 16:38:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.434 16:38:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.434 16:38:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.344 16:38:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.344 00:13:53.344 real 0m6.584s 00:13:53.344 user 0m9.526s 00:13:53.344 sys 0m2.090s 00:13:53.344 16:38:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:53.344 16:38:18 -- common/autotest_common.sh@10 -- # set +x 00:13:53.344 ************************************ 00:13:53.344 END TEST nvmf_multitarget 00:13:53.344 ************************************ 00:13:53.344 16:38:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:53.344 16:38:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:53.344 16:38:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:53.344 16:38:18 -- common/autotest_common.sh@10 -- # set +x 00:13:53.344 ************************************ 00:13:53.344 START TEST nvmf_rpc 00:13:53.344 ************************************ 00:13:53.344 16:38:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:53.344 * Looking for test storage... 00:13:53.344 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.344 16:38:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.344 16:38:18 -- nvmf/common.sh@7 -- # uname -s 00:13:53.344 16:38:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.344 16:38:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.344 16:38:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.344 16:38:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.344 16:38:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.344 16:38:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.344 16:38:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.344 16:38:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.344 16:38:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.344 16:38:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.603 16:38:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.603 16:38:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.603 16:38:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.603 16:38:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.603 16:38:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.603 16:38:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.603 16:38:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.603 16:38:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.603 16:38:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.603 16:38:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.603 16:38:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.603 16:38:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.603 16:38:18 -- paths/export.sh@5 -- # export PATH 00:13:53.603 16:38:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.603 16:38:18 -- nvmf/common.sh@46 -- # : 0 00:13:53.603 16:38:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.603 16:38:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.603 16:38:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.603 16:38:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.603 16:38:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.603 16:38:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.603 16:38:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.603 16:38:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.603 16:38:18 -- target/rpc.sh@11 -- # loops=5 00:13:53.603 16:38:18 -- target/rpc.sh@23 -- # nvmftestinit 00:13:53.603 16:38:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.603 16:38:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.603 16:38:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.603 16:38:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.603 16:38:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.603 16:38:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.603 16:38:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.603 16:38:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.603 16:38:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.603 16:38:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.603 16:38:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.603 16:38:18 -- common/autotest_common.sh@10 -- # set +x 00:13:55.509 16:38:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.509 16:38:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.509 16:38:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.509 16:38:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.509 16:38:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.509 16:38:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.509 16:38:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.509 16:38:20 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.509 16:38:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.509 16:38:20 -- nvmf/common.sh@295 -- # e810=() 00:13:55.509 16:38:20 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.509 16:38:20 -- nvmf/common.sh@296 -- # x722=() 00:13:55.509 16:38:20 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.509 16:38:20 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.509 16:38:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.509 16:38:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.509 16:38:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.509 16:38:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.509 16:38:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.509 16:38:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.510 16:38:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.510 16:38:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.510 16:38:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.510 16:38:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.510 16:38:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.510 16:38:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.510 16:38:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.510 16:38:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.510 16:38:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.510 16:38:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.510 16:38:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.510 16:38:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.510 16:38:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.510 16:38:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.510 16:38:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.510 16:38:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.510 16:38:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.510 16:38:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.510 16:38:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.510 16:38:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.510 16:38:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.510 16:38:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.510 16:38:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.510 16:38:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.510 16:38:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.510 16:38:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.510 16:38:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.510 16:38:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.510 16:38:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.510 16:38:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.510 16:38:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.510 16:38:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.510 16:38:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:13:55.510 00:13:55.510 --- 10.0.0.2 ping statistics --- 00:13:55.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.510 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:13:55.510 16:38:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:13:55.510 00:13:55.510 --- 10.0.0.1 ping statistics --- 00:13:55.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.510 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:13:55.510 16:38:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.510 16:38:20 -- nvmf/common.sh@410 -- # return 0 00:13:55.510 16:38:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.510 16:38:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.510 16:38:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.510 16:38:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.510 16:38:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.510 16:38:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.510 16:38:20 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:55.510 16:38:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.510 16:38:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:55.510 16:38:20 -- common/autotest_common.sh@10 -- # set +x 00:13:55.510 16:38:21 -- nvmf/common.sh@469 -- # nvmfpid=1145288 00:13:55.510 16:38:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:55.510 16:38:21 -- nvmf/common.sh@470 -- # waitforlisten 1145288 00:13:55.510 16:38:21 -- common/autotest_common.sh@819 -- # '[' -z 1145288 ']' 00:13:55.510 16:38:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.510 16:38:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:55.510 16:38:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.510 16:38:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:55.510 16:38:21 -- common/autotest_common.sh@10 -- # set +x 00:13:55.770 [2024-10-13 16:38:21.045859] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:13:55.770 [2024-10-13 16:38:21.045942] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.770 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.770 [2024-10-13 16:38:21.114248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:55.770 [2024-10-13 16:38:21.205936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.770 [2024-10-13 16:38:21.206107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.770 [2024-10-13 16:38:21.206127] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.770 [2024-10-13 16:38:21.206141] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.770 [2024-10-13 16:38:21.206246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.770 [2024-10-13 16:38:21.206303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.770 [2024-10-13 16:38:21.206362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.770 [2024-10-13 16:38:21.206365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:56.704 16:38:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:56.704 16:38:22 -- common/autotest_common.sh@852 -- # return 0 00:13:56.704 16:38:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.705 16:38:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:56.705 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.705 16:38:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.705 16:38:22 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:56.705 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.705 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.705 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.705 16:38:22 -- target/rpc.sh@26 -- # stats='{ 00:13:56.705 "tick_rate": 2700000000, 00:13:56.705 "poll_groups": [ 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_0", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_1", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_2", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_3", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [] 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 }' 00:13:56.705 16:38:22 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:56.705 16:38:22 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:56.705 16:38:22 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:56.705 16:38:22 -- target/rpc.sh@15 -- # wc -l 00:13:56.705 16:38:22 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:56.705 16:38:22 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:56.705 16:38:22 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:56.705 16:38:22 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:56.705 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.705 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.705 [2024-10-13 16:38:22.146463] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.705 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.705 16:38:22 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:56.705 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.705 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.705 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.705 16:38:22 -- target/rpc.sh@33 -- # stats='{ 00:13:56.705 "tick_rate": 2700000000, 00:13:56.705 "poll_groups": [ 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_0", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [ 00:13:56.705 { 00:13:56.705 "trtype": "TCP" 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_1", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [ 00:13:56.705 { 00:13:56.705 "trtype": "TCP" 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_2", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [ 00:13:56.705 { 00:13:56.705 "trtype": "TCP" 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 }, 00:13:56.705 { 00:13:56.705 "name": "nvmf_tgt_poll_group_3", 00:13:56.705 "admin_qpairs": 0, 00:13:56.705 "io_qpairs": 0, 00:13:56.705 "current_admin_qpairs": 0, 00:13:56.705 "current_io_qpairs": 0, 00:13:56.705 "pending_bdev_io": 0, 00:13:56.705 "completed_nvme_io": 0, 00:13:56.705 "transports": [ 00:13:56.705 { 00:13:56.705 "trtype": "TCP" 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 } 00:13:56.705 ] 00:13:56.705 }' 00:13:56.705 16:38:22 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:56.705 16:38:22 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:56.705 16:38:22 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:56.705 16:38:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:56.966 16:38:22 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:56.966 16:38:22 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:56.966 16:38:22 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:56.966 16:38:22 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:56.966 16:38:22 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.966 Malloc1 00:13:56.966 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.966 16:38:22 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.966 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.966 16:38:22 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.966 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.966 16:38:22 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.966 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.966 16:38:22 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.966 [2024-10-13 16:38:22.285859] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.966 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.966 16:38:22 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:56.966 16:38:22 -- common/autotest_common.sh@640 -- # local es=0 00:13:56.966 16:38:22 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:56.966 16:38:22 -- common/autotest_common.sh@628 -- # local arg=nvme 00:13:56.966 16:38:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:56.966 16:38:22 -- common/autotest_common.sh@632 -- # type -t nvme 00:13:56.966 16:38:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:56.966 16:38:22 -- common/autotest_common.sh@634 -- # type -P nvme 00:13:56.966 16:38:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:56.966 16:38:22 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:13:56.966 16:38:22 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:13:56.966 16:38:22 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:56.966 [2024-10-13 16:38:22.308344] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:56.966 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:56.966 could not add new controller: failed to write to nvme-fabrics device 00:13:56.966 16:38:22 -- common/autotest_common.sh@643 -- # es=1 00:13:56.966 16:38:22 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:56.966 16:38:22 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:56.966 16:38:22 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:56.966 16:38:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:56.966 16:38:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.966 16:38:22 -- common/autotest_common.sh@10 -- # set +x 00:13:56.967 16:38:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.967 16:38:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:57.537 16:38:23 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:57.537 16:38:23 -- common/autotest_common.sh@1177 -- # local i=0 00:13:57.537 16:38:23 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:57.537 16:38:23 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:57.537 16:38:23 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:00.077 16:38:25 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:00.077 16:38:25 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:00.077 16:38:25 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:00.077 16:38:25 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:00.077 16:38:25 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:00.077 16:38:25 -- common/autotest_common.sh@1187 -- # return 0 00:14:00.077 16:38:25 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:00.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:00.077 16:38:25 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:00.077 16:38:25 -- common/autotest_common.sh@1198 -- # local i=0 00:14:00.077 16:38:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:00.077 16:38:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:00.077 16:38:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:00.077 16:38:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:00.077 16:38:25 -- common/autotest_common.sh@1210 -- # return 0 00:14:00.077 16:38:25 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:00.077 16:38:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:00.077 16:38:25 -- common/autotest_common.sh@10 -- # set +x 00:14:00.077 16:38:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:00.077 16:38:25 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.077 16:38:25 -- common/autotest_common.sh@640 -- # local es=0 00:14:00.077 16:38:25 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.077 16:38:25 -- common/autotest_common.sh@628 -- # local arg=nvme 00:14:00.077 16:38:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:00.077 16:38:25 -- common/autotest_common.sh@632 -- # type -t nvme 00:14:00.077 16:38:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:00.077 16:38:25 -- common/autotest_common.sh@634 -- # type -P nvme 00:14:00.077 16:38:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:00.077 16:38:25 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:14:00.077 16:38:25 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:14:00.077 16:38:25 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.077 [2024-10-13 16:38:25.184898] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:14:00.077 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:00.077 could not add new controller: failed to write to nvme-fabrics device 00:14:00.077 16:38:25 -- common/autotest_common.sh@643 -- # es=1 00:14:00.077 16:38:25 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:00.077 16:38:25 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:00.077 16:38:25 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:00.077 16:38:25 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:14:00.077 16:38:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:00.077 16:38:25 -- common/autotest_common.sh@10 -- # set +x 00:14:00.077 16:38:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:00.077 16:38:25 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.337 16:38:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:14:00.337 16:38:25 -- common/autotest_common.sh@1177 -- # local i=0 00:14:00.337 16:38:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:00.337 16:38:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:00.337 16:38:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:02.871 16:38:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:02.871 16:38:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:02.871 16:38:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:02.871 16:38:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:02.871 16:38:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:02.871 16:38:27 -- common/autotest_common.sh@1187 -- # return 0 00:14:02.871 16:38:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:02.871 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:02.871 16:38:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:02.871 16:38:27 -- common/autotest_common.sh@1198 -- # local i=0 00:14:02.871 16:38:27 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:02.871 16:38:27 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:02.871 16:38:27 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:02.871 16:38:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:02.871 16:38:27 -- common/autotest_common.sh@1210 -- # return 0 00:14:02.871 16:38:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:02.871 16:38:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.871 16:38:27 -- common/autotest_common.sh@10 -- # set +x 00:14:02.871 16:38:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.871 16:38:27 -- target/rpc.sh@81 -- # seq 1 5 00:14:02.871 16:38:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:02.871 16:38:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:02.871 16:38:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.871 16:38:27 -- common/autotest_common.sh@10 -- # set +x 00:14:02.871 16:38:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.871 16:38:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:02.871 16:38:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.871 16:38:27 -- common/autotest_common.sh@10 -- # set +x 00:14:02.871 [2024-10-13 16:38:27.933492] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:02.871 16:38:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.871 16:38:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:02.871 16:38:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.871 16:38:27 -- common/autotest_common.sh@10 -- # set +x 00:14:02.871 16:38:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.871 16:38:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:02.871 16:38:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.871 16:38:27 -- common/autotest_common.sh@10 -- # set +x 00:14:02.871 16:38:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.871 16:38:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:03.436 16:38:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:03.436 16:38:28 -- common/autotest_common.sh@1177 -- # local i=0 00:14:03.436 16:38:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:03.436 16:38:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:03.436 16:38:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:05.340 16:38:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:05.340 16:38:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:05.340 16:38:30 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:05.340 16:38:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:05.340 16:38:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:05.340 16:38:30 -- common/autotest_common.sh@1187 -- # return 0 00:14:05.340 16:38:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:05.340 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:05.340 16:38:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:05.340 16:38:30 -- common/autotest_common.sh@1198 -- # local i=0 00:14:05.340 16:38:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:05.340 16:38:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:05.340 16:38:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:05.340 16:38:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:05.340 16:38:30 -- common/autotest_common.sh@1210 -- # return 0 00:14:05.340 16:38:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:05.340 16:38:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 [2024-10-13 16:38:30.773031] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:05.340 16:38:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.340 16:38:30 -- common/autotest_common.sh@10 -- # set +x 00:14:05.340 16:38:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.340 16:38:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:05.910 16:38:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:05.910 16:38:31 -- common/autotest_common.sh@1177 -- # local i=0 00:14:05.910 16:38:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:05.910 16:38:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:05.910 16:38:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:08.502 16:38:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:08.502 16:38:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:08.502 16:38:33 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:08.502 16:38:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:08.502 16:38:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:08.502 16:38:33 -- common/autotest_common.sh@1187 -- # return 0 00:14:08.502 16:38:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:08.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:08.502 16:38:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:08.502 16:38:33 -- common/autotest_common.sh@1198 -- # local i=0 00:14:08.502 16:38:33 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:08.502 16:38:33 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:08.502 16:38:33 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:08.502 16:38:33 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:08.502 16:38:33 -- common/autotest_common.sh@1210 -- # return 0 00:14:08.502 16:38:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:08.502 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.502 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.502 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.502 16:38:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:08.502 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.502 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.502 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.502 16:38:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:08.502 16:38:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:08.502 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.502 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.502 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.502 16:38:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:08.502 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.502 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.502 [2024-10-13 16:38:33.543204] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:08.502 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.503 16:38:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:08.503 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.503 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.503 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.503 16:38:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:08.503 16:38:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.503 16:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:08.503 16:38:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.503 16:38:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:08.760 16:38:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:08.760 16:38:34 -- common/autotest_common.sh@1177 -- # local i=0 00:14:08.760 16:38:34 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:08.760 16:38:34 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:08.760 16:38:34 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:11.287 16:38:36 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:11.287 16:38:36 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:11.287 16:38:36 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:11.287 16:38:36 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:11.287 16:38:36 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:11.287 16:38:36 -- common/autotest_common.sh@1187 -- # return 0 00:14:11.287 16:38:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:11.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:11.287 16:38:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:11.287 16:38:36 -- common/autotest_common.sh@1198 -- # local i=0 00:14:11.287 16:38:36 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:11.287 16:38:36 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:11.287 16:38:36 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:11.287 16:38:36 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:11.287 16:38:36 -- common/autotest_common.sh@1210 -- # return 0 00:14:11.287 16:38:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:11.287 16:38:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 [2024-10-13 16:38:36.445738] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:11.287 16:38:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:11.287 16:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:11.287 16:38:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:11.287 16:38:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:11.854 16:38:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:11.854 16:38:37 -- common/autotest_common.sh@1177 -- # local i=0 00:14:11.854 16:38:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:11.854 16:38:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:11.854 16:38:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:13.751 16:38:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:13.751 16:38:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:13.751 16:38:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:13.751 16:38:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:13.751 16:38:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:13.751 16:38:39 -- common/autotest_common.sh@1187 -- # return 0 00:14:13.751 16:38:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:13.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:13.751 16:38:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:13.751 16:38:39 -- common/autotest_common.sh@1198 -- # local i=0 00:14:13.751 16:38:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:13.751 16:38:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.751 16:38:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:13.751 16:38:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.751 16:38:39 -- common/autotest_common.sh@1210 -- # return 0 00:14:13.751 16:38:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:13.751 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:13.751 16:38:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:13.751 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:13.751 16:38:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:13.751 16:38:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:13.751 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:13.751 16:38:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:13.751 [2024-10-13 16:38:39.232170] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:13.751 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:13.751 16:38:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:13.751 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:13.751 16:38:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:13.751 16:38:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:13.751 16:38:39 -- common/autotest_common.sh@10 -- # set +x 00:14:14.009 16:38:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:14.009 16:38:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:14.574 16:38:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:14.574 16:38:39 -- common/autotest_common.sh@1177 -- # local i=0 00:14:14.574 16:38:39 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:14.574 16:38:39 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:14:14.574 16:38:39 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:16.472 16:38:41 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:16.472 16:38:41 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:16.472 16:38:41 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:16.472 16:38:41 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:14:16.472 16:38:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:16.472 16:38:41 -- common/autotest_common.sh@1187 -- # return 0 00:14:16.472 16:38:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:16.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:16.472 16:38:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:16.472 16:38:41 -- common/autotest_common.sh@1198 -- # local i=0 00:14:16.472 16:38:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:16.472 16:38:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:16.472 16:38:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:16.472 16:38:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:16.731 16:38:41 -- common/autotest_common.sh@1210 -- # return 0 00:14:16.731 16:38:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.731 16:38:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:41 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:41 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:41 -- target/rpc.sh@99 -- # seq 1 5 00:14:16.731 16:38:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:16.731 16:38:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.731 16:38:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:41 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 [2024-10-13 16:38:42.008481] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:16.731 16:38:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 [2024-10-13 16:38:42.056519] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:16.731 16:38:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 [2024-10-13 16:38:42.104701] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:16.731 16:38:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.731 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 [2024-10-13 16:38:42.152875] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.731 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.731 16:38:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.731 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:16.732 16:38:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 [2024-10-13 16:38:42.201042] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.732 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.732 16:38:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.732 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.732 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.990 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.990 16:38:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:14:16.990 16:38:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:16.990 16:38:42 -- common/autotest_common.sh@10 -- # set +x 00:14:16.990 16:38:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:16.990 16:38:42 -- target/rpc.sh@110 -- # stats='{ 00:14:16.990 "tick_rate": 2700000000, 00:14:16.990 "poll_groups": [ 00:14:16.990 { 00:14:16.990 "name": "nvmf_tgt_poll_group_0", 00:14:16.990 "admin_qpairs": 2, 00:14:16.990 "io_qpairs": 84, 00:14:16.990 "current_admin_qpairs": 0, 00:14:16.990 "current_io_qpairs": 0, 00:14:16.990 "pending_bdev_io": 0, 00:14:16.990 "completed_nvme_io": 183, 00:14:16.990 "transports": [ 00:14:16.990 { 00:14:16.990 "trtype": "TCP" 00:14:16.990 } 00:14:16.990 ] 00:14:16.990 }, 00:14:16.990 { 00:14:16.990 "name": "nvmf_tgt_poll_group_1", 00:14:16.990 "admin_qpairs": 2, 00:14:16.990 "io_qpairs": 84, 00:14:16.990 "current_admin_qpairs": 0, 00:14:16.990 "current_io_qpairs": 0, 00:14:16.990 "pending_bdev_io": 0, 00:14:16.990 "completed_nvme_io": 175, 00:14:16.990 "transports": [ 00:14:16.990 { 00:14:16.990 "trtype": "TCP" 00:14:16.990 } 00:14:16.990 ] 00:14:16.990 }, 00:14:16.990 { 00:14:16.990 "name": "nvmf_tgt_poll_group_2", 00:14:16.990 "admin_qpairs": 1, 00:14:16.990 "io_qpairs": 84, 00:14:16.990 "current_admin_qpairs": 0, 00:14:16.990 "current_io_qpairs": 0, 00:14:16.990 "pending_bdev_io": 0, 00:14:16.990 "completed_nvme_io": 94, 00:14:16.990 "transports": [ 00:14:16.990 { 00:14:16.990 "trtype": "TCP" 00:14:16.990 } 00:14:16.990 ] 00:14:16.990 }, 00:14:16.990 { 00:14:16.990 "name": "nvmf_tgt_poll_group_3", 00:14:16.990 "admin_qpairs": 2, 00:14:16.990 "io_qpairs": 84, 00:14:16.990 "current_admin_qpairs": 0, 00:14:16.990 "current_io_qpairs": 0, 00:14:16.990 "pending_bdev_io": 0, 00:14:16.990 "completed_nvme_io": 234, 00:14:16.990 "transports": [ 00:14:16.990 { 00:14:16.990 "trtype": "TCP" 00:14:16.990 } 00:14:16.990 ] 00:14:16.990 } 00:14:16.990 ] 00:14:16.990 }' 00:14:16.990 16:38:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:16.990 16:38:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:14:16.990 16:38:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:16.990 16:38:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:16.990 16:38:42 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:14:16.990 16:38:42 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:14:16.990 16:38:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:14:16.990 16:38:42 -- target/rpc.sh@123 -- # nvmftestfini 00:14:16.990 16:38:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:16.990 16:38:42 -- nvmf/common.sh@116 -- # sync 00:14:16.990 16:38:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:16.990 16:38:42 -- nvmf/common.sh@119 -- # set +e 00:14:16.990 16:38:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:16.990 16:38:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:16.990 rmmod nvme_tcp 00:14:16.990 rmmod nvme_fabrics 00:14:16.990 rmmod nvme_keyring 00:14:16.990 16:38:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:16.990 16:38:42 -- nvmf/common.sh@123 -- # set -e 00:14:16.990 16:38:42 -- nvmf/common.sh@124 -- # return 0 00:14:16.990 16:38:42 -- nvmf/common.sh@477 -- # '[' -n 1145288 ']' 00:14:16.990 16:38:42 -- nvmf/common.sh@478 -- # killprocess 1145288 00:14:16.990 16:38:42 -- common/autotest_common.sh@926 -- # '[' -z 1145288 ']' 00:14:16.990 16:38:42 -- common/autotest_common.sh@930 -- # kill -0 1145288 00:14:16.990 16:38:42 -- common/autotest_common.sh@931 -- # uname 00:14:16.990 16:38:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:16.990 16:38:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1145288 00:14:16.990 16:38:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:16.990 16:38:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:16.990 16:38:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1145288' 00:14:16.990 killing process with pid 1145288 00:14:16.990 16:38:42 -- common/autotest_common.sh@945 -- # kill 1145288 00:14:16.990 16:38:42 -- common/autotest_common.sh@950 -- # wait 1145288 00:14:17.249 16:38:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:17.249 16:38:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:17.249 16:38:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:17.249 16:38:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:17.249 16:38:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:17.249 16:38:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.249 16:38:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.249 16:38:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.788 16:38:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:19.788 00:14:19.788 real 0m25.946s 00:14:19.788 user 1m25.365s 00:14:19.788 sys 0m4.118s 00:14:19.788 16:38:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:19.788 16:38:44 -- common/autotest_common.sh@10 -- # set +x 00:14:19.788 ************************************ 00:14:19.788 END TEST nvmf_rpc 00:14:19.788 ************************************ 00:14:19.788 16:38:44 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:14:19.788 16:38:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:19.788 16:38:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:19.788 16:38:44 -- common/autotest_common.sh@10 -- # set +x 00:14:19.788 ************************************ 00:14:19.788 START TEST nvmf_invalid 00:14:19.788 ************************************ 00:14:19.788 16:38:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:14:19.788 * Looking for test storage... 00:14:19.789 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:19.789 16:38:44 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:19.789 16:38:44 -- nvmf/common.sh@7 -- # uname -s 00:14:19.789 16:38:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:19.789 16:38:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:19.789 16:38:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:19.789 16:38:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:19.789 16:38:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:19.789 16:38:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:19.789 16:38:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:19.789 16:38:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:19.789 16:38:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:19.789 16:38:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:19.789 16:38:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.789 16:38:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.789 16:38:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:19.789 16:38:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:19.789 16:38:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:19.789 16:38:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:19.789 16:38:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:19.789 16:38:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:19.789 16:38:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:19.789 16:38:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.789 16:38:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.789 16:38:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.789 16:38:44 -- paths/export.sh@5 -- # export PATH 00:14:19.789 16:38:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.789 16:38:44 -- nvmf/common.sh@46 -- # : 0 00:14:19.789 16:38:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:19.789 16:38:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:19.789 16:38:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:19.789 16:38:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:19.789 16:38:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:19.789 16:38:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:19.789 16:38:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:19.789 16:38:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:19.789 16:38:44 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:14:19.789 16:38:44 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:19.789 16:38:44 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:14:19.789 16:38:44 -- target/invalid.sh@14 -- # target=foobar 00:14:19.789 16:38:44 -- target/invalid.sh@16 -- # RANDOM=0 00:14:19.789 16:38:44 -- target/invalid.sh@34 -- # nvmftestinit 00:14:19.789 16:38:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:19.789 16:38:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:19.789 16:38:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:19.789 16:38:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:19.789 16:38:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:19.789 16:38:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:19.789 16:38:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:19.789 16:38:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.789 16:38:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:19.789 16:38:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:19.789 16:38:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:19.789 16:38:44 -- common/autotest_common.sh@10 -- # set +x 00:14:21.695 16:38:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:21.695 16:38:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:21.695 16:38:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:21.695 16:38:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:21.695 16:38:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:21.695 16:38:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:21.695 16:38:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:21.695 16:38:46 -- nvmf/common.sh@294 -- # net_devs=() 00:14:21.695 16:38:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:21.695 16:38:46 -- nvmf/common.sh@295 -- # e810=() 00:14:21.695 16:38:46 -- nvmf/common.sh@295 -- # local -ga e810 00:14:21.695 16:38:46 -- nvmf/common.sh@296 -- # x722=() 00:14:21.695 16:38:46 -- nvmf/common.sh@296 -- # local -ga x722 00:14:21.695 16:38:46 -- nvmf/common.sh@297 -- # mlx=() 00:14:21.695 16:38:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:21.695 16:38:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:21.695 16:38:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:21.695 16:38:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:21.695 16:38:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:21.695 16:38:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:21.695 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:21.695 16:38:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:21.695 16:38:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:21.695 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:21.695 16:38:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:21.695 16:38:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:21.695 16:38:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:21.695 16:38:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:21.695 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:21.695 16:38:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:21.695 16:38:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:21.695 16:38:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:21.695 16:38:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:21.695 16:38:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:21.695 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:21.695 16:38:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:21.695 16:38:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:21.695 16:38:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:21.695 16:38:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:21.695 16:38:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:21.695 16:38:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:21.695 16:38:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:21.695 16:38:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:21.695 16:38:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:21.695 16:38:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:21.695 16:38:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:21.695 16:38:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:21.695 16:38:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:21.695 16:38:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:21.695 16:38:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:21.695 16:38:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:21.695 16:38:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:21.695 16:38:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:21.695 16:38:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:21.695 16:38:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:21.695 16:38:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:21.695 16:38:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:21.695 16:38:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:21.695 16:38:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:21.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:21.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:14:21.695 00:14:21.695 --- 10.0.0.2 ping statistics --- 00:14:21.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:21.695 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:14:21.695 16:38:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:21.695 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:21.695 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:14:21.695 00:14:21.695 --- 10.0.0.1 ping statistics --- 00:14:21.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:21.695 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:14:21.695 16:38:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:21.695 16:38:47 -- nvmf/common.sh@410 -- # return 0 00:14:21.695 16:38:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:21.695 16:38:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:21.695 16:38:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:21.695 16:38:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:21.695 16:38:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:21.695 16:38:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:21.695 16:38:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:21.695 16:38:47 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:14:21.695 16:38:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:21.695 16:38:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:21.695 16:38:47 -- common/autotest_common.sh@10 -- # set +x 00:14:21.695 16:38:47 -- nvmf/common.sh@469 -- # nvmfpid=1150002 00:14:21.695 16:38:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:21.695 16:38:47 -- nvmf/common.sh@470 -- # waitforlisten 1150002 00:14:21.695 16:38:47 -- common/autotest_common.sh@819 -- # '[' -z 1150002 ']' 00:14:21.695 16:38:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:21.695 16:38:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:21.695 16:38:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:21.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:21.695 16:38:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:21.695 16:38:47 -- common/autotest_common.sh@10 -- # set +x 00:14:21.695 [2024-10-13 16:38:47.096498] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:14:21.695 [2024-10-13 16:38:47.096579] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:21.695 EAL: No free 2048 kB hugepages reported on node 1 00:14:21.695 [2024-10-13 16:38:47.169909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:21.954 [2024-10-13 16:38:47.263576] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:21.954 [2024-10-13 16:38:47.263748] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:21.954 [2024-10-13 16:38:47.263768] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:21.954 [2024-10-13 16:38:47.263782] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:21.954 [2024-10-13 16:38:47.263875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:21.954 [2024-10-13 16:38:47.263938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:21.954 [2024-10-13 16:38:47.263993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:21.954 [2024-10-13 16:38:47.263996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:22.887 16:38:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:22.887 16:38:48 -- common/autotest_common.sh@852 -- # return 0 00:14:22.887 16:38:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:22.887 16:38:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:22.887 16:38:48 -- common/autotest_common.sh@10 -- # set +x 00:14:22.887 16:38:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:22.887 16:38:48 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:22.887 16:38:48 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode30110 00:14:22.887 [2024-10-13 16:38:48.307745] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:14:22.887 16:38:48 -- target/invalid.sh@40 -- # out='request: 00:14:22.887 { 00:14:22.887 "nqn": "nqn.2016-06.io.spdk:cnode30110", 00:14:22.887 "tgt_name": "foobar", 00:14:22.887 "method": "nvmf_create_subsystem", 00:14:22.887 "req_id": 1 00:14:22.887 } 00:14:22.887 Got JSON-RPC error response 00:14:22.887 response: 00:14:22.887 { 00:14:22.887 "code": -32603, 00:14:22.887 "message": "Unable to find target foobar" 00:14:22.887 }' 00:14:22.887 16:38:48 -- target/invalid.sh@41 -- # [[ request: 00:14:22.887 { 00:14:22.887 "nqn": "nqn.2016-06.io.spdk:cnode30110", 00:14:22.887 "tgt_name": "foobar", 00:14:22.887 "method": "nvmf_create_subsystem", 00:14:22.887 "req_id": 1 00:14:22.887 } 00:14:22.887 Got JSON-RPC error response 00:14:22.887 response: 00:14:22.887 { 00:14:22.887 "code": -32603, 00:14:22.887 "message": "Unable to find target foobar" 00:14:22.887 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:14:22.887 16:38:48 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:14:22.887 16:38:48 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode12270 00:14:23.145 [2024-10-13 16:38:48.560617] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12270: invalid serial number 'SPDKISFASTANDAWESOME' 00:14:23.145 16:38:48 -- target/invalid.sh@45 -- # out='request: 00:14:23.145 { 00:14:23.145 "nqn": "nqn.2016-06.io.spdk:cnode12270", 00:14:23.145 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:23.145 "method": "nvmf_create_subsystem", 00:14:23.145 "req_id": 1 00:14:23.145 } 00:14:23.145 Got JSON-RPC error response 00:14:23.145 response: 00:14:23.145 { 00:14:23.145 "code": -32602, 00:14:23.145 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:23.145 }' 00:14:23.145 16:38:48 -- target/invalid.sh@46 -- # [[ request: 00:14:23.145 { 00:14:23.145 "nqn": "nqn.2016-06.io.spdk:cnode12270", 00:14:23.145 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:23.145 "method": "nvmf_create_subsystem", 00:14:23.145 "req_id": 1 00:14:23.145 } 00:14:23.145 Got JSON-RPC error response 00:14:23.145 response: 00:14:23.145 { 00:14:23.145 "code": -32602, 00:14:23.145 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:23.145 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:23.145 16:38:48 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:14:23.145 16:38:48 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode30331 00:14:23.403 [2024-10-13 16:38:48.821478] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30331: invalid model number 'SPDK_Controller' 00:14:23.403 16:38:48 -- target/invalid.sh@50 -- # out='request: 00:14:23.403 { 00:14:23.403 "nqn": "nqn.2016-06.io.spdk:cnode30331", 00:14:23.403 "model_number": "SPDK_Controller\u001f", 00:14:23.403 "method": "nvmf_create_subsystem", 00:14:23.403 "req_id": 1 00:14:23.403 } 00:14:23.403 Got JSON-RPC error response 00:14:23.403 response: 00:14:23.403 { 00:14:23.403 "code": -32602, 00:14:23.403 "message": "Invalid MN SPDK_Controller\u001f" 00:14:23.403 }' 00:14:23.403 16:38:48 -- target/invalid.sh@51 -- # [[ request: 00:14:23.403 { 00:14:23.403 "nqn": "nqn.2016-06.io.spdk:cnode30331", 00:14:23.403 "model_number": "SPDK_Controller\u001f", 00:14:23.403 "method": "nvmf_create_subsystem", 00:14:23.403 "req_id": 1 00:14:23.403 } 00:14:23.403 Got JSON-RPC error response 00:14:23.403 response: 00:14:23.403 { 00:14:23.403 "code": -32602, 00:14:23.403 "message": "Invalid MN SPDK_Controller\u001f" 00:14:23.403 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:23.403 16:38:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:14:23.403 16:38:48 -- target/invalid.sh@19 -- # local length=21 ll 00:14:23.403 16:38:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:23.403 16:38:48 -- target/invalid.sh@21 -- # local chars 00:14:23.403 16:38:48 -- target/invalid.sh@22 -- # local string 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 80 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=P 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 76 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=L 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 69 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x45' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=E 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 118 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=v 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 66 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x42' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=B 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 47 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=/ 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 86 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x56' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=V 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 118 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=v 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 104 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x68' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=h 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 110 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=n 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 73 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x49' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=I 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 101 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x65' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=e 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 106 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=j 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 61 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+== 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 119 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x77' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=w 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 50 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x32' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=2 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # printf %x 98 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x62' 00:14:23.403 16:38:48 -- target/invalid.sh@25 -- # string+=b 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.403 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # printf %x 43 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # string+=+ 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # printf %x 99 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x63' 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # string+=c 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # printf %x 40 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x28' 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # string+='(' 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # printf %x 89 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # echo -e '\x59' 00:14:23.661 16:38:48 -- target/invalid.sh@25 -- # string+=Y 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.661 16:38:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.661 16:38:48 -- target/invalid.sh@28 -- # [[ P == \- ]] 00:14:23.661 16:38:48 -- target/invalid.sh@31 -- # echo 'PLEvB/VvhnIej=w2b+c(Y' 00:14:23.661 16:38:48 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'PLEvB/VvhnIej=w2b+c(Y' nqn.2016-06.io.spdk:cnode21116 00:14:23.661 [2024-10-13 16:38:49.158560] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21116: invalid serial number 'PLEvB/VvhnIej=w2b+c(Y' 00:14:23.919 16:38:49 -- target/invalid.sh@54 -- # out='request: 00:14:23.919 { 00:14:23.919 "nqn": "nqn.2016-06.io.spdk:cnode21116", 00:14:23.919 "serial_number": "PLEvB/VvhnIej=w2b+c(Y", 00:14:23.919 "method": "nvmf_create_subsystem", 00:14:23.919 "req_id": 1 00:14:23.919 } 00:14:23.919 Got JSON-RPC error response 00:14:23.919 response: 00:14:23.919 { 00:14:23.919 "code": -32602, 00:14:23.919 "message": "Invalid SN PLEvB/VvhnIej=w2b+c(Y" 00:14:23.919 }' 00:14:23.919 16:38:49 -- target/invalid.sh@55 -- # [[ request: 00:14:23.919 { 00:14:23.919 "nqn": "nqn.2016-06.io.spdk:cnode21116", 00:14:23.919 "serial_number": "PLEvB/VvhnIej=w2b+c(Y", 00:14:23.919 "method": "nvmf_create_subsystem", 00:14:23.919 "req_id": 1 00:14:23.919 } 00:14:23.919 Got JSON-RPC error response 00:14:23.919 response: 00:14:23.919 { 00:14:23.919 "code": -32602, 00:14:23.919 "message": "Invalid SN PLEvB/VvhnIej=w2b+c(Y" 00:14:23.919 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:23.919 16:38:49 -- target/invalid.sh@58 -- # gen_random_s 41 00:14:23.919 16:38:49 -- target/invalid.sh@19 -- # local length=41 ll 00:14:23.919 16:38:49 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:23.919 16:38:49 -- target/invalid.sh@21 -- # local chars 00:14:23.919 16:38:49 -- target/invalid.sh@22 -- # local string 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # printf %x 118 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x76' 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # string+=v 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # printf %x 54 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x36' 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # string+=6 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.919 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # printf %x 109 00:14:23.919 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=m 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 52 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x34' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=4 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 88 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x58' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=X 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 37 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x25' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=% 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 116 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x74' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=t 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 72 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x48' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=H 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 102 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x66' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=f 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 75 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=K 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 76 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=L 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 106 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=j 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 119 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x77' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=w 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 57 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x39' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=9 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 47 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=/ 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 102 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x66' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=f 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 111 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=o 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 84 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x54' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=T 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 123 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='{' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 122 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=z 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 35 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x23' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='#' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 91 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='[' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 125 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='}' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 111 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=o 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 71 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x47' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=G 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 49 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x31' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=1 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 77 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=M 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 46 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=. 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 79 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=O 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 72 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x48' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=H 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 102 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x66' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=f 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 119 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x77' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=w 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 65 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x41' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=A 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 44 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=, 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 101 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x65' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=e 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 38 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x26' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='&' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 34 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x22' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+='"' 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 85 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=U 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.920 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # printf %x 85 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:14:23.920 16:38:49 -- target/invalid.sh@25 -- # string+=U 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # printf %x 86 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x56' 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # string+=V 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # printf %x 108 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:14:23.921 16:38:49 -- target/invalid.sh@25 -- # string+=l 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:23.921 16:38:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:23.921 16:38:49 -- target/invalid.sh@28 -- # [[ v == \- ]] 00:14:23.921 16:38:49 -- target/invalid.sh@31 -- # echo 'v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&"UUVl' 00:14:23.921 16:38:49 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&"UUVl' nqn.2016-06.io.spdk:cnode32014 00:14:24.178 [2024-10-13 16:38:49.568008] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32014: invalid model number 'v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&"UUVl' 00:14:24.178 16:38:49 -- target/invalid.sh@58 -- # out='request: 00:14:24.178 { 00:14:24.178 "nqn": "nqn.2016-06.io.spdk:cnode32014", 00:14:24.178 "model_number": "v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&\"UUVl", 00:14:24.178 "method": "nvmf_create_subsystem", 00:14:24.178 "req_id": 1 00:14:24.178 } 00:14:24.178 Got JSON-RPC error response 00:14:24.178 response: 00:14:24.178 { 00:14:24.178 "code": -32602, 00:14:24.178 "message": "Invalid MN v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&\"UUVl" 00:14:24.178 }' 00:14:24.178 16:38:49 -- target/invalid.sh@59 -- # [[ request: 00:14:24.178 { 00:14:24.178 "nqn": "nqn.2016-06.io.spdk:cnode32014", 00:14:24.178 "model_number": "v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&\"UUVl", 00:14:24.178 "method": "nvmf_create_subsystem", 00:14:24.178 "req_id": 1 00:14:24.178 } 00:14:24.178 Got JSON-RPC error response 00:14:24.178 response: 00:14:24.178 { 00:14:24.178 "code": -32602, 00:14:24.178 "message": "Invalid MN v6m4X%tHfKLjw9/foT{z#[}oG1M.OHfwA,e&\"UUVl" 00:14:24.178 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:24.178 16:38:49 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:14:24.435 [2024-10-13 16:38:49.812922] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:24.435 16:38:49 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:14:24.695 16:38:50 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:14:24.695 16:38:50 -- target/invalid.sh@67 -- # echo '' 00:14:24.695 16:38:50 -- target/invalid.sh@67 -- # head -n 1 00:14:24.695 16:38:50 -- target/invalid.sh@67 -- # IP= 00:14:24.695 16:38:50 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:14:24.952 [2024-10-13 16:38:50.346820] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:14:24.952 16:38:50 -- target/invalid.sh@69 -- # out='request: 00:14:24.952 { 00:14:24.952 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:24.952 "listen_address": { 00:14:24.953 "trtype": "tcp", 00:14:24.953 "traddr": "", 00:14:24.953 "trsvcid": "4421" 00:14:24.953 }, 00:14:24.953 "method": "nvmf_subsystem_remove_listener", 00:14:24.953 "req_id": 1 00:14:24.953 } 00:14:24.953 Got JSON-RPC error response 00:14:24.953 response: 00:14:24.953 { 00:14:24.953 "code": -32602, 00:14:24.953 "message": "Invalid parameters" 00:14:24.953 }' 00:14:24.953 16:38:50 -- target/invalid.sh@70 -- # [[ request: 00:14:24.953 { 00:14:24.953 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:24.953 "listen_address": { 00:14:24.953 "trtype": "tcp", 00:14:24.953 "traddr": "", 00:14:24.953 "trsvcid": "4421" 00:14:24.953 }, 00:14:24.953 "method": "nvmf_subsystem_remove_listener", 00:14:24.953 "req_id": 1 00:14:24.953 } 00:14:24.953 Got JSON-RPC error response 00:14:24.953 response: 00:14:24.953 { 00:14:24.953 "code": -32602, 00:14:24.953 "message": "Invalid parameters" 00:14:24.953 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:14:24.953 16:38:50 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16354 -i 0 00:14:25.210 [2024-10-13 16:38:50.599623] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16354: invalid cntlid range [0-65519] 00:14:25.210 16:38:50 -- target/invalid.sh@73 -- # out='request: 00:14:25.210 { 00:14:25.210 "nqn": "nqn.2016-06.io.spdk:cnode16354", 00:14:25.210 "min_cntlid": 0, 00:14:25.210 "method": "nvmf_create_subsystem", 00:14:25.210 "req_id": 1 00:14:25.210 } 00:14:25.210 Got JSON-RPC error response 00:14:25.210 response: 00:14:25.210 { 00:14:25.210 "code": -32602, 00:14:25.210 "message": "Invalid cntlid range [0-65519]" 00:14:25.210 }' 00:14:25.210 16:38:50 -- target/invalid.sh@74 -- # [[ request: 00:14:25.210 { 00:14:25.210 "nqn": "nqn.2016-06.io.spdk:cnode16354", 00:14:25.210 "min_cntlid": 0, 00:14:25.210 "method": "nvmf_create_subsystem", 00:14:25.210 "req_id": 1 00:14:25.210 } 00:14:25.210 Got JSON-RPC error response 00:14:25.210 response: 00:14:25.210 { 00:14:25.210 "code": -32602, 00:14:25.210 "message": "Invalid cntlid range [0-65519]" 00:14:25.210 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:25.210 16:38:50 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27228 -i 65520 00:14:25.468 [2024-10-13 16:38:50.844507] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27228: invalid cntlid range [65520-65519] 00:14:25.468 16:38:50 -- target/invalid.sh@75 -- # out='request: 00:14:25.468 { 00:14:25.468 "nqn": "nqn.2016-06.io.spdk:cnode27228", 00:14:25.468 "min_cntlid": 65520, 00:14:25.468 "method": "nvmf_create_subsystem", 00:14:25.468 "req_id": 1 00:14:25.468 } 00:14:25.468 Got JSON-RPC error response 00:14:25.468 response: 00:14:25.468 { 00:14:25.468 "code": -32602, 00:14:25.468 "message": "Invalid cntlid range [65520-65519]" 00:14:25.468 }' 00:14:25.468 16:38:50 -- target/invalid.sh@76 -- # [[ request: 00:14:25.468 { 00:14:25.468 "nqn": "nqn.2016-06.io.spdk:cnode27228", 00:14:25.468 "min_cntlid": 65520, 00:14:25.468 "method": "nvmf_create_subsystem", 00:14:25.468 "req_id": 1 00:14:25.468 } 00:14:25.468 Got JSON-RPC error response 00:14:25.468 response: 00:14:25.468 { 00:14:25.468 "code": -32602, 00:14:25.468 "message": "Invalid cntlid range [65520-65519]" 00:14:25.468 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:25.468 16:38:50 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8663 -I 0 00:14:25.725 [2024-10-13 16:38:51.121471] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8663: invalid cntlid range [1-0] 00:14:25.725 16:38:51 -- target/invalid.sh@77 -- # out='request: 00:14:25.725 { 00:14:25.725 "nqn": "nqn.2016-06.io.spdk:cnode8663", 00:14:25.725 "max_cntlid": 0, 00:14:25.725 "method": "nvmf_create_subsystem", 00:14:25.725 "req_id": 1 00:14:25.725 } 00:14:25.725 Got JSON-RPC error response 00:14:25.725 response: 00:14:25.725 { 00:14:25.725 "code": -32602, 00:14:25.725 "message": "Invalid cntlid range [1-0]" 00:14:25.725 }' 00:14:25.725 16:38:51 -- target/invalid.sh@78 -- # [[ request: 00:14:25.725 { 00:14:25.725 "nqn": "nqn.2016-06.io.spdk:cnode8663", 00:14:25.725 "max_cntlid": 0, 00:14:25.725 "method": "nvmf_create_subsystem", 00:14:25.726 "req_id": 1 00:14:25.726 } 00:14:25.726 Got JSON-RPC error response 00:14:25.726 response: 00:14:25.726 { 00:14:25.726 "code": -32602, 00:14:25.726 "message": "Invalid cntlid range [1-0]" 00:14:25.726 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:25.726 16:38:51 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18829 -I 65520 00:14:25.983 [2024-10-13 16:38:51.378331] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18829: invalid cntlid range [1-65520] 00:14:25.983 16:38:51 -- target/invalid.sh@79 -- # out='request: 00:14:25.983 { 00:14:25.983 "nqn": "nqn.2016-06.io.spdk:cnode18829", 00:14:25.983 "max_cntlid": 65520, 00:14:25.983 "method": "nvmf_create_subsystem", 00:14:25.983 "req_id": 1 00:14:25.983 } 00:14:25.983 Got JSON-RPC error response 00:14:25.983 response: 00:14:25.983 { 00:14:25.983 "code": -32602, 00:14:25.983 "message": "Invalid cntlid range [1-65520]" 00:14:25.983 }' 00:14:25.983 16:38:51 -- target/invalid.sh@80 -- # [[ request: 00:14:25.983 { 00:14:25.983 "nqn": "nqn.2016-06.io.spdk:cnode18829", 00:14:25.983 "max_cntlid": 65520, 00:14:25.983 "method": "nvmf_create_subsystem", 00:14:25.983 "req_id": 1 00:14:25.983 } 00:14:25.983 Got JSON-RPC error response 00:14:25.983 response: 00:14:25.983 { 00:14:25.983 "code": -32602, 00:14:25.983 "message": "Invalid cntlid range [1-65520]" 00:14:25.983 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:25.983 16:38:51 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18968 -i 6 -I 5 00:14:26.240 [2024-10-13 16:38:51.623181] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18968: invalid cntlid range [6-5] 00:14:26.240 16:38:51 -- target/invalid.sh@83 -- # out='request: 00:14:26.240 { 00:14:26.240 "nqn": "nqn.2016-06.io.spdk:cnode18968", 00:14:26.240 "min_cntlid": 6, 00:14:26.240 "max_cntlid": 5, 00:14:26.240 "method": "nvmf_create_subsystem", 00:14:26.240 "req_id": 1 00:14:26.240 } 00:14:26.240 Got JSON-RPC error response 00:14:26.240 response: 00:14:26.240 { 00:14:26.240 "code": -32602, 00:14:26.240 "message": "Invalid cntlid range [6-5]" 00:14:26.240 }' 00:14:26.240 16:38:51 -- target/invalid.sh@84 -- # [[ request: 00:14:26.240 { 00:14:26.240 "nqn": "nqn.2016-06.io.spdk:cnode18968", 00:14:26.240 "min_cntlid": 6, 00:14:26.240 "max_cntlid": 5, 00:14:26.240 "method": "nvmf_create_subsystem", 00:14:26.240 "req_id": 1 00:14:26.240 } 00:14:26.240 Got JSON-RPC error response 00:14:26.240 response: 00:14:26.240 { 00:14:26.240 "code": -32602, 00:14:26.240 "message": "Invalid cntlid range [6-5]" 00:14:26.240 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:26.240 16:38:51 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:14:26.499 16:38:51 -- target/invalid.sh@87 -- # out='request: 00:14:26.499 { 00:14:26.499 "name": "foobar", 00:14:26.499 "method": "nvmf_delete_target", 00:14:26.499 "req_id": 1 00:14:26.499 } 00:14:26.499 Got JSON-RPC error response 00:14:26.499 response: 00:14:26.499 { 00:14:26.499 "code": -32602, 00:14:26.499 "message": "The specified target doesn'\''t exist, cannot delete it." 00:14:26.499 }' 00:14:26.499 16:38:51 -- target/invalid.sh@88 -- # [[ request: 00:14:26.499 { 00:14:26.499 "name": "foobar", 00:14:26.499 "method": "nvmf_delete_target", 00:14:26.499 "req_id": 1 00:14:26.499 } 00:14:26.499 Got JSON-RPC error response 00:14:26.499 response: 00:14:26.499 { 00:14:26.499 "code": -32602, 00:14:26.499 "message": "The specified target doesn't exist, cannot delete it." 00:14:26.499 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:14:26.499 16:38:51 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:14:26.499 16:38:51 -- target/invalid.sh@91 -- # nvmftestfini 00:14:26.499 16:38:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:26.499 16:38:51 -- nvmf/common.sh@116 -- # sync 00:14:26.499 16:38:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:26.499 16:38:51 -- nvmf/common.sh@119 -- # set +e 00:14:26.499 16:38:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:26.499 16:38:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:26.499 rmmod nvme_tcp 00:14:26.499 rmmod nvme_fabrics 00:14:26.499 rmmod nvme_keyring 00:14:26.499 16:38:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:26.499 16:38:51 -- nvmf/common.sh@123 -- # set -e 00:14:26.499 16:38:51 -- nvmf/common.sh@124 -- # return 0 00:14:26.499 16:38:51 -- nvmf/common.sh@477 -- # '[' -n 1150002 ']' 00:14:26.499 16:38:51 -- nvmf/common.sh@478 -- # killprocess 1150002 00:14:26.499 16:38:51 -- common/autotest_common.sh@926 -- # '[' -z 1150002 ']' 00:14:26.499 16:38:51 -- common/autotest_common.sh@930 -- # kill -0 1150002 00:14:26.499 16:38:51 -- common/autotest_common.sh@931 -- # uname 00:14:26.499 16:38:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:26.499 16:38:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1150002 00:14:26.499 16:38:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:26.499 16:38:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:26.499 16:38:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1150002' 00:14:26.499 killing process with pid 1150002 00:14:26.499 16:38:51 -- common/autotest_common.sh@945 -- # kill 1150002 00:14:26.499 16:38:51 -- common/autotest_common.sh@950 -- # wait 1150002 00:14:26.758 16:38:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:26.758 16:38:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:26.758 16:38:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:26.758 16:38:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:26.758 16:38:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:26.758 16:38:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:26.758 16:38:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:26.758 16:38:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:28.664 16:38:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:28.664 00:14:28.664 real 0m9.380s 00:14:28.664 user 0m23.227s 00:14:28.664 sys 0m2.460s 00:14:28.664 16:38:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:28.664 16:38:54 -- common/autotest_common.sh@10 -- # set +x 00:14:28.664 ************************************ 00:14:28.664 END TEST nvmf_invalid 00:14:28.664 ************************************ 00:14:28.922 16:38:54 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:28.922 16:38:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:28.922 16:38:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:28.922 16:38:54 -- common/autotest_common.sh@10 -- # set +x 00:14:28.922 ************************************ 00:14:28.922 START TEST nvmf_abort 00:14:28.922 ************************************ 00:14:28.922 16:38:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:28.922 * Looking for test storage... 00:14:28.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:28.922 16:38:54 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:28.922 16:38:54 -- nvmf/common.sh@7 -- # uname -s 00:14:28.922 16:38:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:28.922 16:38:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:28.922 16:38:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:28.922 16:38:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:28.922 16:38:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:28.922 16:38:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:28.922 16:38:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:28.922 16:38:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:28.922 16:38:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:28.922 16:38:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:28.922 16:38:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:28.922 16:38:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:28.922 16:38:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:28.922 16:38:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:28.922 16:38:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:28.922 16:38:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:28.922 16:38:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:28.922 16:38:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:28.922 16:38:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:28.922 16:38:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:28.922 16:38:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:28.922 16:38:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:28.922 16:38:54 -- paths/export.sh@5 -- # export PATH 00:14:28.922 16:38:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:28.922 16:38:54 -- nvmf/common.sh@46 -- # : 0 00:14:28.922 16:38:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:28.922 16:38:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:28.922 16:38:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:28.922 16:38:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:28.922 16:38:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:28.922 16:38:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:28.922 16:38:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:28.922 16:38:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:28.922 16:38:54 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:28.922 16:38:54 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:14:28.922 16:38:54 -- target/abort.sh@14 -- # nvmftestinit 00:14:28.922 16:38:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:28.922 16:38:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:28.922 16:38:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:28.922 16:38:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:28.922 16:38:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:28.922 16:38:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:28.922 16:38:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:28.922 16:38:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:28.922 16:38:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:28.922 16:38:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:28.922 16:38:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:28.922 16:38:54 -- common/autotest_common.sh@10 -- # set +x 00:14:31.455 16:38:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:31.455 16:38:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:31.455 16:38:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:31.455 16:38:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:31.455 16:38:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:31.455 16:38:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:31.455 16:38:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:31.455 16:38:56 -- nvmf/common.sh@294 -- # net_devs=() 00:14:31.455 16:38:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:31.455 16:38:56 -- nvmf/common.sh@295 -- # e810=() 00:14:31.455 16:38:56 -- nvmf/common.sh@295 -- # local -ga e810 00:14:31.455 16:38:56 -- nvmf/common.sh@296 -- # x722=() 00:14:31.455 16:38:56 -- nvmf/common.sh@296 -- # local -ga x722 00:14:31.455 16:38:56 -- nvmf/common.sh@297 -- # mlx=() 00:14:31.455 16:38:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:31.455 16:38:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:31.455 16:38:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:31.455 16:38:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:31.455 16:38:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:31.455 16:38:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:31.455 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:31.455 16:38:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:31.455 16:38:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:31.455 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:31.455 16:38:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:31.455 16:38:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:31.455 16:38:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:31.455 16:38:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:31.455 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:31.455 16:38:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:31.455 16:38:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:31.455 16:38:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:31.455 16:38:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:31.455 16:38:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:31.455 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:31.455 16:38:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:31.455 16:38:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:31.455 16:38:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:31.455 16:38:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:31.455 16:38:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:31.455 16:38:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:31.455 16:38:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:31.455 16:38:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:31.455 16:38:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:31.455 16:38:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:31.455 16:38:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:31.455 16:38:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:31.455 16:38:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:31.455 16:38:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:31.455 16:38:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:31.455 16:38:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:31.455 16:38:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:31.455 16:38:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:31.455 16:38:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:31.455 16:38:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:31.455 16:38:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:31.455 16:38:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:31.455 16:38:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:31.455 16:38:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:31.455 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:31.455 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:14:31.455 00:14:31.455 --- 10.0.0.2 ping statistics --- 00:14:31.455 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:31.455 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:14:31.455 16:38:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:31.455 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:31.455 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:14:31.455 00:14:31.456 --- 10.0.0.1 ping statistics --- 00:14:31.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:31.456 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:14:31.456 16:38:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:31.456 16:38:56 -- nvmf/common.sh@410 -- # return 0 00:14:31.456 16:38:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:31.456 16:38:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:31.456 16:38:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:31.456 16:38:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:31.456 16:38:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:31.456 16:38:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:31.456 16:38:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:31.456 16:38:56 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:14:31.456 16:38:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:31.456 16:38:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:31.456 16:38:56 -- common/autotest_common.sh@10 -- # set +x 00:14:31.456 16:38:56 -- nvmf/common.sh@469 -- # nvmfpid=1152672 00:14:31.456 16:38:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:31.456 16:38:56 -- nvmf/common.sh@470 -- # waitforlisten 1152672 00:14:31.456 16:38:56 -- common/autotest_common.sh@819 -- # '[' -z 1152672 ']' 00:14:31.456 16:38:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:31.456 16:38:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:31.456 16:38:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:31.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:31.456 16:38:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:31.456 16:38:56 -- common/autotest_common.sh@10 -- # set +x 00:14:31.456 [2024-10-13 16:38:56.602767] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:14:31.456 [2024-10-13 16:38:56.602846] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:31.456 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.456 [2024-10-13 16:38:56.677603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:31.456 [2024-10-13 16:38:56.772737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:31.456 [2024-10-13 16:38:56.772897] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:31.456 [2024-10-13 16:38:56.772917] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:31.456 [2024-10-13 16:38:56.772931] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:31.456 [2024-10-13 16:38:56.772995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:31.456 [2024-10-13 16:38:56.773044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:31.456 [2024-10-13 16:38:56.773047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.390 16:38:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:32.390 16:38:57 -- common/autotest_common.sh@852 -- # return 0 00:14:32.390 16:38:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:32.390 16:38:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 16:38:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:32.390 16:38:57 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 [2024-10-13 16:38:57.648189] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 Malloc0 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 Delay0 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 [2024-10-13 16:38:57.719526] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:32.390 16:38:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.390 16:38:57 -- common/autotest_common.sh@10 -- # set +x 00:14:32.390 16:38:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.390 16:38:57 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:14:32.390 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.390 [2024-10-13 16:38:57.824278] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:34.917 Initializing NVMe Controllers 00:14:34.917 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:34.917 controller IO queue size 128 less than required 00:14:34.917 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:34.917 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:34.917 Initialization complete. Launching workers. 00:14:34.917 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 32848 00:14:34.917 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 32909, failed to submit 62 00:14:34.917 success 32848, unsuccess 61, failed 0 00:14:34.917 16:38:59 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:34.917 16:38:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.917 16:38:59 -- common/autotest_common.sh@10 -- # set +x 00:14:34.917 16:38:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.917 16:38:59 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:34.917 16:38:59 -- target/abort.sh@38 -- # nvmftestfini 00:14:34.917 16:38:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:34.917 16:38:59 -- nvmf/common.sh@116 -- # sync 00:14:34.917 16:38:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:34.917 16:38:59 -- nvmf/common.sh@119 -- # set +e 00:14:34.917 16:38:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:34.917 16:38:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:34.917 rmmod nvme_tcp 00:14:34.917 rmmod nvme_fabrics 00:14:34.917 rmmod nvme_keyring 00:14:34.917 16:39:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:34.917 16:39:00 -- nvmf/common.sh@123 -- # set -e 00:14:34.917 16:39:00 -- nvmf/common.sh@124 -- # return 0 00:14:34.917 16:39:00 -- nvmf/common.sh@477 -- # '[' -n 1152672 ']' 00:14:34.917 16:39:00 -- nvmf/common.sh@478 -- # killprocess 1152672 00:14:34.917 16:39:00 -- common/autotest_common.sh@926 -- # '[' -z 1152672 ']' 00:14:34.917 16:39:00 -- common/autotest_common.sh@930 -- # kill -0 1152672 00:14:34.917 16:39:00 -- common/autotest_common.sh@931 -- # uname 00:14:34.917 16:39:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:34.917 16:39:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1152672 00:14:34.917 16:39:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:34.917 16:39:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:34.917 16:39:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1152672' 00:14:34.917 killing process with pid 1152672 00:14:34.917 16:39:00 -- common/autotest_common.sh@945 -- # kill 1152672 00:14:34.917 16:39:00 -- common/autotest_common.sh@950 -- # wait 1152672 00:14:34.917 16:39:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:34.917 16:39:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:34.917 16:39:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:34.917 16:39:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:34.917 16:39:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:34.917 16:39:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:34.917 16:39:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:34.917 16:39:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.453 16:39:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:37.453 00:14:37.453 real 0m8.211s 00:14:37.453 user 0m13.331s 00:14:37.453 sys 0m2.650s 00:14:37.453 16:39:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:37.453 16:39:02 -- common/autotest_common.sh@10 -- # set +x 00:14:37.453 ************************************ 00:14:37.453 END TEST nvmf_abort 00:14:37.453 ************************************ 00:14:37.453 16:39:02 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:37.453 16:39:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:37.453 16:39:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:37.453 16:39:02 -- common/autotest_common.sh@10 -- # set +x 00:14:37.453 ************************************ 00:14:37.453 START TEST nvmf_ns_hotplug_stress 00:14:37.453 ************************************ 00:14:37.453 16:39:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:37.453 * Looking for test storage... 00:14:37.453 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:37.453 16:39:02 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:37.453 16:39:02 -- nvmf/common.sh@7 -- # uname -s 00:14:37.453 16:39:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:37.453 16:39:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:37.453 16:39:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:37.453 16:39:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:37.453 16:39:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:37.453 16:39:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:37.453 16:39:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:37.453 16:39:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:37.453 16:39:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:37.453 16:39:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:37.453 16:39:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.453 16:39:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.453 16:39:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:37.453 16:39:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:37.453 16:39:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:37.453 16:39:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:37.453 16:39:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:37.453 16:39:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:37.453 16:39:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:37.453 16:39:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.453 16:39:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.453 16:39:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.453 16:39:02 -- paths/export.sh@5 -- # export PATH 00:14:37.453 16:39:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.453 16:39:02 -- nvmf/common.sh@46 -- # : 0 00:14:37.453 16:39:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:37.453 16:39:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:37.453 16:39:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:37.453 16:39:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:37.453 16:39:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:37.453 16:39:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:37.453 16:39:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:37.453 16:39:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:37.453 16:39:02 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.453 16:39:02 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:37.453 16:39:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:37.453 16:39:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:37.454 16:39:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:37.454 16:39:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:37.454 16:39:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:37.454 16:39:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.454 16:39:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:37.454 16:39:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.454 16:39:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:37.454 16:39:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:37.454 16:39:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:37.454 16:39:02 -- common/autotest_common.sh@10 -- # set +x 00:14:39.397 16:39:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.397 16:39:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:39.397 16:39:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:39.397 16:39:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:39.397 16:39:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:39.397 16:39:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:39.397 16:39:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:39.397 16:39:04 -- nvmf/common.sh@294 -- # net_devs=() 00:14:39.397 16:39:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:39.397 16:39:04 -- nvmf/common.sh@295 -- # e810=() 00:14:39.397 16:39:04 -- nvmf/common.sh@295 -- # local -ga e810 00:14:39.397 16:39:04 -- nvmf/common.sh@296 -- # x722=() 00:14:39.397 16:39:04 -- nvmf/common.sh@296 -- # local -ga x722 00:14:39.397 16:39:04 -- nvmf/common.sh@297 -- # mlx=() 00:14:39.397 16:39:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:39.397 16:39:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.397 16:39:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:39.397 16:39:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:39.397 16:39:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.397 16:39:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:39.397 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:39.397 16:39:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.397 16:39:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:39.397 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:39.397 16:39:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.397 16:39:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.397 16:39:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.397 16:39:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:39.397 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:39.397 16:39:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.397 16:39:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.397 16:39:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.397 16:39:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.397 16:39:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:39.397 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:39.397 16:39:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.397 16:39:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:39.397 16:39:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:39.397 16:39:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:39.397 16:39:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:39.397 16:39:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:39.397 16:39:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:39.397 16:39:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:39.397 16:39:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:39.398 16:39:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:39.398 16:39:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:39.398 16:39:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:39.398 16:39:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:39.398 16:39:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:39.398 16:39:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:39.398 16:39:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:39.398 16:39:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:39.398 16:39:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:39.398 16:39:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:39.398 16:39:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:39.398 16:39:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:39.398 16:39:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:39.398 16:39:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:39.398 16:39:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:39.398 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:39.398 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:14:39.398 00:14:39.398 --- 10.0.0.2 ping statistics --- 00:14:39.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.398 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:14:39.398 16:39:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:39.398 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:39.398 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:14:39.398 00:14:39.398 --- 10.0.0.1 ping statistics --- 00:14:39.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.398 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:14:39.398 16:39:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:39.398 16:39:04 -- nvmf/common.sh@410 -- # return 0 00:14:39.398 16:39:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:39.398 16:39:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:39.398 16:39:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:39.398 16:39:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:39.398 16:39:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:39.398 16:39:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:39.398 16:39:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:39.398 16:39:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:39.398 16:39:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:39.398 16:39:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:39.398 16:39:04 -- common/autotest_common.sh@10 -- # set +x 00:14:39.398 16:39:04 -- nvmf/common.sh@469 -- # nvmfpid=1155234 00:14:39.398 16:39:04 -- nvmf/common.sh@470 -- # waitforlisten 1155234 00:14:39.398 16:39:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:39.398 16:39:04 -- common/autotest_common.sh@819 -- # '[' -z 1155234 ']' 00:14:39.398 16:39:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:39.398 16:39:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:39.398 16:39:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:39.398 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:39.398 16:39:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:39.398 16:39:04 -- common/autotest_common.sh@10 -- # set +x 00:14:39.398 [2024-10-13 16:39:04.712193] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:14:39.398 [2024-10-13 16:39:04.712263] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:39.398 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.398 [2024-10-13 16:39:04.778688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:39.398 [2024-10-13 16:39:04.862684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:39.398 [2024-10-13 16:39:04.862832] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:39.398 [2024-10-13 16:39:04.862849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:39.398 [2024-10-13 16:39:04.862862] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:39.398 [2024-10-13 16:39:04.862938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:39.398 [2024-10-13 16:39:04.862987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:39.398 [2024-10-13 16:39:04.862991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:40.359 16:39:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:40.359 16:39:05 -- common/autotest_common.sh@852 -- # return 0 00:14:40.359 16:39:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:40.359 16:39:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:40.359 16:39:05 -- common/autotest_common.sh@10 -- # set +x 00:14:40.359 16:39:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:40.359 16:39:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:40.359 16:39:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:40.617 [2024-10-13 16:39:06.023117] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:40.617 16:39:06 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:40.875 16:39:06 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:41.133 [2024-10-13 16:39:06.566052] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:41.133 16:39:06 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:41.390 16:39:06 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:41.649 Malloc0 00:14:41.649 16:39:07 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:41.907 Delay0 00:14:41.907 16:39:07 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.473 16:39:07 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:42.473 NULL1 00:14:42.473 16:39:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:42.729 16:39:08 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1156082 00:14:42.729 16:39:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:42.729 16:39:08 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:42.729 16:39:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:42.987 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.920 Read completed with error (sct=0, sc=11) 00:14:43.920 16:39:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:43.920 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:44.177 16:39:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:44.177 16:39:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:44.435 true 00:14:44.435 16:39:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:44.435 16:39:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.367 16:39:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:45.624 16:39:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:45.624 16:39:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:45.624 true 00:14:45.882 16:39:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:45.882 16:39:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.140 16:39:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:46.397 16:39:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:46.397 16:39:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:46.397 true 00:14:46.655 16:39:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:46.655 16:39:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.655 16:39:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:46.912 16:39:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:46.912 16:39:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:47.169 true 00:14:47.169 16:39:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:47.169 16:39:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.542 16:39:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:48.542 16:39:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:48.542 16:39:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:48.800 true 00:14:48.800 16:39:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:48.800 16:39:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.057 16:39:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:49.315 16:39:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:49.315 16:39:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:49.572 true 00:14:49.572 16:39:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:49.572 16:39:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.830 16:39:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:50.088 16:39:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:50.088 16:39:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:50.346 true 00:14:50.346 16:39:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:50.346 16:39:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:51.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:51.279 16:39:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:51.537 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:51.537 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:51.795 16:39:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:51.795 16:39:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:51.795 true 00:14:51.795 16:39:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:51.795 16:39:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:52.053 16:39:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:52.310 16:39:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:52.310 16:39:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:52.633 true 00:14:52.633 16:39:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:52.633 16:39:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:53.622 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:53.622 16:39:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:53.622 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:53.879 16:39:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:53.879 16:39:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:54.137 true 00:14:54.137 16:39:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:54.137 16:39:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:54.394 16:39:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:54.652 16:39:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:54.652 16:39:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:54.909 true 00:14:54.909 16:39:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:54.909 16:39:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:55.842 16:39:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:55.842 16:39:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:55.842 16:39:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:56.100 true 00:14:56.100 16:39:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:56.100 16:39:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:56.356 16:39:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:56.613 16:39:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:56.613 16:39:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:56.870 true 00:14:56.870 16:39:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:56.870 16:39:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:57.128 16:39:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:57.385 16:39:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:57.385 16:39:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:57.644 true 00:14:57.644 16:39:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:57.644 16:39:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:59.051 16:39:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:59.051 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.051 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.051 16:39:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:59.051 16:39:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:59.374 true 00:14:59.374 16:39:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:14:59.374 16:39:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:59.631 16:39:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:59.889 16:39:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:59.889 16:39:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:15:00.147 true 00:15:00.147 16:39:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:00.147 16:39:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:01.079 16:39:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:01.079 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.079 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.079 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.079 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.337 16:39:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:15:01.337 16:39:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:15:01.594 true 00:15:01.594 16:39:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:01.594 16:39:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:01.852 16:39:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:02.110 16:39:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:15:02.110 16:39:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:15:02.110 true 00:15:02.368 16:39:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:02.368 16:39:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:03.301 16:39:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:03.559 16:39:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:15:03.559 16:39:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:15:03.816 true 00:15:03.816 16:39:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:03.816 16:39:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:04.074 16:39:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:04.332 16:39:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:15:04.332 16:39:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:15:04.590 true 00:15:04.590 16:39:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:04.590 16:39:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:04.847 16:39:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:05.104 16:39:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:15:05.104 16:39:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:15:05.362 true 00:15:05.362 16:39:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:05.362 16:39:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:06.294 16:39:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:06.551 16:39:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:15:06.551 16:39:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:15:06.808 true 00:15:06.808 16:39:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:06.808 16:39:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.065 16:39:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:07.323 16:39:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:15:07.323 16:39:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:15:07.582 true 00:15:07.582 16:39:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:07.582 16:39:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.839 16:39:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:08.097 16:39:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:15:08.097 16:39:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:15:08.355 true 00:15:08.355 16:39:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:08.355 16:39:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:09.726 16:39:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.726 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.726 16:39:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:15:09.726 16:39:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:15:09.984 true 00:15:09.984 16:39:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:09.984 16:39:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:10.241 16:39:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:10.499 16:39:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:15:10.499 16:39:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:15:10.757 true 00:15:10.757 16:39:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:10.757 16:39:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:11.690 16:39:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:11.690 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.690 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.690 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.690 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.948 16:39:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:15:11.948 16:39:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:15:12.205 true 00:15:12.205 16:39:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:12.205 16:39:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:12.463 16:39:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:12.721 16:39:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:15:12.721 16:39:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:15:12.978 true 00:15:12.978 16:39:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:12.978 16:39:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:13.912 Initializing NVMe Controllers 00:15:13.912 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:13.912 Controller IO queue size 128, less than required. 00:15:13.912 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:13.912 Controller IO queue size 128, less than required. 00:15:13.912 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:13.912 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:13.912 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:15:13.912 Initialization complete. Launching workers. 00:15:13.912 ======================================================== 00:15:13.912 Latency(us) 00:15:13.912 Device Information : IOPS MiB/s Average min max 00:15:13.912 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 796.12 0.39 77674.53 2912.70 1026268.45 00:15:13.912 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10521.43 5.14 12165.98 1580.55 449596.46 00:15:13.912 ======================================================== 00:15:13.912 Total : 11317.55 5.53 16774.11 1580.55 1026268.45 00:15:13.912 00:15:13.912 16:39:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:14.170 16:39:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:15:14.170 16:39:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:15:14.428 true 00:15:14.428 16:39:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1156082 00:15:14.428 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1156082) - No such process 00:15:14.428 16:39:39 -- target/ns_hotplug_stress.sh@53 -- # wait 1156082 00:15:14.428 16:39:39 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:14.686 16:39:40 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:14.944 16:39:40 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:15:14.944 16:39:40 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:15:14.944 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:15:14.944 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:14.944 16:39:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:15:15.201 null0 00:15:15.201 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:15.201 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:15.201 16:39:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:15:15.459 null1 00:15:15.459 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:15.459 16:39:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:15.459 16:39:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:15:15.716 null2 00:15:15.716 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:15.716 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:15.716 16:39:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:15:15.974 null3 00:15:15.974 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:15.974 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:15.974 16:39:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:15:16.231 null4 00:15:16.231 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:16.231 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:16.231 16:39:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:15:16.490 null5 00:15:16.490 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:16.490 16:39:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:16.490 16:39:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:15:16.747 null6 00:15:16.747 16:39:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:16.747 16:39:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:16.748 16:39:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:15:17.005 null7 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@66 -- # wait 1160397 1160398 1160399 1160402 1160404 1160406 1160408 1160410 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.005 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:17.263 16:39:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:17.522 16:39:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:17.780 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.038 16:39:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:18.297 16:39:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:18.555 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:18.814 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.072 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:19.330 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.331 16:39:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.331 16:39:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:19.589 16:39:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:19.847 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:20.106 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.364 16:39:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:20.622 16:39:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:20.880 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:21.139 16:39:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.397 16:39:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:21.655 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:21.655 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:21.656 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:21.914 16:39:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:22.171 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:22.171 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:22.171 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:22.172 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:22.172 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:22.172 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:22.430 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:22.430 16:39:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:22.686 16:39:47 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:15:22.686 16:39:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.686 16:39:47 -- nvmf/common.sh@116 -- # sync 00:15:22.686 16:39:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.686 16:39:47 -- nvmf/common.sh@119 -- # set +e 00:15:22.686 16:39:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.686 16:39:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.686 rmmod nvme_tcp 00:15:22.686 rmmod nvme_fabrics 00:15:22.686 rmmod nvme_keyring 00:15:22.686 16:39:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.686 16:39:48 -- nvmf/common.sh@123 -- # set -e 00:15:22.686 16:39:48 -- nvmf/common.sh@124 -- # return 0 00:15:22.686 16:39:48 -- nvmf/common.sh@477 -- # '[' -n 1155234 ']' 00:15:22.686 16:39:48 -- nvmf/common.sh@478 -- # killprocess 1155234 00:15:22.686 16:39:48 -- common/autotest_common.sh@926 -- # '[' -z 1155234 ']' 00:15:22.686 16:39:48 -- common/autotest_common.sh@930 -- # kill -0 1155234 00:15:22.686 16:39:48 -- common/autotest_common.sh@931 -- # uname 00:15:22.686 16:39:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:22.686 16:39:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1155234 00:15:22.686 16:39:48 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:22.686 16:39:48 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:22.686 16:39:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1155234' 00:15:22.686 killing process with pid 1155234 00:15:22.686 16:39:48 -- common/autotest_common.sh@945 -- # kill 1155234 00:15:22.686 16:39:48 -- common/autotest_common.sh@950 -- # wait 1155234 00:15:22.945 16:39:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.945 16:39:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.945 16:39:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.945 16:39:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.945 16:39:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.945 16:39:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.945 16:39:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.945 16:39:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.851 16:39:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.851 00:15:24.851 real 0m47.930s 00:15:24.851 user 3m39.380s 00:15:24.851 sys 0m15.213s 00:15:24.851 16:39:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:24.851 16:39:50 -- common/autotest_common.sh@10 -- # set +x 00:15:24.851 ************************************ 00:15:24.851 END TEST nvmf_ns_hotplug_stress 00:15:24.851 ************************************ 00:15:25.109 16:39:50 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:25.109 16:39:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:25.109 16:39:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:25.109 16:39:50 -- common/autotest_common.sh@10 -- # set +x 00:15:25.109 ************************************ 00:15:25.109 START TEST nvmf_connect_stress 00:15:25.109 ************************************ 00:15:25.109 16:39:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:25.109 * Looking for test storage... 00:15:25.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:25.109 16:39:50 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:25.109 16:39:50 -- nvmf/common.sh@7 -- # uname -s 00:15:25.109 16:39:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:25.109 16:39:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:25.109 16:39:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:25.109 16:39:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:25.109 16:39:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:25.109 16:39:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:25.109 16:39:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:25.109 16:39:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:25.109 16:39:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:25.109 16:39:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:25.109 16:39:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.110 16:39:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.110 16:39:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:25.110 16:39:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:25.110 16:39:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:25.110 16:39:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:25.110 16:39:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:25.110 16:39:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:25.110 16:39:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:25.110 16:39:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.110 16:39:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.110 16:39:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.110 16:39:50 -- paths/export.sh@5 -- # export PATH 00:15:25.110 16:39:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.110 16:39:50 -- nvmf/common.sh@46 -- # : 0 00:15:25.110 16:39:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:25.110 16:39:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:25.110 16:39:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:25.110 16:39:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:25.110 16:39:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:25.110 16:39:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:25.110 16:39:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:25.110 16:39:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:25.110 16:39:50 -- target/connect_stress.sh@12 -- # nvmftestinit 00:15:25.110 16:39:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:25.110 16:39:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:25.110 16:39:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:25.110 16:39:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:25.110 16:39:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:25.110 16:39:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.110 16:39:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.110 16:39:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.110 16:39:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:25.110 16:39:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:25.110 16:39:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:25.110 16:39:50 -- common/autotest_common.sh@10 -- # set +x 00:15:27.013 16:39:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:27.013 16:39:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:27.013 16:39:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:27.013 16:39:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:27.013 16:39:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:27.013 16:39:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:27.013 16:39:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:27.013 16:39:52 -- nvmf/common.sh@294 -- # net_devs=() 00:15:27.013 16:39:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:27.013 16:39:52 -- nvmf/common.sh@295 -- # e810=() 00:15:27.013 16:39:52 -- nvmf/common.sh@295 -- # local -ga e810 00:15:27.013 16:39:52 -- nvmf/common.sh@296 -- # x722=() 00:15:27.013 16:39:52 -- nvmf/common.sh@296 -- # local -ga x722 00:15:27.013 16:39:52 -- nvmf/common.sh@297 -- # mlx=() 00:15:27.013 16:39:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:27.013 16:39:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:27.013 16:39:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:27.013 16:39:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:27.013 16:39:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.013 16:39:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:27.013 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:27.013 16:39:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.013 16:39:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:27.013 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:27.013 16:39:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.013 16:39:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.013 16:39:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.013 16:39:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:27.013 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:27.013 16:39:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.013 16:39:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.013 16:39:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.013 16:39:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.013 16:39:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:27.013 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:27.013 16:39:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.013 16:39:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:27.013 16:39:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:27.013 16:39:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:27.013 16:39:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:27.013 16:39:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:27.013 16:39:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:27.013 16:39:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:27.013 16:39:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:27.013 16:39:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:27.013 16:39:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:27.013 16:39:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:27.013 16:39:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:27.013 16:39:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:27.013 16:39:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:27.013 16:39:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:27.013 16:39:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:27.272 16:39:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:27.272 16:39:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:27.272 16:39:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:27.272 16:39:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:27.272 16:39:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:27.272 16:39:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:27.272 16:39:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:27.272 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:27.272 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:15:27.272 00:15:27.272 --- 10.0.0.2 ping statistics --- 00:15:27.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.272 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:15:27.272 16:39:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:27.272 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:27.272 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:15:27.272 00:15:27.272 --- 10.0.0.1 ping statistics --- 00:15:27.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.272 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:15:27.272 16:39:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:27.272 16:39:52 -- nvmf/common.sh@410 -- # return 0 00:15:27.272 16:39:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:27.272 16:39:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:27.272 16:39:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:27.272 16:39:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:27.272 16:39:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:27.272 16:39:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:27.272 16:39:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:27.272 16:39:52 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:15:27.272 16:39:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:27.272 16:39:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:27.272 16:39:52 -- common/autotest_common.sh@10 -- # set +x 00:15:27.272 16:39:52 -- nvmf/common.sh@469 -- # nvmfpid=1163185 00:15:27.272 16:39:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:27.272 16:39:52 -- nvmf/common.sh@470 -- # waitforlisten 1163185 00:15:27.272 16:39:52 -- common/autotest_common.sh@819 -- # '[' -z 1163185 ']' 00:15:27.272 16:39:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:27.272 16:39:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:27.272 16:39:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:27.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:27.272 16:39:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:27.272 16:39:52 -- common/autotest_common.sh@10 -- # set +x 00:15:27.272 [2024-10-13 16:39:52.657708] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:15:27.272 [2024-10-13 16:39:52.657798] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:27.272 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.272 [2024-10-13 16:39:52.727658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:27.530 [2024-10-13 16:39:52.822372] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:27.530 [2024-10-13 16:39:52.822540] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:27.530 [2024-10-13 16:39:52.822559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:27.530 [2024-10-13 16:39:52.822572] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:27.530 [2024-10-13 16:39:52.822651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:27.530 [2024-10-13 16:39:52.822713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:27.530 [2024-10-13 16:39:52.822716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.463 16:39:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:28.463 16:39:53 -- common/autotest_common.sh@852 -- # return 0 00:15:28.463 16:39:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:28.463 16:39:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:28.463 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.463 16:39:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:28.463 16:39:53 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:28.463 16:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.463 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.463 [2024-10-13 16:39:53.650602] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:28.463 16:39:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.463 16:39:53 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:28.463 16:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.464 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.464 16:39:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.464 16:39:53 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:28.464 16:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.464 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.464 [2024-10-13 16:39:53.683551] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:28.464 16:39:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.464 16:39:53 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:28.464 16:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.464 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.464 NULL1 00:15:28.464 16:39:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.464 16:39:53 -- target/connect_stress.sh@21 -- # PERF_PID=1163352 00:15:28.464 16:39:53 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:28.464 16:39:53 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:28.464 16:39:53 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # seq 1 20 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:28.464 16:39:53 -- target/connect_stress.sh@28 -- # cat 00:15:28.464 16:39:53 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:28.464 16:39:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.464 16:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.464 16:39:53 -- common/autotest_common.sh@10 -- # set +x 00:15:28.722 16:39:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.722 16:39:54 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:28.722 16:39:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.722 16:39:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.722 16:39:54 -- common/autotest_common.sh@10 -- # set +x 00:15:28.980 16:39:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:28.980 16:39:54 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:28.980 16:39:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.980 16:39:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:28.980 16:39:54 -- common/autotest_common.sh@10 -- # set +x 00:15:29.237 16:39:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:29.237 16:39:54 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:29.237 16:39:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:29.237 16:39:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:29.237 16:39:54 -- common/autotest_common.sh@10 -- # set +x 00:15:29.802 16:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:29.802 16:39:55 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:29.802 16:39:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:29.802 16:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:29.802 16:39:55 -- common/autotest_common.sh@10 -- # set +x 00:15:30.060 16:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.060 16:39:55 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:30.060 16:39:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.060 16:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.060 16:39:55 -- common/autotest_common.sh@10 -- # set +x 00:15:30.317 16:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.317 16:39:55 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:30.317 16:39:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.317 16:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.317 16:39:55 -- common/autotest_common.sh@10 -- # set +x 00:15:30.575 16:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.575 16:39:55 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:30.575 16:39:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.575 16:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.575 16:39:55 -- common/autotest_common.sh@10 -- # set +x 00:15:30.832 16:39:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.832 16:39:56 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:30.832 16:39:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.832 16:39:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.832 16:39:56 -- common/autotest_common.sh@10 -- # set +x 00:15:31.397 16:39:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.397 16:39:56 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:31.397 16:39:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.397 16:39:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.397 16:39:56 -- common/autotest_common.sh@10 -- # set +x 00:15:31.655 16:39:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.655 16:39:56 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:31.655 16:39:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.655 16:39:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.655 16:39:56 -- common/autotest_common.sh@10 -- # set +x 00:15:31.912 16:39:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.912 16:39:57 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:31.912 16:39:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.912 16:39:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.912 16:39:57 -- common/autotest_common.sh@10 -- # set +x 00:15:32.170 16:39:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:32.170 16:39:57 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:32.170 16:39:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:32.170 16:39:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:32.170 16:39:57 -- common/autotest_common.sh@10 -- # set +x 00:15:32.427 16:39:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:32.427 16:39:57 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:32.427 16:39:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:32.427 16:39:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:32.427 16:39:57 -- common/autotest_common.sh@10 -- # set +x 00:15:32.991 16:39:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:32.991 16:39:58 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:32.991 16:39:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:32.991 16:39:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:32.991 16:39:58 -- common/autotest_common.sh@10 -- # set +x 00:15:33.249 16:39:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:33.249 16:39:58 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:33.249 16:39:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.249 16:39:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:33.249 16:39:58 -- common/autotest_common.sh@10 -- # set +x 00:15:33.507 16:39:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:33.507 16:39:58 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:33.507 16:39:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.507 16:39:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:33.507 16:39:58 -- common/autotest_common.sh@10 -- # set +x 00:15:33.765 16:39:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:33.765 16:39:59 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:33.765 16:39:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.765 16:39:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:33.765 16:39:59 -- common/autotest_common.sh@10 -- # set +x 00:15:34.023 16:39:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.280 16:39:59 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:34.280 16:39:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.280 16:39:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.280 16:39:59 -- common/autotest_common.sh@10 -- # set +x 00:15:34.538 16:39:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.538 16:39:59 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:34.538 16:39:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.538 16:39:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.538 16:39:59 -- common/autotest_common.sh@10 -- # set +x 00:15:34.796 16:40:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.796 16:40:00 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:34.796 16:40:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.796 16:40:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.796 16:40:00 -- common/autotest_common.sh@10 -- # set +x 00:15:35.054 16:40:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:35.054 16:40:00 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:35.054 16:40:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:35.054 16:40:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:35.054 16:40:00 -- common/autotest_common.sh@10 -- # set +x 00:15:35.312 16:40:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:35.312 16:40:00 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:35.312 16:40:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:35.312 16:40:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:35.312 16:40:00 -- common/autotest_common.sh@10 -- # set +x 00:15:35.879 16:40:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:35.879 16:40:01 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:35.879 16:40:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:35.879 16:40:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:35.879 16:40:01 -- common/autotest_common.sh@10 -- # set +x 00:15:36.137 16:40:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:36.137 16:40:01 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:36.137 16:40:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.137 16:40:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:36.137 16:40:01 -- common/autotest_common.sh@10 -- # set +x 00:15:36.394 16:40:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:36.394 16:40:01 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:36.394 16:40:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.394 16:40:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:36.394 16:40:01 -- common/autotest_common.sh@10 -- # set +x 00:15:36.653 16:40:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:36.653 16:40:02 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:36.653 16:40:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.653 16:40:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:36.653 16:40:02 -- common/autotest_common.sh@10 -- # set +x 00:15:37.219 16:40:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:37.219 16:40:02 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:37.219 16:40:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:37.219 16:40:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:37.219 16:40:02 -- common/autotest_common.sh@10 -- # set +x 00:15:37.477 16:40:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:37.477 16:40:02 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:37.477 16:40:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:37.477 16:40:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:37.477 16:40:02 -- common/autotest_common.sh@10 -- # set +x 00:15:37.735 16:40:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:37.735 16:40:03 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:37.735 16:40:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:37.735 16:40:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:37.735 16:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:37.993 16:40:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:37.993 16:40:03 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:37.993 16:40:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:37.993 16:40:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:37.993 16:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:38.251 16:40:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:38.251 16:40:03 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:38.251 16:40:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:38.251 16:40:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:38.251 16:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:38.509 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:38.767 16:40:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:38.767 16:40:04 -- target/connect_stress.sh@34 -- # kill -0 1163352 00:15:38.767 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1163352) - No such process 00:15:38.767 16:40:04 -- target/connect_stress.sh@38 -- # wait 1163352 00:15:38.767 16:40:04 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:38.767 16:40:04 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:38.767 16:40:04 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:38.767 16:40:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:38.767 16:40:04 -- nvmf/common.sh@116 -- # sync 00:15:38.767 16:40:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:38.767 16:40:04 -- nvmf/common.sh@119 -- # set +e 00:15:38.767 16:40:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:38.767 16:40:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:38.767 rmmod nvme_tcp 00:15:38.767 rmmod nvme_fabrics 00:15:38.767 rmmod nvme_keyring 00:15:38.767 16:40:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:38.767 16:40:04 -- nvmf/common.sh@123 -- # set -e 00:15:38.767 16:40:04 -- nvmf/common.sh@124 -- # return 0 00:15:38.767 16:40:04 -- nvmf/common.sh@477 -- # '[' -n 1163185 ']' 00:15:38.767 16:40:04 -- nvmf/common.sh@478 -- # killprocess 1163185 00:15:38.767 16:40:04 -- common/autotest_common.sh@926 -- # '[' -z 1163185 ']' 00:15:38.767 16:40:04 -- common/autotest_common.sh@930 -- # kill -0 1163185 00:15:38.767 16:40:04 -- common/autotest_common.sh@931 -- # uname 00:15:38.767 16:40:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:38.767 16:40:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1163185 00:15:38.767 16:40:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:38.767 16:40:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:38.767 16:40:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1163185' 00:15:38.767 killing process with pid 1163185 00:15:38.767 16:40:04 -- common/autotest_common.sh@945 -- # kill 1163185 00:15:38.767 16:40:04 -- common/autotest_common.sh@950 -- # wait 1163185 00:15:39.028 16:40:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:39.028 16:40:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:39.028 16:40:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:39.028 16:40:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:39.028 16:40:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:39.028 16:40:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:39.028 16:40:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:39.028 16:40:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:41.035 16:40:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:41.035 00:15:41.035 real 0m16.014s 00:15:41.035 user 0m40.747s 00:15:41.035 sys 0m5.783s 00:15:41.035 16:40:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:41.035 16:40:06 -- common/autotest_common.sh@10 -- # set +x 00:15:41.035 ************************************ 00:15:41.035 END TEST nvmf_connect_stress 00:15:41.035 ************************************ 00:15:41.035 16:40:06 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:41.035 16:40:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:41.035 16:40:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:41.035 16:40:06 -- common/autotest_common.sh@10 -- # set +x 00:15:41.035 ************************************ 00:15:41.035 START TEST nvmf_fused_ordering 00:15:41.035 ************************************ 00:15:41.035 16:40:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:41.035 * Looking for test storage... 00:15:41.035 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:41.035 16:40:06 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:41.035 16:40:06 -- nvmf/common.sh@7 -- # uname -s 00:15:41.035 16:40:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:41.035 16:40:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:41.035 16:40:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:41.035 16:40:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:41.035 16:40:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:41.035 16:40:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:41.035 16:40:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:41.035 16:40:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:41.035 16:40:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:41.035 16:40:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:41.035 16:40:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:41.035 16:40:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:41.035 16:40:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:41.035 16:40:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:41.035 16:40:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:41.035 16:40:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:41.035 16:40:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:41.035 16:40:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:41.035 16:40:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:41.035 16:40:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.035 16:40:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.035 16:40:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.035 16:40:06 -- paths/export.sh@5 -- # export PATH 00:15:41.035 16:40:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.035 16:40:06 -- nvmf/common.sh@46 -- # : 0 00:15:41.035 16:40:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:41.035 16:40:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:41.035 16:40:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:41.035 16:40:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:41.035 16:40:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:41.035 16:40:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:41.035 16:40:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:41.035 16:40:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:41.035 16:40:06 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:41.035 16:40:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:41.035 16:40:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:41.035 16:40:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:41.035 16:40:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:41.035 16:40:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:41.035 16:40:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:41.035 16:40:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:41.035 16:40:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:41.035 16:40:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:41.035 16:40:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:41.035 16:40:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:41.035 16:40:06 -- common/autotest_common.sh@10 -- # set +x 00:15:43.565 16:40:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:43.565 16:40:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:43.565 16:40:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:43.565 16:40:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:43.565 16:40:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:43.565 16:40:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:43.565 16:40:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:43.565 16:40:08 -- nvmf/common.sh@294 -- # net_devs=() 00:15:43.565 16:40:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:43.565 16:40:08 -- nvmf/common.sh@295 -- # e810=() 00:15:43.565 16:40:08 -- nvmf/common.sh@295 -- # local -ga e810 00:15:43.565 16:40:08 -- nvmf/common.sh@296 -- # x722=() 00:15:43.565 16:40:08 -- nvmf/common.sh@296 -- # local -ga x722 00:15:43.565 16:40:08 -- nvmf/common.sh@297 -- # mlx=() 00:15:43.565 16:40:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:43.565 16:40:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:43.565 16:40:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:43.565 16:40:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:43.565 16:40:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.565 16:40:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:43.565 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:43.565 16:40:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.565 16:40:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:43.565 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:43.565 16:40:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.565 16:40:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.565 16:40:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.565 16:40:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:43.565 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:43.565 16:40:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.565 16:40:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.565 16:40:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.565 16:40:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.565 16:40:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:43.565 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:43.565 16:40:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.565 16:40:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:43.565 16:40:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:43.565 16:40:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:43.565 16:40:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:43.565 16:40:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:43.565 16:40:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:43.565 16:40:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:43.565 16:40:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:43.565 16:40:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:43.565 16:40:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:43.565 16:40:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:43.565 16:40:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:43.565 16:40:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:43.566 16:40:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:43.566 16:40:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:43.566 16:40:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:43.566 16:40:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:43.566 16:40:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:43.566 16:40:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:43.566 16:40:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:43.566 16:40:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:43.566 16:40:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:43.566 16:40:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:43.566 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:43.566 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:15:43.566 00:15:43.566 --- 10.0.0.2 ping statistics --- 00:15:43.566 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.566 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:15:43.566 16:40:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:43.566 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:43.566 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:15:43.566 00:15:43.566 --- 10.0.0.1 ping statistics --- 00:15:43.566 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.566 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:43.566 16:40:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:43.566 16:40:08 -- nvmf/common.sh@410 -- # return 0 00:15:43.566 16:40:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:43.566 16:40:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:43.566 16:40:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:43.566 16:40:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:43.566 16:40:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:43.566 16:40:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:43.566 16:40:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:43.566 16:40:08 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:43.566 16:40:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:43.566 16:40:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:43.566 16:40:08 -- common/autotest_common.sh@10 -- # set +x 00:15:43.566 16:40:08 -- nvmf/common.sh@469 -- # nvmfpid=1166547 00:15:43.566 16:40:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:43.566 16:40:08 -- nvmf/common.sh@470 -- # waitforlisten 1166547 00:15:43.566 16:40:08 -- common/autotest_common.sh@819 -- # '[' -z 1166547 ']' 00:15:43.566 16:40:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:43.566 16:40:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:43.566 16:40:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:43.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:43.566 16:40:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:43.566 16:40:08 -- common/autotest_common.sh@10 -- # set +x 00:15:43.566 [2024-10-13 16:40:08.660149] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:15:43.566 [2024-10-13 16:40:08.660224] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:43.566 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.566 [2024-10-13 16:40:08.727246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:43.566 [2024-10-13 16:40:08.816470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:43.566 [2024-10-13 16:40:08.816641] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:43.566 [2024-10-13 16:40:08.816657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:43.566 [2024-10-13 16:40:08.816670] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:43.566 [2024-10-13 16:40:08.816722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:44.131 16:40:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:44.131 16:40:09 -- common/autotest_common.sh@852 -- # return 0 00:15:44.131 16:40:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:44.131 16:40:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:44.131 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 16:40:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:44.390 16:40:09 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 [2024-10-13 16:40:09.654480] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 [2024-10-13 16:40:09.670659] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 NULL1 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:44.390 16:40:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:44.390 16:40:09 -- common/autotest_common.sh@10 -- # set +x 00:15:44.390 16:40:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:44.390 16:40:09 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:44.390 [2024-10-13 16:40:09.713970] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:15:44.390 [2024-10-13 16:40:09.714012] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1166699 ] 00:15:44.390 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.959 Attached to nqn.2016-06.io.spdk:cnode1 00:15:44.959 Namespace ID: 1 size: 1GB 00:15:44.959 fused_ordering(0) 00:15:44.959 fused_ordering(1) 00:15:44.959 fused_ordering(2) 00:15:44.959 fused_ordering(3) 00:15:44.959 fused_ordering(4) 00:15:44.959 fused_ordering(5) 00:15:44.959 fused_ordering(6) 00:15:44.959 fused_ordering(7) 00:15:44.959 fused_ordering(8) 00:15:44.959 fused_ordering(9) 00:15:44.959 fused_ordering(10) 00:15:44.959 fused_ordering(11) 00:15:44.959 fused_ordering(12) 00:15:44.959 fused_ordering(13) 00:15:44.959 fused_ordering(14) 00:15:44.959 fused_ordering(15) 00:15:44.959 fused_ordering(16) 00:15:44.959 fused_ordering(17) 00:15:44.959 fused_ordering(18) 00:15:44.959 fused_ordering(19) 00:15:44.959 fused_ordering(20) 00:15:44.959 fused_ordering(21) 00:15:44.959 fused_ordering(22) 00:15:44.959 fused_ordering(23) 00:15:44.959 fused_ordering(24) 00:15:44.959 fused_ordering(25) 00:15:44.959 fused_ordering(26) 00:15:44.959 fused_ordering(27) 00:15:44.959 fused_ordering(28) 00:15:44.959 fused_ordering(29) 00:15:44.959 fused_ordering(30) 00:15:44.959 fused_ordering(31) 00:15:44.959 fused_ordering(32) 00:15:44.959 fused_ordering(33) 00:15:44.959 fused_ordering(34) 00:15:44.959 fused_ordering(35) 00:15:44.959 fused_ordering(36) 00:15:44.959 fused_ordering(37) 00:15:44.959 fused_ordering(38) 00:15:44.959 fused_ordering(39) 00:15:44.959 fused_ordering(40) 00:15:44.959 fused_ordering(41) 00:15:44.959 fused_ordering(42) 00:15:44.959 fused_ordering(43) 00:15:44.959 fused_ordering(44) 00:15:44.959 fused_ordering(45) 00:15:44.959 fused_ordering(46) 00:15:44.959 fused_ordering(47) 00:15:44.959 fused_ordering(48) 00:15:44.959 fused_ordering(49) 00:15:44.959 fused_ordering(50) 00:15:44.960 fused_ordering(51) 00:15:44.960 fused_ordering(52) 00:15:44.960 fused_ordering(53) 00:15:44.960 fused_ordering(54) 00:15:44.960 fused_ordering(55) 00:15:44.960 fused_ordering(56) 00:15:44.960 fused_ordering(57) 00:15:44.960 fused_ordering(58) 00:15:44.960 fused_ordering(59) 00:15:44.960 fused_ordering(60) 00:15:44.960 fused_ordering(61) 00:15:44.960 fused_ordering(62) 00:15:44.960 fused_ordering(63) 00:15:44.960 fused_ordering(64) 00:15:44.960 fused_ordering(65) 00:15:44.960 fused_ordering(66) 00:15:44.960 fused_ordering(67) 00:15:44.960 fused_ordering(68) 00:15:44.960 fused_ordering(69) 00:15:44.960 fused_ordering(70) 00:15:44.960 fused_ordering(71) 00:15:44.960 fused_ordering(72) 00:15:44.960 fused_ordering(73) 00:15:44.960 fused_ordering(74) 00:15:44.960 fused_ordering(75) 00:15:44.960 fused_ordering(76) 00:15:44.960 fused_ordering(77) 00:15:44.960 fused_ordering(78) 00:15:44.960 fused_ordering(79) 00:15:44.960 fused_ordering(80) 00:15:44.960 fused_ordering(81) 00:15:44.960 fused_ordering(82) 00:15:44.960 fused_ordering(83) 00:15:44.960 fused_ordering(84) 00:15:44.960 fused_ordering(85) 00:15:44.960 fused_ordering(86) 00:15:44.960 fused_ordering(87) 00:15:44.960 fused_ordering(88) 00:15:44.960 fused_ordering(89) 00:15:44.960 fused_ordering(90) 00:15:44.960 fused_ordering(91) 00:15:44.960 fused_ordering(92) 00:15:44.960 fused_ordering(93) 00:15:44.960 fused_ordering(94) 00:15:44.960 fused_ordering(95) 00:15:44.960 fused_ordering(96) 00:15:44.960 fused_ordering(97) 00:15:44.960 fused_ordering(98) 00:15:44.960 fused_ordering(99) 00:15:44.960 fused_ordering(100) 00:15:44.960 fused_ordering(101) 00:15:44.960 fused_ordering(102) 00:15:44.960 fused_ordering(103) 00:15:44.960 fused_ordering(104) 00:15:44.960 fused_ordering(105) 00:15:44.960 fused_ordering(106) 00:15:44.960 fused_ordering(107) 00:15:44.960 fused_ordering(108) 00:15:44.960 fused_ordering(109) 00:15:44.960 fused_ordering(110) 00:15:44.960 fused_ordering(111) 00:15:44.960 fused_ordering(112) 00:15:44.960 fused_ordering(113) 00:15:44.960 fused_ordering(114) 00:15:44.960 fused_ordering(115) 00:15:44.960 fused_ordering(116) 00:15:44.960 fused_ordering(117) 00:15:44.960 fused_ordering(118) 00:15:44.960 fused_ordering(119) 00:15:44.960 fused_ordering(120) 00:15:44.960 fused_ordering(121) 00:15:44.960 fused_ordering(122) 00:15:44.960 fused_ordering(123) 00:15:44.960 fused_ordering(124) 00:15:44.960 fused_ordering(125) 00:15:44.960 fused_ordering(126) 00:15:44.960 fused_ordering(127) 00:15:44.960 fused_ordering(128) 00:15:44.960 fused_ordering(129) 00:15:44.960 fused_ordering(130) 00:15:44.960 fused_ordering(131) 00:15:44.960 fused_ordering(132) 00:15:44.960 fused_ordering(133) 00:15:44.960 fused_ordering(134) 00:15:44.960 fused_ordering(135) 00:15:44.960 fused_ordering(136) 00:15:44.960 fused_ordering(137) 00:15:44.960 fused_ordering(138) 00:15:44.960 fused_ordering(139) 00:15:44.960 fused_ordering(140) 00:15:44.960 fused_ordering(141) 00:15:44.960 fused_ordering(142) 00:15:44.960 fused_ordering(143) 00:15:44.960 fused_ordering(144) 00:15:44.960 fused_ordering(145) 00:15:44.960 fused_ordering(146) 00:15:44.960 fused_ordering(147) 00:15:44.960 fused_ordering(148) 00:15:44.960 fused_ordering(149) 00:15:44.960 fused_ordering(150) 00:15:44.960 fused_ordering(151) 00:15:44.960 fused_ordering(152) 00:15:44.960 fused_ordering(153) 00:15:44.960 fused_ordering(154) 00:15:44.960 fused_ordering(155) 00:15:44.960 fused_ordering(156) 00:15:44.960 fused_ordering(157) 00:15:44.960 fused_ordering(158) 00:15:44.961 fused_ordering(159) 00:15:44.961 fused_ordering(160) 00:15:44.961 fused_ordering(161) 00:15:44.961 fused_ordering(162) 00:15:44.961 fused_ordering(163) 00:15:44.961 fused_ordering(164) 00:15:44.961 fused_ordering(165) 00:15:44.961 fused_ordering(166) 00:15:44.961 fused_ordering(167) 00:15:44.961 fused_ordering(168) 00:15:44.961 fused_ordering(169) 00:15:44.961 fused_ordering(170) 00:15:44.961 fused_ordering(171) 00:15:44.961 fused_ordering(172) 00:15:44.961 fused_ordering(173) 00:15:44.961 fused_ordering(174) 00:15:44.961 fused_ordering(175) 00:15:44.961 fused_ordering(176) 00:15:44.961 fused_ordering(177) 00:15:44.961 fused_ordering(178) 00:15:44.961 fused_ordering(179) 00:15:44.961 fused_ordering(180) 00:15:44.961 fused_ordering(181) 00:15:44.961 fused_ordering(182) 00:15:44.961 fused_ordering(183) 00:15:44.961 fused_ordering(184) 00:15:44.961 fused_ordering(185) 00:15:44.961 fused_ordering(186) 00:15:44.961 fused_ordering(187) 00:15:44.961 fused_ordering(188) 00:15:44.961 fused_ordering(189) 00:15:44.961 fused_ordering(190) 00:15:44.961 fused_ordering(191) 00:15:44.961 fused_ordering(192) 00:15:44.961 fused_ordering(193) 00:15:44.961 fused_ordering(194) 00:15:44.961 fused_ordering(195) 00:15:44.961 fused_ordering(196) 00:15:44.961 fused_ordering(197) 00:15:44.961 fused_ordering(198) 00:15:44.961 fused_ordering(199) 00:15:44.961 fused_ordering(200) 00:15:44.961 fused_ordering(201) 00:15:44.961 fused_ordering(202) 00:15:44.961 fused_ordering(203) 00:15:44.961 fused_ordering(204) 00:15:44.961 fused_ordering(205) 00:15:45.221 fused_ordering(206) 00:15:45.221 fused_ordering(207) 00:15:45.221 fused_ordering(208) 00:15:45.221 fused_ordering(209) 00:15:45.221 fused_ordering(210) 00:15:45.221 fused_ordering(211) 00:15:45.221 fused_ordering(212) 00:15:45.221 fused_ordering(213) 00:15:45.221 fused_ordering(214) 00:15:45.221 fused_ordering(215) 00:15:45.221 fused_ordering(216) 00:15:45.221 fused_ordering(217) 00:15:45.221 fused_ordering(218) 00:15:45.221 fused_ordering(219) 00:15:45.221 fused_ordering(220) 00:15:45.221 fused_ordering(221) 00:15:45.221 fused_ordering(222) 00:15:45.221 fused_ordering(223) 00:15:45.221 fused_ordering(224) 00:15:45.221 fused_ordering(225) 00:15:45.221 fused_ordering(226) 00:15:45.221 fused_ordering(227) 00:15:45.221 fused_ordering(228) 00:15:45.221 fused_ordering(229) 00:15:45.221 fused_ordering(230) 00:15:45.221 fused_ordering(231) 00:15:45.221 fused_ordering(232) 00:15:45.221 fused_ordering(233) 00:15:45.221 fused_ordering(234) 00:15:45.221 fused_ordering(235) 00:15:45.221 fused_ordering(236) 00:15:45.221 fused_ordering(237) 00:15:45.221 fused_ordering(238) 00:15:45.221 fused_ordering(239) 00:15:45.221 fused_ordering(240) 00:15:45.221 fused_ordering(241) 00:15:45.221 fused_ordering(242) 00:15:45.221 fused_ordering(243) 00:15:45.221 fused_ordering(244) 00:15:45.221 fused_ordering(245) 00:15:45.221 fused_ordering(246) 00:15:45.221 fused_ordering(247) 00:15:45.221 fused_ordering(248) 00:15:45.221 fused_ordering(249) 00:15:45.221 fused_ordering(250) 00:15:45.221 fused_ordering(251) 00:15:45.221 fused_ordering(252) 00:15:45.221 fused_ordering(253) 00:15:45.221 fused_ordering(254) 00:15:45.221 fused_ordering(255) 00:15:45.221 fused_ordering(256) 00:15:45.221 fused_ordering(257) 00:15:45.221 fused_ordering(258) 00:15:45.221 fused_ordering(259) 00:15:45.221 fused_ordering(260) 00:15:45.221 fused_ordering(261) 00:15:45.221 fused_ordering(262) 00:15:45.221 fused_ordering(263) 00:15:45.221 fused_ordering(264) 00:15:45.221 fused_ordering(265) 00:15:45.221 fused_ordering(266) 00:15:45.221 fused_ordering(267) 00:15:45.221 fused_ordering(268) 00:15:45.221 fused_ordering(269) 00:15:45.221 fused_ordering(270) 00:15:45.221 fused_ordering(271) 00:15:45.221 fused_ordering(272) 00:15:45.221 fused_ordering(273) 00:15:45.221 fused_ordering(274) 00:15:45.221 fused_ordering(275) 00:15:45.221 fused_ordering(276) 00:15:45.221 fused_ordering(277) 00:15:45.221 fused_ordering(278) 00:15:45.221 fused_ordering(279) 00:15:45.221 fused_ordering(280) 00:15:45.221 fused_ordering(281) 00:15:45.221 fused_ordering(282) 00:15:45.221 fused_ordering(283) 00:15:45.221 fused_ordering(284) 00:15:45.221 fused_ordering(285) 00:15:45.221 fused_ordering(286) 00:15:45.221 fused_ordering(287) 00:15:45.221 fused_ordering(288) 00:15:45.221 fused_ordering(289) 00:15:45.221 fused_ordering(290) 00:15:45.221 fused_ordering(291) 00:15:45.221 fused_ordering(292) 00:15:45.221 fused_ordering(293) 00:15:45.221 fused_ordering(294) 00:15:45.221 fused_ordering(295) 00:15:45.221 fused_ordering(296) 00:15:45.221 fused_ordering(297) 00:15:45.221 fused_ordering(298) 00:15:45.221 fused_ordering(299) 00:15:45.221 fused_ordering(300) 00:15:45.221 fused_ordering(301) 00:15:45.221 fused_ordering(302) 00:15:45.221 fused_ordering(303) 00:15:45.221 fused_ordering(304) 00:15:45.221 fused_ordering(305) 00:15:45.221 fused_ordering(306) 00:15:45.221 fused_ordering(307) 00:15:45.221 fused_ordering(308) 00:15:45.221 fused_ordering(309) 00:15:45.221 fused_ordering(310) 00:15:45.221 fused_ordering(311) 00:15:45.221 fused_ordering(312) 00:15:45.221 fused_ordering(313) 00:15:45.221 fused_ordering(314) 00:15:45.221 fused_ordering(315) 00:15:45.221 fused_ordering(316) 00:15:45.221 fused_ordering(317) 00:15:45.221 fused_ordering(318) 00:15:45.221 fused_ordering(319) 00:15:45.221 fused_ordering(320) 00:15:45.221 fused_ordering(321) 00:15:45.221 fused_ordering(322) 00:15:45.221 fused_ordering(323) 00:15:45.221 fused_ordering(324) 00:15:45.221 fused_ordering(325) 00:15:45.221 fused_ordering(326) 00:15:45.221 fused_ordering(327) 00:15:45.221 fused_ordering(328) 00:15:45.221 fused_ordering(329) 00:15:45.221 fused_ordering(330) 00:15:45.221 fused_ordering(331) 00:15:45.221 fused_ordering(332) 00:15:45.221 fused_ordering(333) 00:15:45.221 fused_ordering(334) 00:15:45.221 fused_ordering(335) 00:15:45.221 fused_ordering(336) 00:15:45.221 fused_ordering(337) 00:15:45.221 fused_ordering(338) 00:15:45.221 fused_ordering(339) 00:15:45.221 fused_ordering(340) 00:15:45.221 fused_ordering(341) 00:15:45.221 fused_ordering(342) 00:15:45.221 fused_ordering(343) 00:15:45.221 fused_ordering(344) 00:15:45.221 fused_ordering(345) 00:15:45.221 fused_ordering(346) 00:15:45.221 fused_ordering(347) 00:15:45.221 fused_ordering(348) 00:15:45.221 fused_ordering(349) 00:15:45.221 fused_ordering(350) 00:15:45.221 fused_ordering(351) 00:15:45.221 fused_ordering(352) 00:15:45.221 fused_ordering(353) 00:15:45.221 fused_ordering(354) 00:15:45.221 fused_ordering(355) 00:15:45.221 fused_ordering(356) 00:15:45.221 fused_ordering(357) 00:15:45.221 fused_ordering(358) 00:15:45.221 fused_ordering(359) 00:15:45.221 fused_ordering(360) 00:15:45.221 fused_ordering(361) 00:15:45.221 fused_ordering(362) 00:15:45.221 fused_ordering(363) 00:15:45.221 fused_ordering(364) 00:15:45.221 fused_ordering(365) 00:15:45.221 fused_ordering(366) 00:15:45.221 fused_ordering(367) 00:15:45.221 fused_ordering(368) 00:15:45.221 fused_ordering(369) 00:15:45.221 fused_ordering(370) 00:15:45.221 fused_ordering(371) 00:15:45.221 fused_ordering(372) 00:15:45.221 fused_ordering(373) 00:15:45.221 fused_ordering(374) 00:15:45.221 fused_ordering(375) 00:15:45.221 fused_ordering(376) 00:15:45.221 fused_ordering(377) 00:15:45.221 fused_ordering(378) 00:15:45.221 fused_ordering(379) 00:15:45.221 fused_ordering(380) 00:15:45.221 fused_ordering(381) 00:15:45.221 fused_ordering(382) 00:15:45.221 fused_ordering(383) 00:15:45.221 fused_ordering(384) 00:15:45.221 fused_ordering(385) 00:15:45.221 fused_ordering(386) 00:15:45.221 fused_ordering(387) 00:15:45.221 fused_ordering(388) 00:15:45.221 fused_ordering(389) 00:15:45.221 fused_ordering(390) 00:15:45.221 fused_ordering(391) 00:15:45.221 fused_ordering(392) 00:15:45.221 fused_ordering(393) 00:15:45.221 fused_ordering(394) 00:15:45.221 fused_ordering(395) 00:15:45.221 fused_ordering(396) 00:15:45.221 fused_ordering(397) 00:15:45.221 fused_ordering(398) 00:15:45.221 fused_ordering(399) 00:15:45.221 fused_ordering(400) 00:15:45.221 fused_ordering(401) 00:15:45.221 fused_ordering(402) 00:15:45.221 fused_ordering(403) 00:15:45.221 fused_ordering(404) 00:15:45.222 fused_ordering(405) 00:15:45.222 fused_ordering(406) 00:15:45.222 fused_ordering(407) 00:15:45.222 fused_ordering(408) 00:15:45.222 fused_ordering(409) 00:15:45.222 fused_ordering(410) 00:15:45.480 fused_ordering(411) 00:15:45.480 fused_ordering(412) 00:15:45.480 fused_ordering(413) 00:15:45.480 fused_ordering(414) 00:15:45.480 fused_ordering(415) 00:15:45.480 fused_ordering(416) 00:15:45.480 fused_ordering(417) 00:15:45.480 fused_ordering(418) 00:15:45.480 fused_ordering(419) 00:15:45.480 fused_ordering(420) 00:15:45.480 fused_ordering(421) 00:15:45.480 fused_ordering(422) 00:15:45.480 fused_ordering(423) 00:15:45.480 fused_ordering(424) 00:15:45.480 fused_ordering(425) 00:15:45.480 fused_ordering(426) 00:15:45.480 fused_ordering(427) 00:15:45.480 fused_ordering(428) 00:15:45.480 fused_ordering(429) 00:15:45.480 fused_ordering(430) 00:15:45.480 fused_ordering(431) 00:15:45.480 fused_ordering(432) 00:15:45.480 fused_ordering(433) 00:15:45.480 fused_ordering(434) 00:15:45.480 fused_ordering(435) 00:15:45.480 fused_ordering(436) 00:15:45.480 fused_ordering(437) 00:15:45.480 fused_ordering(438) 00:15:45.480 fused_ordering(439) 00:15:45.480 fused_ordering(440) 00:15:45.480 fused_ordering(441) 00:15:45.480 fused_ordering(442) 00:15:45.480 fused_ordering(443) 00:15:45.480 fused_ordering(444) 00:15:45.480 fused_ordering(445) 00:15:45.480 fused_ordering(446) 00:15:45.480 fused_ordering(447) 00:15:45.480 fused_ordering(448) 00:15:45.480 fused_ordering(449) 00:15:45.480 fused_ordering(450) 00:15:45.480 fused_ordering(451) 00:15:45.480 fused_ordering(452) 00:15:45.480 fused_ordering(453) 00:15:45.480 fused_ordering(454) 00:15:45.480 fused_ordering(455) 00:15:45.480 fused_ordering(456) 00:15:45.480 fused_ordering(457) 00:15:45.480 fused_ordering(458) 00:15:45.480 fused_ordering(459) 00:15:45.480 fused_ordering(460) 00:15:45.480 fused_ordering(461) 00:15:45.480 fused_ordering(462) 00:15:45.480 fused_ordering(463) 00:15:45.480 fused_ordering(464) 00:15:45.480 fused_ordering(465) 00:15:45.480 fused_ordering(466) 00:15:45.480 fused_ordering(467) 00:15:45.481 fused_ordering(468) 00:15:45.481 fused_ordering(469) 00:15:45.481 fused_ordering(470) 00:15:45.481 fused_ordering(471) 00:15:45.481 fused_ordering(472) 00:15:45.481 fused_ordering(473) 00:15:45.481 fused_ordering(474) 00:15:45.481 fused_ordering(475) 00:15:45.481 fused_ordering(476) 00:15:45.481 fused_ordering(477) 00:15:45.481 fused_ordering(478) 00:15:45.481 fused_ordering(479) 00:15:45.481 fused_ordering(480) 00:15:45.481 fused_ordering(481) 00:15:45.481 fused_ordering(482) 00:15:45.481 fused_ordering(483) 00:15:45.481 fused_ordering(484) 00:15:45.481 fused_ordering(485) 00:15:45.481 fused_ordering(486) 00:15:45.481 fused_ordering(487) 00:15:45.481 fused_ordering(488) 00:15:45.481 fused_ordering(489) 00:15:45.481 fused_ordering(490) 00:15:45.481 fused_ordering(491) 00:15:45.481 fused_ordering(492) 00:15:45.481 fused_ordering(493) 00:15:45.481 fused_ordering(494) 00:15:45.481 fused_ordering(495) 00:15:45.481 fused_ordering(496) 00:15:45.481 fused_ordering(497) 00:15:45.481 fused_ordering(498) 00:15:45.481 fused_ordering(499) 00:15:45.481 fused_ordering(500) 00:15:45.481 fused_ordering(501) 00:15:45.481 fused_ordering(502) 00:15:45.481 fused_ordering(503) 00:15:45.481 fused_ordering(504) 00:15:45.481 fused_ordering(505) 00:15:45.481 fused_ordering(506) 00:15:45.481 fused_ordering(507) 00:15:45.481 fused_ordering(508) 00:15:45.481 fused_ordering(509) 00:15:45.481 fused_ordering(510) 00:15:45.481 fused_ordering(511) 00:15:45.481 fused_ordering(512) 00:15:45.481 fused_ordering(513) 00:15:45.481 fused_ordering(514) 00:15:45.481 fused_ordering(515) 00:15:45.481 fused_ordering(516) 00:15:45.481 fused_ordering(517) 00:15:45.481 fused_ordering(518) 00:15:45.481 fused_ordering(519) 00:15:45.481 fused_ordering(520) 00:15:45.481 fused_ordering(521) 00:15:45.481 fused_ordering(522) 00:15:45.481 fused_ordering(523) 00:15:45.481 fused_ordering(524) 00:15:45.481 fused_ordering(525) 00:15:45.481 fused_ordering(526) 00:15:45.481 fused_ordering(527) 00:15:45.481 fused_ordering(528) 00:15:45.481 fused_ordering(529) 00:15:45.481 fused_ordering(530) 00:15:45.481 fused_ordering(531) 00:15:45.481 fused_ordering(532) 00:15:45.481 fused_ordering(533) 00:15:45.481 fused_ordering(534) 00:15:45.481 fused_ordering(535) 00:15:45.481 fused_ordering(536) 00:15:45.481 fused_ordering(537) 00:15:45.481 fused_ordering(538) 00:15:45.481 fused_ordering(539) 00:15:45.481 fused_ordering(540) 00:15:45.481 fused_ordering(541) 00:15:45.481 fused_ordering(542) 00:15:45.481 fused_ordering(543) 00:15:45.481 fused_ordering(544) 00:15:45.481 fused_ordering(545) 00:15:45.481 fused_ordering(546) 00:15:45.481 fused_ordering(547) 00:15:45.481 fused_ordering(548) 00:15:45.481 fused_ordering(549) 00:15:45.481 fused_ordering(550) 00:15:45.481 fused_ordering(551) 00:15:45.481 fused_ordering(552) 00:15:45.481 fused_ordering(553) 00:15:45.481 fused_ordering(554) 00:15:45.481 fused_ordering(555) 00:15:45.481 fused_ordering(556) 00:15:45.481 fused_ordering(557) 00:15:45.481 fused_ordering(558) 00:15:45.481 fused_ordering(559) 00:15:45.481 fused_ordering(560) 00:15:45.481 fused_ordering(561) 00:15:45.481 fused_ordering(562) 00:15:45.481 fused_ordering(563) 00:15:45.481 fused_ordering(564) 00:15:45.481 fused_ordering(565) 00:15:45.481 fused_ordering(566) 00:15:45.481 fused_ordering(567) 00:15:45.481 fused_ordering(568) 00:15:45.481 fused_ordering(569) 00:15:45.481 fused_ordering(570) 00:15:45.481 fused_ordering(571) 00:15:45.481 fused_ordering(572) 00:15:45.481 fused_ordering(573) 00:15:45.481 fused_ordering(574) 00:15:45.481 fused_ordering(575) 00:15:45.481 fused_ordering(576) 00:15:45.481 fused_ordering(577) 00:15:45.481 fused_ordering(578) 00:15:45.481 fused_ordering(579) 00:15:45.481 fused_ordering(580) 00:15:45.481 fused_ordering(581) 00:15:45.481 fused_ordering(582) 00:15:45.481 fused_ordering(583) 00:15:45.481 fused_ordering(584) 00:15:45.481 fused_ordering(585) 00:15:45.481 fused_ordering(586) 00:15:45.481 fused_ordering(587) 00:15:45.481 fused_ordering(588) 00:15:45.481 fused_ordering(589) 00:15:45.481 fused_ordering(590) 00:15:45.481 fused_ordering(591) 00:15:45.481 fused_ordering(592) 00:15:45.481 fused_ordering(593) 00:15:45.481 fused_ordering(594) 00:15:45.481 fused_ordering(595) 00:15:45.481 fused_ordering(596) 00:15:45.481 fused_ordering(597) 00:15:45.481 fused_ordering(598) 00:15:45.481 fused_ordering(599) 00:15:45.481 fused_ordering(600) 00:15:45.481 fused_ordering(601) 00:15:45.481 fused_ordering(602) 00:15:45.481 fused_ordering(603) 00:15:45.481 fused_ordering(604) 00:15:45.481 fused_ordering(605) 00:15:45.481 fused_ordering(606) 00:15:45.481 fused_ordering(607) 00:15:45.481 fused_ordering(608) 00:15:45.481 fused_ordering(609) 00:15:45.481 fused_ordering(610) 00:15:45.481 fused_ordering(611) 00:15:45.481 fused_ordering(612) 00:15:45.481 fused_ordering(613) 00:15:45.481 fused_ordering(614) 00:15:45.481 fused_ordering(615) 00:15:46.048 fused_ordering(616) 00:15:46.048 fused_ordering(617) 00:15:46.048 fused_ordering(618) 00:15:46.048 fused_ordering(619) 00:15:46.048 fused_ordering(620) 00:15:46.048 fused_ordering(621) 00:15:46.048 fused_ordering(622) 00:15:46.048 fused_ordering(623) 00:15:46.048 fused_ordering(624) 00:15:46.048 fused_ordering(625) 00:15:46.048 fused_ordering(626) 00:15:46.048 fused_ordering(627) 00:15:46.048 fused_ordering(628) 00:15:46.048 fused_ordering(629) 00:15:46.048 fused_ordering(630) 00:15:46.048 fused_ordering(631) 00:15:46.048 fused_ordering(632) 00:15:46.048 fused_ordering(633) 00:15:46.048 fused_ordering(634) 00:15:46.048 fused_ordering(635) 00:15:46.048 fused_ordering(636) 00:15:46.048 fused_ordering(637) 00:15:46.048 fused_ordering(638) 00:15:46.048 fused_ordering(639) 00:15:46.048 fused_ordering(640) 00:15:46.048 fused_ordering(641) 00:15:46.048 fused_ordering(642) 00:15:46.048 fused_ordering(643) 00:15:46.048 fused_ordering(644) 00:15:46.048 fused_ordering(645) 00:15:46.048 fused_ordering(646) 00:15:46.048 fused_ordering(647) 00:15:46.048 fused_ordering(648) 00:15:46.048 fused_ordering(649) 00:15:46.048 fused_ordering(650) 00:15:46.048 fused_ordering(651) 00:15:46.048 fused_ordering(652) 00:15:46.049 fused_ordering(653) 00:15:46.049 fused_ordering(654) 00:15:46.049 fused_ordering(655) 00:15:46.049 fused_ordering(656) 00:15:46.049 fused_ordering(657) 00:15:46.049 fused_ordering(658) 00:15:46.049 fused_ordering(659) 00:15:46.049 fused_ordering(660) 00:15:46.049 fused_ordering(661) 00:15:46.049 fused_ordering(662) 00:15:46.049 fused_ordering(663) 00:15:46.049 fused_ordering(664) 00:15:46.049 fused_ordering(665) 00:15:46.049 fused_ordering(666) 00:15:46.049 fused_ordering(667) 00:15:46.049 fused_ordering(668) 00:15:46.049 fused_ordering(669) 00:15:46.049 fused_ordering(670) 00:15:46.049 fused_ordering(671) 00:15:46.049 fused_ordering(672) 00:15:46.049 fused_ordering(673) 00:15:46.049 fused_ordering(674) 00:15:46.049 fused_ordering(675) 00:15:46.049 fused_ordering(676) 00:15:46.049 fused_ordering(677) 00:15:46.049 fused_ordering(678) 00:15:46.049 fused_ordering(679) 00:15:46.049 fused_ordering(680) 00:15:46.049 fused_ordering(681) 00:15:46.049 fused_ordering(682) 00:15:46.049 fused_ordering(683) 00:15:46.049 fused_ordering(684) 00:15:46.049 fused_ordering(685) 00:15:46.049 fused_ordering(686) 00:15:46.049 fused_ordering(687) 00:15:46.049 fused_ordering(688) 00:15:46.049 fused_ordering(689) 00:15:46.049 fused_ordering(690) 00:15:46.049 fused_ordering(691) 00:15:46.049 fused_ordering(692) 00:15:46.049 fused_ordering(693) 00:15:46.049 fused_ordering(694) 00:15:46.049 fused_ordering(695) 00:15:46.049 fused_ordering(696) 00:15:46.049 fused_ordering(697) 00:15:46.049 fused_ordering(698) 00:15:46.049 fused_ordering(699) 00:15:46.049 fused_ordering(700) 00:15:46.049 fused_ordering(701) 00:15:46.049 fused_ordering(702) 00:15:46.049 fused_ordering(703) 00:15:46.049 fused_ordering(704) 00:15:46.049 fused_ordering(705) 00:15:46.049 fused_ordering(706) 00:15:46.049 fused_ordering(707) 00:15:46.049 fused_ordering(708) 00:15:46.049 fused_ordering(709) 00:15:46.049 fused_ordering(710) 00:15:46.049 fused_ordering(711) 00:15:46.049 fused_ordering(712) 00:15:46.049 fused_ordering(713) 00:15:46.049 fused_ordering(714) 00:15:46.049 fused_ordering(715) 00:15:46.049 fused_ordering(716) 00:15:46.049 fused_ordering(717) 00:15:46.049 fused_ordering(718) 00:15:46.049 fused_ordering(719) 00:15:46.049 fused_ordering(720) 00:15:46.049 fused_ordering(721) 00:15:46.049 fused_ordering(722) 00:15:46.049 fused_ordering(723) 00:15:46.049 fused_ordering(724) 00:15:46.049 fused_ordering(725) 00:15:46.049 fused_ordering(726) 00:15:46.049 fused_ordering(727) 00:15:46.049 fused_ordering(728) 00:15:46.049 fused_ordering(729) 00:15:46.049 fused_ordering(730) 00:15:46.049 fused_ordering(731) 00:15:46.049 fused_ordering(732) 00:15:46.049 fused_ordering(733) 00:15:46.049 fused_ordering(734) 00:15:46.049 fused_ordering(735) 00:15:46.049 fused_ordering(736) 00:15:46.049 fused_ordering(737) 00:15:46.049 fused_ordering(738) 00:15:46.049 fused_ordering(739) 00:15:46.049 fused_ordering(740) 00:15:46.049 fused_ordering(741) 00:15:46.049 fused_ordering(742) 00:15:46.049 fused_ordering(743) 00:15:46.049 fused_ordering(744) 00:15:46.049 fused_ordering(745) 00:15:46.049 fused_ordering(746) 00:15:46.049 fused_ordering(747) 00:15:46.049 fused_ordering(748) 00:15:46.049 fused_ordering(749) 00:15:46.049 fused_ordering(750) 00:15:46.049 fused_ordering(751) 00:15:46.049 fused_ordering(752) 00:15:46.049 fused_ordering(753) 00:15:46.049 fused_ordering(754) 00:15:46.049 fused_ordering(755) 00:15:46.049 fused_ordering(756) 00:15:46.049 fused_ordering(757) 00:15:46.049 fused_ordering(758) 00:15:46.049 fused_ordering(759) 00:15:46.049 fused_ordering(760) 00:15:46.049 fused_ordering(761) 00:15:46.049 fused_ordering(762) 00:15:46.049 fused_ordering(763) 00:15:46.049 fused_ordering(764) 00:15:46.049 fused_ordering(765) 00:15:46.049 fused_ordering(766) 00:15:46.049 fused_ordering(767) 00:15:46.049 fused_ordering(768) 00:15:46.049 fused_ordering(769) 00:15:46.049 fused_ordering(770) 00:15:46.049 fused_ordering(771) 00:15:46.049 fused_ordering(772) 00:15:46.049 fused_ordering(773) 00:15:46.049 fused_ordering(774) 00:15:46.049 fused_ordering(775) 00:15:46.049 fused_ordering(776) 00:15:46.049 fused_ordering(777) 00:15:46.049 fused_ordering(778) 00:15:46.049 fused_ordering(779) 00:15:46.049 fused_ordering(780) 00:15:46.049 fused_ordering(781) 00:15:46.049 fused_ordering(782) 00:15:46.049 fused_ordering(783) 00:15:46.049 fused_ordering(784) 00:15:46.049 fused_ordering(785) 00:15:46.049 fused_ordering(786) 00:15:46.049 fused_ordering(787) 00:15:46.049 fused_ordering(788) 00:15:46.049 fused_ordering(789) 00:15:46.049 fused_ordering(790) 00:15:46.049 fused_ordering(791) 00:15:46.049 fused_ordering(792) 00:15:46.049 fused_ordering(793) 00:15:46.049 fused_ordering(794) 00:15:46.049 fused_ordering(795) 00:15:46.049 fused_ordering(796) 00:15:46.049 fused_ordering(797) 00:15:46.049 fused_ordering(798) 00:15:46.049 fused_ordering(799) 00:15:46.049 fused_ordering(800) 00:15:46.049 fused_ordering(801) 00:15:46.049 fused_ordering(802) 00:15:46.049 fused_ordering(803) 00:15:46.049 fused_ordering(804) 00:15:46.049 fused_ordering(805) 00:15:46.049 fused_ordering(806) 00:15:46.049 fused_ordering(807) 00:15:46.049 fused_ordering(808) 00:15:46.049 fused_ordering(809) 00:15:46.049 fused_ordering(810) 00:15:46.049 fused_ordering(811) 00:15:46.049 fused_ordering(812) 00:15:46.049 fused_ordering(813) 00:15:46.049 fused_ordering(814) 00:15:46.049 fused_ordering(815) 00:15:46.049 fused_ordering(816) 00:15:46.049 fused_ordering(817) 00:15:46.049 fused_ordering(818) 00:15:46.049 fused_ordering(819) 00:15:46.049 fused_ordering(820) 00:15:46.985 fused_ordering(821) 00:15:46.985 fused_ordering(822) 00:15:46.985 fused_ordering(823) 00:15:46.985 fused_ordering(824) 00:15:46.985 fused_ordering(825) 00:15:46.985 fused_ordering(826) 00:15:46.985 fused_ordering(827) 00:15:46.985 fused_ordering(828) 00:15:46.985 fused_ordering(829) 00:15:46.985 fused_ordering(830) 00:15:46.985 fused_ordering(831) 00:15:46.985 fused_ordering(832) 00:15:46.985 fused_ordering(833) 00:15:46.985 fused_ordering(834) 00:15:46.985 fused_ordering(835) 00:15:46.985 fused_ordering(836) 00:15:46.985 fused_ordering(837) 00:15:46.985 fused_ordering(838) 00:15:46.985 fused_ordering(839) 00:15:46.985 fused_ordering(840) 00:15:46.985 fused_ordering(841) 00:15:46.985 fused_ordering(842) 00:15:46.985 fused_ordering(843) 00:15:46.985 fused_ordering(844) 00:15:46.985 fused_ordering(845) 00:15:46.985 fused_ordering(846) 00:15:46.985 fused_ordering(847) 00:15:46.985 fused_ordering(848) 00:15:46.985 fused_ordering(849) 00:15:46.985 fused_ordering(850) 00:15:46.985 fused_ordering(851) 00:15:46.985 fused_ordering(852) 00:15:46.985 fused_ordering(853) 00:15:46.985 fused_ordering(854) 00:15:46.985 fused_ordering(855) 00:15:46.985 fused_ordering(856) 00:15:46.985 fused_ordering(857) 00:15:46.985 fused_ordering(858) 00:15:46.985 fused_ordering(859) 00:15:46.985 fused_ordering(860) 00:15:46.985 fused_ordering(861) 00:15:46.985 fused_ordering(862) 00:15:46.985 fused_ordering(863) 00:15:46.985 fused_ordering(864) 00:15:46.985 fused_ordering(865) 00:15:46.985 fused_ordering(866) 00:15:46.985 fused_ordering(867) 00:15:46.985 fused_ordering(868) 00:15:46.985 fused_ordering(869) 00:15:46.985 fused_ordering(870) 00:15:46.985 fused_ordering(871) 00:15:46.985 fused_ordering(872) 00:15:46.985 fused_ordering(873) 00:15:46.985 fused_ordering(874) 00:15:46.985 fused_ordering(875) 00:15:46.985 fused_ordering(876) 00:15:46.985 fused_ordering(877) 00:15:46.985 fused_ordering(878) 00:15:46.985 fused_ordering(879) 00:15:46.985 fused_ordering(880) 00:15:46.985 fused_ordering(881) 00:15:46.985 fused_ordering(882) 00:15:46.985 fused_ordering(883) 00:15:46.985 fused_ordering(884) 00:15:46.985 fused_ordering(885) 00:15:46.985 fused_ordering(886) 00:15:46.985 fused_ordering(887) 00:15:46.985 fused_ordering(888) 00:15:46.985 fused_ordering(889) 00:15:46.985 fused_ordering(890) 00:15:46.985 fused_ordering(891) 00:15:46.985 fused_ordering(892) 00:15:46.985 fused_ordering(893) 00:15:46.985 fused_ordering(894) 00:15:46.985 fused_ordering(895) 00:15:46.985 fused_ordering(896) 00:15:46.985 fused_ordering(897) 00:15:46.985 fused_ordering(898) 00:15:46.985 fused_ordering(899) 00:15:46.985 fused_ordering(900) 00:15:46.985 fused_ordering(901) 00:15:46.985 fused_ordering(902) 00:15:46.985 fused_ordering(903) 00:15:46.985 fused_ordering(904) 00:15:46.985 fused_ordering(905) 00:15:46.985 fused_ordering(906) 00:15:46.985 fused_ordering(907) 00:15:46.985 fused_ordering(908) 00:15:46.985 fused_ordering(909) 00:15:46.985 fused_ordering(910) 00:15:46.985 fused_ordering(911) 00:15:46.985 fused_ordering(912) 00:15:46.985 fused_ordering(913) 00:15:46.985 fused_ordering(914) 00:15:46.985 fused_ordering(915) 00:15:46.985 fused_ordering(916) 00:15:46.985 fused_ordering(917) 00:15:46.985 fused_ordering(918) 00:15:46.985 fused_ordering(919) 00:15:46.985 fused_ordering(920) 00:15:46.985 fused_ordering(921) 00:15:46.985 fused_ordering(922) 00:15:46.985 fused_ordering(923) 00:15:46.985 fused_ordering(924) 00:15:46.985 fused_ordering(925) 00:15:46.985 fused_ordering(926) 00:15:46.985 fused_ordering(927) 00:15:46.985 fused_ordering(928) 00:15:46.985 fused_ordering(929) 00:15:46.985 fused_ordering(930) 00:15:46.985 fused_ordering(931) 00:15:46.985 fused_ordering(932) 00:15:46.985 fused_ordering(933) 00:15:46.985 fused_ordering(934) 00:15:46.985 fused_ordering(935) 00:15:46.985 fused_ordering(936) 00:15:46.985 fused_ordering(937) 00:15:46.985 fused_ordering(938) 00:15:46.985 fused_ordering(939) 00:15:46.985 fused_ordering(940) 00:15:46.985 fused_ordering(941) 00:15:46.985 fused_ordering(942) 00:15:46.985 fused_ordering(943) 00:15:46.985 fused_ordering(944) 00:15:46.985 fused_ordering(945) 00:15:46.985 fused_ordering(946) 00:15:46.985 fused_ordering(947) 00:15:46.985 fused_ordering(948) 00:15:46.985 fused_ordering(949) 00:15:46.985 fused_ordering(950) 00:15:46.985 fused_ordering(951) 00:15:46.985 fused_ordering(952) 00:15:46.985 fused_ordering(953) 00:15:46.985 fused_ordering(954) 00:15:46.985 fused_ordering(955) 00:15:46.985 fused_ordering(956) 00:15:46.985 fused_ordering(957) 00:15:46.985 fused_ordering(958) 00:15:46.985 fused_ordering(959) 00:15:46.985 fused_ordering(960) 00:15:46.985 fused_ordering(961) 00:15:46.985 fused_ordering(962) 00:15:46.985 fused_ordering(963) 00:15:46.985 fused_ordering(964) 00:15:46.985 fused_ordering(965) 00:15:46.985 fused_ordering(966) 00:15:46.985 fused_ordering(967) 00:15:46.985 fused_ordering(968) 00:15:46.985 fused_ordering(969) 00:15:46.985 fused_ordering(970) 00:15:46.985 fused_ordering(971) 00:15:46.985 fused_ordering(972) 00:15:46.985 fused_ordering(973) 00:15:46.985 fused_ordering(974) 00:15:46.985 fused_ordering(975) 00:15:46.985 fused_ordering(976) 00:15:46.985 fused_ordering(977) 00:15:46.985 fused_ordering(978) 00:15:46.985 fused_ordering(979) 00:15:46.985 fused_ordering(980) 00:15:46.985 fused_ordering(981) 00:15:46.985 fused_ordering(982) 00:15:46.985 fused_ordering(983) 00:15:46.985 fused_ordering(984) 00:15:46.985 fused_ordering(985) 00:15:46.985 fused_ordering(986) 00:15:46.985 fused_ordering(987) 00:15:46.985 fused_ordering(988) 00:15:46.985 fused_ordering(989) 00:15:46.985 fused_ordering(990) 00:15:46.985 fused_ordering(991) 00:15:46.985 fused_ordering(992) 00:15:46.985 fused_ordering(993) 00:15:46.985 fused_ordering(994) 00:15:46.985 fused_ordering(995) 00:15:46.985 fused_ordering(996) 00:15:46.985 fused_ordering(997) 00:15:46.985 fused_ordering(998) 00:15:46.985 fused_ordering(999) 00:15:46.985 fused_ordering(1000) 00:15:46.985 fused_ordering(1001) 00:15:46.985 fused_ordering(1002) 00:15:46.985 fused_ordering(1003) 00:15:46.985 fused_ordering(1004) 00:15:46.985 fused_ordering(1005) 00:15:46.985 fused_ordering(1006) 00:15:46.985 fused_ordering(1007) 00:15:46.985 fused_ordering(1008) 00:15:46.985 fused_ordering(1009) 00:15:46.985 fused_ordering(1010) 00:15:46.985 fused_ordering(1011) 00:15:46.985 fused_ordering(1012) 00:15:46.985 fused_ordering(1013) 00:15:46.985 fused_ordering(1014) 00:15:46.985 fused_ordering(1015) 00:15:46.985 fused_ordering(1016) 00:15:46.985 fused_ordering(1017) 00:15:46.985 fused_ordering(1018) 00:15:46.985 fused_ordering(1019) 00:15:46.985 fused_ordering(1020) 00:15:46.985 fused_ordering(1021) 00:15:46.985 fused_ordering(1022) 00:15:46.985 fused_ordering(1023) 00:15:46.985 16:40:12 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:46.985 16:40:12 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:46.985 16:40:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:46.985 16:40:12 -- nvmf/common.sh@116 -- # sync 00:15:46.985 16:40:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:46.985 16:40:12 -- nvmf/common.sh@119 -- # set +e 00:15:46.985 16:40:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:46.985 16:40:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:46.985 rmmod nvme_tcp 00:15:46.985 rmmod nvme_fabrics 00:15:46.985 rmmod nvme_keyring 00:15:46.985 16:40:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:46.985 16:40:12 -- nvmf/common.sh@123 -- # set -e 00:15:46.985 16:40:12 -- nvmf/common.sh@124 -- # return 0 00:15:46.985 16:40:12 -- nvmf/common.sh@477 -- # '[' -n 1166547 ']' 00:15:46.985 16:40:12 -- nvmf/common.sh@478 -- # killprocess 1166547 00:15:46.985 16:40:12 -- common/autotest_common.sh@926 -- # '[' -z 1166547 ']' 00:15:46.985 16:40:12 -- common/autotest_common.sh@930 -- # kill -0 1166547 00:15:46.985 16:40:12 -- common/autotest_common.sh@931 -- # uname 00:15:46.985 16:40:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:46.985 16:40:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1166547 00:15:46.985 16:40:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:46.985 16:40:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:46.985 16:40:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1166547' 00:15:46.985 killing process with pid 1166547 00:15:46.985 16:40:12 -- common/autotest_common.sh@945 -- # kill 1166547 00:15:46.985 16:40:12 -- common/autotest_common.sh@950 -- # wait 1166547 00:15:46.985 16:40:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:46.985 16:40:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:46.985 16:40:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:46.986 16:40:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:46.986 16:40:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:46.986 16:40:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:46.986 16:40:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:46.986 16:40:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.519 16:40:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:49.519 00:15:49.519 real 0m8.084s 00:15:49.519 user 0m5.995s 00:15:49.519 sys 0m3.102s 00:15:49.519 16:40:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:49.519 16:40:14 -- common/autotest_common.sh@10 -- # set +x 00:15:49.519 ************************************ 00:15:49.519 END TEST nvmf_fused_ordering 00:15:49.519 ************************************ 00:15:49.519 16:40:14 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:49.519 16:40:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:49.519 16:40:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:49.519 16:40:14 -- common/autotest_common.sh@10 -- # set +x 00:15:49.519 ************************************ 00:15:49.519 START TEST nvmf_delete_subsystem 00:15:49.519 ************************************ 00:15:49.519 16:40:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:49.519 * Looking for test storage... 00:15:49.519 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:49.519 16:40:14 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:49.519 16:40:14 -- nvmf/common.sh@7 -- # uname -s 00:15:49.519 16:40:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:49.519 16:40:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:49.519 16:40:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:49.519 16:40:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:49.519 16:40:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:49.519 16:40:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:49.519 16:40:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:49.519 16:40:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:49.519 16:40:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:49.519 16:40:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:49.519 16:40:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:49.519 16:40:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:49.519 16:40:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:49.519 16:40:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:49.519 16:40:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:49.519 16:40:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:49.519 16:40:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:49.519 16:40:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:49.519 16:40:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:49.519 16:40:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.519 16:40:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.519 16:40:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.519 16:40:14 -- paths/export.sh@5 -- # export PATH 00:15:49.519 16:40:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.519 16:40:14 -- nvmf/common.sh@46 -- # : 0 00:15:49.519 16:40:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:49.519 16:40:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:49.519 16:40:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:49.519 16:40:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:49.519 16:40:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:49.519 16:40:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:49.519 16:40:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:49.519 16:40:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:49.519 16:40:14 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:49.519 16:40:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:49.519 16:40:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:49.519 16:40:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:49.519 16:40:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:49.519 16:40:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:49.519 16:40:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.519 16:40:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.519 16:40:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.519 16:40:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:49.519 16:40:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:49.519 16:40:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:49.519 16:40:14 -- common/autotest_common.sh@10 -- # set +x 00:15:51.421 16:40:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:51.421 16:40:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:51.421 16:40:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:51.421 16:40:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:51.421 16:40:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:51.421 16:40:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:51.421 16:40:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:51.421 16:40:16 -- nvmf/common.sh@294 -- # net_devs=() 00:15:51.421 16:40:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:51.421 16:40:16 -- nvmf/common.sh@295 -- # e810=() 00:15:51.421 16:40:16 -- nvmf/common.sh@295 -- # local -ga e810 00:15:51.421 16:40:16 -- nvmf/common.sh@296 -- # x722=() 00:15:51.421 16:40:16 -- nvmf/common.sh@296 -- # local -ga x722 00:15:51.421 16:40:16 -- nvmf/common.sh@297 -- # mlx=() 00:15:51.421 16:40:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:51.421 16:40:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:51.421 16:40:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:51.422 16:40:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:51.422 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:51.422 16:40:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:51.422 16:40:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:51.422 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:51.422 16:40:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:51.422 16:40:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:51.422 16:40:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:51.422 16:40:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:51.422 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:51.422 16:40:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:51.422 16:40:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:51.422 16:40:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:51.422 16:40:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:51.422 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:51.422 16:40:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:51.422 16:40:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:51.422 16:40:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:51.422 16:40:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:51.422 16:40:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:51.422 16:40:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:51.422 16:40:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:51.422 16:40:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:51.422 16:40:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:51.422 16:40:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:51.422 16:40:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:51.422 16:40:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:51.422 16:40:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:51.422 16:40:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:51.422 16:40:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:51.422 16:40:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:51.422 16:40:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:51.422 16:40:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:51.422 16:40:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:51.422 16:40:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:51.422 16:40:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:51.422 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:51.422 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:15:51.422 00:15:51.422 --- 10.0.0.2 ping statistics --- 00:15:51.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:51.422 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:15:51.422 16:40:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:51.422 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:51.422 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:15:51.422 00:15:51.422 --- 10.0.0.1 ping statistics --- 00:15:51.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:51.422 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:15:51.422 16:40:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:51.422 16:40:16 -- nvmf/common.sh@410 -- # return 0 00:15:51.422 16:40:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:51.422 16:40:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:51.422 16:40:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:51.422 16:40:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:51.422 16:40:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:51.422 16:40:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:51.422 16:40:16 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:51.422 16:40:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:51.422 16:40:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:51.422 16:40:16 -- common/autotest_common.sh@10 -- # set +x 00:15:51.422 16:40:16 -- nvmf/common.sh@469 -- # nvmfpid=1169035 00:15:51.422 16:40:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:51.422 16:40:16 -- nvmf/common.sh@470 -- # waitforlisten 1169035 00:15:51.422 16:40:16 -- common/autotest_common.sh@819 -- # '[' -z 1169035 ']' 00:15:51.422 16:40:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:51.422 16:40:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:51.422 16:40:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:51.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:51.422 16:40:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:51.422 16:40:16 -- common/autotest_common.sh@10 -- # set +x 00:15:51.422 [2024-10-13 16:40:16.789191] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:15:51.422 [2024-10-13 16:40:16.789272] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:51.422 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.422 [2024-10-13 16:40:16.857033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:51.681 [2024-10-13 16:40:16.945744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:51.681 [2024-10-13 16:40:16.945908] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:51.681 [2024-10-13 16:40:16.945928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:51.681 [2024-10-13 16:40:16.945942] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:51.681 [2024-10-13 16:40:16.946032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:51.681 [2024-10-13 16:40:16.946038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:52.616 16:40:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:52.616 16:40:17 -- common/autotest_common.sh@852 -- # return 0 00:15:52.616 16:40:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:52.616 16:40:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 16:40:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 [2024-10-13 16:40:17.803557] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 [2024-10-13 16:40:17.819862] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 NULL1 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 Delay0 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:52.616 16:40:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:52.616 16:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.616 16:40:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@28 -- # perf_pid=1169194 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:52.616 16:40:17 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:52.616 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.616 [2024-10-13 16:40:17.894448] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:54.515 16:40:19 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:54.515 16:40:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.515 16:40:19 -- common/autotest_common.sh@10 -- # set +x 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 [2024-10-13 16:40:20.055773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6f0ce0 is same with the state(5) to be set 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 starting I/O failed: -6 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Write completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.776 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 starting I/O failed: -6 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 starting I/O failed: -6 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 starting I/O failed: -6 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 starting I/O failed: -6 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 [2024-10-13 16:40:20.056501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fc714000c00 is same with the state(5) to be set 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Read completed with error (sct=0, sc=8) 00:15:54.777 Write completed with error (sct=0, sc=8) 00:15:55.714 [2024-10-13 16:40:21.030949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6f29c0 is same with the state(5) to be set 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 [2024-10-13 16:40:21.054515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6f09e0 is same with the state(5) to be set 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 [2024-10-13 16:40:21.054727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6f0f90 is same with the state(5) to be set 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 [2024-10-13 16:40:21.058669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fc71400bf20 is same with the state(5) to be set 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Write completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 Read completed with error (sct=0, sc=8) 00:15:55.714 [2024-10-13 16:40:21.058874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fc71400c600 is same with the state(5) to be set 00:15:55.714 [2024-10-13 16:40:21.059708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6f29c0 (9): Bad file descriptor 00:15:55.714 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:55.714 16:40:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.714 16:40:21 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:55.714 16:40:21 -- target/delete_subsystem.sh@35 -- # kill -0 1169194 00:15:55.714 16:40:21 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:55.714 Initializing NVMe Controllers 00:15:55.714 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:55.714 Controller IO queue size 128, less than required. 00:15:55.714 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:55.714 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:55.714 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:55.714 Initialization complete. Launching workers. 00:15:55.714 ======================================================== 00:15:55.714 Latency(us) 00:15:55.714 Device Information : IOPS MiB/s Average min max 00:15:55.714 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 156.87 0.08 926419.61 580.91 1011449.05 00:15:55.714 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 161.34 0.08 959756.74 379.20 2004341.48 00:15:55.714 ======================================================== 00:15:55.714 Total : 318.21 0.16 943322.21 379.20 2004341.48 00:15:55.714 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@35 -- # kill -0 1169194 00:15:56.283 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1169194) - No such process 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@45 -- # NOT wait 1169194 00:15:56.283 16:40:21 -- common/autotest_common.sh@640 -- # local es=0 00:15:56.283 16:40:21 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 1169194 00:15:56.283 16:40:21 -- common/autotest_common.sh@628 -- # local arg=wait 00:15:56.283 16:40:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:56.283 16:40:21 -- common/autotest_common.sh@632 -- # type -t wait 00:15:56.283 16:40:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:56.283 16:40:21 -- common/autotest_common.sh@643 -- # wait 1169194 00:15:56.283 16:40:21 -- common/autotest_common.sh@643 -- # es=1 00:15:56.283 16:40:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:56.283 16:40:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:56.283 16:40:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:56.283 16:40:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:56.283 16:40:21 -- common/autotest_common.sh@10 -- # set +x 00:15:56.283 16:40:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:56.283 16:40:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:56.283 16:40:21 -- common/autotest_common.sh@10 -- # set +x 00:15:56.283 [2024-10-13 16:40:21.583888] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:56.283 16:40:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:56.283 16:40:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:56.283 16:40:21 -- common/autotest_common.sh@10 -- # set +x 00:15:56.283 16:40:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@54 -- # perf_pid=1169610 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:56.283 16:40:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:56.283 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.283 [2024-10-13 16:40:21.646577] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:56.849 16:40:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:56.849 16:40:22 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:56.849 16:40:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:57.107 16:40:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:57.107 16:40:22 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:57.107 16:40:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:57.678 16:40:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:57.678 16:40:23 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:57.678 16:40:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:58.246 16:40:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:58.246 16:40:23 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:58.246 16:40:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:58.816 16:40:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:58.816 16:40:24 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:58.816 16:40:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:59.384 16:40:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:59.384 16:40:24 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:59.384 16:40:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:59.384 Initializing NVMe Controllers 00:15:59.384 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:59.384 Controller IO queue size 128, less than required. 00:15:59.384 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:59.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:59.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:59.384 Initialization complete. Launching workers. 00:15:59.384 ======================================================== 00:15:59.384 Latency(us) 00:15:59.384 Device Information : IOPS MiB/s Average min max 00:15:59.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004044.46 1000222.56 1011877.79 00:15:59.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004031.71 1000207.80 1011980.88 00:15:59.385 ======================================================== 00:15:59.385 Total : 256.00 0.12 1004038.08 1000207.80 1011980.88 00:15:59.385 00:15:59.644 16:40:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:59.644 16:40:25 -- target/delete_subsystem.sh@57 -- # kill -0 1169610 00:15:59.644 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1169610) - No such process 00:15:59.644 16:40:25 -- target/delete_subsystem.sh@67 -- # wait 1169610 00:15:59.644 16:40:25 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:59.644 16:40:25 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:59.644 16:40:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:59.644 16:40:25 -- nvmf/common.sh@116 -- # sync 00:15:59.644 16:40:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:59.644 16:40:25 -- nvmf/common.sh@119 -- # set +e 00:15:59.644 16:40:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:59.644 16:40:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:59.644 rmmod nvme_tcp 00:15:59.644 rmmod nvme_fabrics 00:15:59.904 rmmod nvme_keyring 00:15:59.904 16:40:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:59.904 16:40:25 -- nvmf/common.sh@123 -- # set -e 00:15:59.904 16:40:25 -- nvmf/common.sh@124 -- # return 0 00:15:59.904 16:40:25 -- nvmf/common.sh@477 -- # '[' -n 1169035 ']' 00:15:59.904 16:40:25 -- nvmf/common.sh@478 -- # killprocess 1169035 00:15:59.904 16:40:25 -- common/autotest_common.sh@926 -- # '[' -z 1169035 ']' 00:15:59.904 16:40:25 -- common/autotest_common.sh@930 -- # kill -0 1169035 00:15:59.904 16:40:25 -- common/autotest_common.sh@931 -- # uname 00:15:59.904 16:40:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:59.904 16:40:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1169035 00:15:59.904 16:40:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:59.904 16:40:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:59.904 16:40:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1169035' 00:15:59.904 killing process with pid 1169035 00:15:59.904 16:40:25 -- common/autotest_common.sh@945 -- # kill 1169035 00:15:59.904 16:40:25 -- common/autotest_common.sh@950 -- # wait 1169035 00:16:00.164 16:40:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.164 16:40:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.164 16:40:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.164 16:40:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.164 16:40:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.164 16:40:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.164 16:40:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.164 16:40:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.074 16:40:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:02.074 00:16:02.074 real 0m12.951s 00:16:02.074 user 0m29.283s 00:16:02.074 sys 0m2.977s 00:16:02.074 16:40:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:02.074 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:02.074 ************************************ 00:16:02.074 END TEST nvmf_delete_subsystem 00:16:02.075 ************************************ 00:16:02.075 16:40:27 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:16:02.075 16:40:27 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:16:02.075 16:40:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:02.075 16:40:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:02.075 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:02.075 ************************************ 00:16:02.075 START TEST nvmf_nvme_cli 00:16:02.075 ************************************ 00:16:02.075 16:40:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:16:02.075 * Looking for test storage... 00:16:02.075 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:02.075 16:40:27 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.075 16:40:27 -- nvmf/common.sh@7 -- # uname -s 00:16:02.075 16:40:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.075 16:40:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.075 16:40:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.075 16:40:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.075 16:40:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.075 16:40:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.075 16:40:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.075 16:40:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.075 16:40:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.075 16:40:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.075 16:40:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.075 16:40:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.075 16:40:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.075 16:40:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.075 16:40:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.075 16:40:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:02.075 16:40:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.075 16:40:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.075 16:40:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.075 16:40:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.075 16:40:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.075 16:40:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.075 16:40:27 -- paths/export.sh@5 -- # export PATH 00:16:02.075 16:40:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.075 16:40:27 -- nvmf/common.sh@46 -- # : 0 00:16:02.075 16:40:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:02.075 16:40:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:02.075 16:40:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:02.075 16:40:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.075 16:40:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.075 16:40:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:02.075 16:40:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:02.075 16:40:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:02.075 16:40:27 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:02.075 16:40:27 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:02.075 16:40:27 -- target/nvme_cli.sh@14 -- # devs=() 00:16:02.075 16:40:27 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:16:02.075 16:40:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:02.075 16:40:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.075 16:40:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:02.075 16:40:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:02.075 16:40:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:02.075 16:40:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.075 16:40:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:02.075 16:40:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.075 16:40:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:02.075 16:40:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:02.075 16:40:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:02.075 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:04.610 16:40:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:04.610 16:40:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:04.610 16:40:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:04.610 16:40:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:04.610 16:40:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:04.610 16:40:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:04.610 16:40:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:04.610 16:40:29 -- nvmf/common.sh@294 -- # net_devs=() 00:16:04.610 16:40:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:04.610 16:40:29 -- nvmf/common.sh@295 -- # e810=() 00:16:04.610 16:40:29 -- nvmf/common.sh@295 -- # local -ga e810 00:16:04.610 16:40:29 -- nvmf/common.sh@296 -- # x722=() 00:16:04.610 16:40:29 -- nvmf/common.sh@296 -- # local -ga x722 00:16:04.610 16:40:29 -- nvmf/common.sh@297 -- # mlx=() 00:16:04.610 16:40:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:04.610 16:40:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:04.610 16:40:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.610 16:40:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:04.610 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:04.610 16:40:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.610 16:40:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:04.610 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:04.610 16:40:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.610 16:40:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.610 16:40:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.610 16:40:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:04.610 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:04.610 16:40:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.610 16:40:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.610 16:40:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.610 16:40:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:04.610 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:04.610 16:40:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:04.610 16:40:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:04.610 16:40:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:04.610 16:40:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:04.610 16:40:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:04.610 16:40:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:04.610 16:40:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:04.610 16:40:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:04.610 16:40:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:04.610 16:40:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:04.610 16:40:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:04.610 16:40:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:04.610 16:40:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:04.610 16:40:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:04.610 16:40:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:04.610 16:40:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:04.610 16:40:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:04.610 16:40:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:04.610 16:40:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:04.610 16:40:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:04.610 16:40:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:04.610 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:04.610 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:16:04.610 00:16:04.610 --- 10.0.0.2 ping statistics --- 00:16:04.610 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.610 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:16:04.610 16:40:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:04.610 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:04.610 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:16:04.610 00:16:04.610 --- 10.0.0.1 ping statistics --- 00:16:04.610 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.610 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:16:04.610 16:40:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:04.610 16:40:29 -- nvmf/common.sh@410 -- # return 0 00:16:04.610 16:40:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:04.610 16:40:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:04.610 16:40:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:04.610 16:40:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:04.610 16:40:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:04.610 16:40:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:04.610 16:40:29 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:16:04.610 16:40:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:04.610 16:40:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:04.610 16:40:29 -- common/autotest_common.sh@10 -- # set +x 00:16:04.610 16:40:29 -- nvmf/common.sh@469 -- # nvmfpid=1171971 00:16:04.610 16:40:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:04.610 16:40:29 -- nvmf/common.sh@470 -- # waitforlisten 1171971 00:16:04.610 16:40:29 -- common/autotest_common.sh@819 -- # '[' -z 1171971 ']' 00:16:04.610 16:40:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.610 16:40:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:04.611 16:40:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.611 16:40:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:04.611 16:40:29 -- common/autotest_common.sh@10 -- # set +x 00:16:04.611 [2024-10-13 16:40:29.784408] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:16:04.611 [2024-10-13 16:40:29.784496] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:04.611 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.611 [2024-10-13 16:40:29.851501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:04.611 [2024-10-13 16:40:29.943979] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:04.611 [2024-10-13 16:40:29.944147] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:04.611 [2024-10-13 16:40:29.944167] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:04.611 [2024-10-13 16:40:29.944181] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:04.611 [2024-10-13 16:40:29.944235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.611 [2024-10-13 16:40:29.944319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:04.611 [2024-10-13 16:40:29.944420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:04.611 [2024-10-13 16:40:29.944424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:05.543 16:40:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:05.543 16:40:30 -- common/autotest_common.sh@852 -- # return 0 00:16:05.543 16:40:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:05.543 16:40:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:05.543 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.543 16:40:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:05.543 16:40:30 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:05.543 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.543 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.543 [2024-10-13 16:40:30.793148] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:05.543 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.543 16:40:30 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 Malloc0 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 Malloc1 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 [2024-10-13 16:40:30.874978] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:05.544 16:40:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.544 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:05.544 16:40:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.544 16:40:30 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:16:05.801 00:16:05.801 Discovery Log Number of Records 2, Generation counter 2 00:16:05.801 =====Discovery Log Entry 0====== 00:16:05.801 trtype: tcp 00:16:05.801 adrfam: ipv4 00:16:05.801 subtype: current discovery subsystem 00:16:05.801 treq: not required 00:16:05.801 portid: 0 00:16:05.801 trsvcid: 4420 00:16:05.801 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:16:05.801 traddr: 10.0.0.2 00:16:05.801 eflags: explicit discovery connections, duplicate discovery information 00:16:05.801 sectype: none 00:16:05.801 =====Discovery Log Entry 1====== 00:16:05.801 trtype: tcp 00:16:05.801 adrfam: ipv4 00:16:05.801 subtype: nvme subsystem 00:16:05.801 treq: not required 00:16:05.801 portid: 0 00:16:05.801 trsvcid: 4420 00:16:05.801 subnqn: nqn.2016-06.io.spdk:cnode1 00:16:05.801 traddr: 10.0.0.2 00:16:05.801 eflags: none 00:16:05.801 sectype: none 00:16:05.801 16:40:31 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:16:05.801 16:40:31 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:16:05.801 16:40:31 -- nvmf/common.sh@510 -- # local dev _ 00:16:05.801 16:40:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:05.801 16:40:31 -- nvmf/common.sh@509 -- # nvme list 00:16:05.801 16:40:31 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:16:05.801 16:40:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:05.801 16:40:31 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:16:05.801 16:40:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:05.801 16:40:31 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:16:05.801 16:40:31 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:06.367 16:40:31 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:16:06.367 16:40:31 -- common/autotest_common.sh@1177 -- # local i=0 00:16:06.367 16:40:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:06.367 16:40:31 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:16:06.367 16:40:31 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:16:06.367 16:40:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:08.264 16:40:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:08.264 16:40:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:08.264 16:40:33 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:08.521 16:40:33 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:16:08.521 16:40:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:08.521 16:40:33 -- common/autotest_common.sh@1187 -- # return 0 00:16:08.521 16:40:33 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:16:08.521 16:40:33 -- nvmf/common.sh@510 -- # local dev _ 00:16:08.521 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.521 16:40:33 -- nvmf/common.sh@509 -- # nvme list 00:16:08.521 16:40:33 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:16:08.521 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.521 16:40:33 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:16:08.521 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.521 16:40:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:16:08.521 16:40:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:16:08.521 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.521 16:40:33 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:16:08.521 16:40:33 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:16:08.521 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.521 16:40:33 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:16:08.521 /dev/nvme0n2 ]] 00:16:08.521 16:40:33 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:16:08.521 16:40:33 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:16:08.521 16:40:33 -- nvmf/common.sh@510 -- # local dev _ 00:16:08.522 16:40:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.522 16:40:33 -- nvmf/common.sh@509 -- # nvme list 00:16:08.779 16:40:34 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:16:08.779 16:40:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.779 16:40:34 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:16:08.779 16:40:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.779 16:40:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:16:08.779 16:40:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:16:08.779 16:40:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.779 16:40:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:16:08.779 16:40:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:16:08.779 16:40:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:16:08.779 16:40:34 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:16:08.779 16:40:34 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:09.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:09.037 16:40:34 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:09.037 16:40:34 -- common/autotest_common.sh@1198 -- # local i=0 00:16:09.037 16:40:34 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:09.037 16:40:34 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:09.037 16:40:34 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:09.037 16:40:34 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:09.037 16:40:34 -- common/autotest_common.sh@1210 -- # return 0 00:16:09.037 16:40:34 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:16:09.037 16:40:34 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:09.037 16:40:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:09.037 16:40:34 -- common/autotest_common.sh@10 -- # set +x 00:16:09.037 16:40:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:09.037 16:40:34 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:16:09.037 16:40:34 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:16:09.037 16:40:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:09.037 16:40:34 -- nvmf/common.sh@116 -- # sync 00:16:09.037 16:40:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:09.037 16:40:34 -- nvmf/common.sh@119 -- # set +e 00:16:09.037 16:40:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:09.037 16:40:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:09.037 rmmod nvme_tcp 00:16:09.037 rmmod nvme_fabrics 00:16:09.037 rmmod nvme_keyring 00:16:09.037 16:40:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:09.037 16:40:34 -- nvmf/common.sh@123 -- # set -e 00:16:09.037 16:40:34 -- nvmf/common.sh@124 -- # return 0 00:16:09.037 16:40:34 -- nvmf/common.sh@477 -- # '[' -n 1171971 ']' 00:16:09.037 16:40:34 -- nvmf/common.sh@478 -- # killprocess 1171971 00:16:09.037 16:40:34 -- common/autotest_common.sh@926 -- # '[' -z 1171971 ']' 00:16:09.037 16:40:34 -- common/autotest_common.sh@930 -- # kill -0 1171971 00:16:09.037 16:40:34 -- common/autotest_common.sh@931 -- # uname 00:16:09.037 16:40:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:09.037 16:40:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1171971 00:16:09.037 16:40:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:09.037 16:40:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:09.037 16:40:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1171971' 00:16:09.037 killing process with pid 1171971 00:16:09.037 16:40:34 -- common/autotest_common.sh@945 -- # kill 1171971 00:16:09.037 16:40:34 -- common/autotest_common.sh@950 -- # wait 1171971 00:16:09.296 16:40:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:09.296 16:40:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:09.296 16:40:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:09.296 16:40:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:09.296 16:40:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:09.296 16:40:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:09.296 16:40:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:09.296 16:40:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:11.866 16:40:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:11.866 00:16:11.866 real 0m9.287s 00:16:11.866 user 0m19.703s 00:16:11.866 sys 0m2.287s 00:16:11.866 16:40:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:11.866 16:40:36 -- common/autotest_common.sh@10 -- # set +x 00:16:11.866 ************************************ 00:16:11.866 END TEST nvmf_nvme_cli 00:16:11.866 ************************************ 00:16:11.866 16:40:36 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:16:11.866 16:40:36 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:16:11.866 16:40:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:11.866 16:40:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:11.866 16:40:36 -- common/autotest_common.sh@10 -- # set +x 00:16:11.866 ************************************ 00:16:11.866 START TEST nvmf_vfio_user 00:16:11.866 ************************************ 00:16:11.866 16:40:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:16:11.866 * Looking for test storage... 00:16:11.866 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:11.866 16:40:36 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:11.866 16:40:36 -- nvmf/common.sh@7 -- # uname -s 00:16:11.866 16:40:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:11.866 16:40:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:11.866 16:40:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:11.866 16:40:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:11.866 16:40:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:11.866 16:40:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:11.866 16:40:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:11.866 16:40:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:11.866 16:40:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:11.866 16:40:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:11.866 16:40:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:11.866 16:40:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:11.866 16:40:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:11.866 16:40:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:11.866 16:40:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:11.866 16:40:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:11.866 16:40:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:11.866 16:40:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:11.867 16:40:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:11.867 16:40:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.867 16:40:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.867 16:40:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.867 16:40:36 -- paths/export.sh@5 -- # export PATH 00:16:11.867 16:40:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.867 16:40:36 -- nvmf/common.sh@46 -- # : 0 00:16:11.867 16:40:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:11.867 16:40:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:11.867 16:40:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:11.867 16:40:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:11.867 16:40:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:11.867 16:40:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:11.867 16:40:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:11.867 16:40:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1172931 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1172931' 00:16:11.867 Process pid: 1172931 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:11.867 16:40:36 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1172931 00:16:11.867 16:40:36 -- common/autotest_common.sh@819 -- # '[' -z 1172931 ']' 00:16:11.867 16:40:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:11.867 16:40:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:11.867 16:40:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:11.867 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:11.867 16:40:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:11.867 16:40:36 -- common/autotest_common.sh@10 -- # set +x 00:16:11.867 [2024-10-13 16:40:36.931336] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:16:11.867 [2024-10-13 16:40:36.931428] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:11.867 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.867 [2024-10-13 16:40:36.996016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:11.867 [2024-10-13 16:40:37.087876] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:11.867 [2024-10-13 16:40:37.088039] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:11.867 [2024-10-13 16:40:37.088057] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:11.867 [2024-10-13 16:40:37.088069] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:11.867 [2024-10-13 16:40:37.088131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:11.867 [2024-10-13 16:40:37.088279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:11.867 [2024-10-13 16:40:37.088210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:11.867 [2024-10-13 16:40:37.088277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:12.799 16:40:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:12.799 16:40:37 -- common/autotest_common.sh@852 -- # return 0 00:16:12.799 16:40:37 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:13.732 16:40:38 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:16:13.732 16:40:39 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:13.732 16:40:39 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:13.732 16:40:39 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:13.732 16:40:39 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:13.732 16:40:39 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:14.297 Malloc1 00:16:14.297 16:40:39 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:14.297 16:40:39 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:14.555 16:40:40 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:14.812 16:40:40 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:14.812 16:40:40 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:14.812 16:40:40 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:15.378 Malloc2 00:16:15.378 16:40:40 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:15.378 16:40:40 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:15.635 16:40:41 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:16:15.893 16:40:41 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:15.893 [2024-10-13 16:40:41.359619] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:16:15.893 [2024-10-13 16:40:41.359658] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1173502 ] 00:16:15.893 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.893 [2024-10-13 16:40:41.389983] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:16:16.153 [2024-10-13 16:40:41.394525] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:16.153 [2024-10-13 16:40:41.394554] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f6a9c903000 00:16:16.153 [2024-10-13 16:40:41.395530] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.396517] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.397521] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.398528] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.399533] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.400543] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.401547] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.402554] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:16.153 [2024-10-13 16:40:41.403560] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:16.153 [2024-10-13 16:40:41.403581] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f6a9adf5000 00:16:16.153 [2024-10-13 16:40:41.404746] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:16.153 [2024-10-13 16:40:41.421043] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:16:16.153 [2024-10-13 16:40:41.421079] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:16:16.153 [2024-10-13 16:40:41.425723] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:16:16.153 [2024-10-13 16:40:41.425791] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:16.153 [2024-10-13 16:40:41.425877] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:16:16.153 [2024-10-13 16:40:41.425907] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:16:16.153 [2024-10-13 16:40:41.425925] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:16:16.153 [2024-10-13 16:40:41.426690] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:16:16.153 [2024-10-13 16:40:41.426712] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:16:16.153 [2024-10-13 16:40:41.426739] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:16:16.153 [2024-10-13 16:40:41.427690] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:16:16.153 [2024-10-13 16:40:41.427722] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:16:16.153 [2024-10-13 16:40:41.427735] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.428708] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:16:16.153 [2024-10-13 16:40:41.428725] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.429711] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:16:16.153 [2024-10-13 16:40:41.429730] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:16:16.153 [2024-10-13 16:40:41.429739] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.429750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.429858] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:16:16.153 [2024-10-13 16:40:41.429865] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.429873] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:16:16.153 [2024-10-13 16:40:41.430722] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:16:16.153 [2024-10-13 16:40:41.431710] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:16:16.153 [2024-10-13 16:40:41.432710] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:16:16.153 [2024-10-13 16:40:41.433760] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:16.153 [2024-10-13 16:40:41.434728] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:16:16.153 [2024-10-13 16:40:41.434745] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:16.153 [2024-10-13 16:40:41.434754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:16:16.153 [2024-10-13 16:40:41.434777] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:16:16.153 [2024-10-13 16:40:41.434794] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:16:16.153 [2024-10-13 16:40:41.434815] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:16.153 [2024-10-13 16:40:41.434824] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:16.153 [2024-10-13 16:40:41.434843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:16.153 [2024-10-13 16:40:41.434930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:16.153 [2024-10-13 16:40:41.434945] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:16:16.153 [2024-10-13 16:40:41.434953] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:16:16.153 [2024-10-13 16:40:41.434960] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:16:16.153 [2024-10-13 16:40:41.434967] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:16.153 [2024-10-13 16:40:41.434974] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:16:16.153 [2024-10-13 16:40:41.434981] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:16:16.153 [2024-10-13 16:40:41.434988] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435003] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435019] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:16.154 [2024-10-13 16:40:41.435071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:16.154 [2024-10-13 16:40:41.435082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:16.154 [2024-10-13 16:40:41.435094] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:16.154 [2024-10-13 16:40:41.435102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435116] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435129] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435151] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:16:16.154 [2024-10-13 16:40:41.435158] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435175] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435189] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435202] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435274] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435287] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435299] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:16.154 [2024-10-13 16:40:41.435307] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:16.154 [2024-10-13 16:40:41.435316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435353] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:16:16.154 [2024-10-13 16:40:41.435368] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435405] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435420] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:16.154 [2024-10-13 16:40:41.435428] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:16.154 [2024-10-13 16:40:41.435438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435484] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435499] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435510] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:16.154 [2024-10-13 16:40:41.435519] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:16.154 [2024-10-13 16:40:41.435528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435556] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435567] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435594] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435603] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435611] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:16:16.154 [2024-10-13 16:40:41.435619] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:16:16.154 [2024-10-13 16:40:41.435627] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:16:16.154 [2024-10-13 16:40:41.435653] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435705] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435734] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435779] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435810] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:16.154 [2024-10-13 16:40:41.435819] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:16.154 [2024-10-13 16:40:41.435824] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:16.154 [2024-10-13 16:40:41.435830] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:16.154 [2024-10-13 16:40:41.435839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:16.154 [2024-10-13 16:40:41.435850] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:16.154 [2024-10-13 16:40:41.435857] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:16.154 [2024-10-13 16:40:41.435866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435877] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:16.154 [2024-10-13 16:40:41.435884] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:16.154 [2024-10-13 16:40:41.435892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435904] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:16.154 [2024-10-13 16:40:41.435911] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:16.154 [2024-10-13 16:40:41.435919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:16.154 [2024-10-13 16:40:41.435934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:16.154 [2024-10-13 16:40:41.435983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:16.154 ===================================================== 00:16:16.154 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:16.154 ===================================================== 00:16:16.154 Controller Capabilities/Features 00:16:16.154 ================================ 00:16:16.154 Vendor ID: 4e58 00:16:16.154 Subsystem Vendor ID: 4e58 00:16:16.154 Serial Number: SPDK1 00:16:16.154 Model Number: SPDK bdev Controller 00:16:16.154 Firmware Version: 24.01.1 00:16:16.154 Recommended Arb Burst: 6 00:16:16.154 IEEE OUI Identifier: 8d 6b 50 00:16:16.154 Multi-path I/O 00:16:16.154 May have multiple subsystem ports: Yes 00:16:16.154 May have multiple controllers: Yes 00:16:16.154 Associated with SR-IOV VF: No 00:16:16.154 Max Data Transfer Size: 131072 00:16:16.154 Max Number of Namespaces: 32 00:16:16.154 Max Number of I/O Queues: 127 00:16:16.154 NVMe Specification Version (VS): 1.3 00:16:16.154 NVMe Specification Version (Identify): 1.3 00:16:16.154 Maximum Queue Entries: 256 00:16:16.154 Contiguous Queues Required: Yes 00:16:16.154 Arbitration Mechanisms Supported 00:16:16.154 Weighted Round Robin: Not Supported 00:16:16.154 Vendor Specific: Not Supported 00:16:16.154 Reset Timeout: 15000 ms 00:16:16.154 Doorbell Stride: 4 bytes 00:16:16.154 NVM Subsystem Reset: Not Supported 00:16:16.154 Command Sets Supported 00:16:16.154 NVM Command Set: Supported 00:16:16.154 Boot Partition: Not Supported 00:16:16.154 Memory Page Size Minimum: 4096 bytes 00:16:16.154 Memory Page Size Maximum: 4096 bytes 00:16:16.154 Persistent Memory Region: Not Supported 00:16:16.154 Optional Asynchronous Events Supported 00:16:16.154 Namespace Attribute Notices: Supported 00:16:16.154 Firmware Activation Notices: Not Supported 00:16:16.154 ANA Change Notices: Not Supported 00:16:16.154 PLE Aggregate Log Change Notices: Not Supported 00:16:16.155 LBA Status Info Alert Notices: Not Supported 00:16:16.155 EGE Aggregate Log Change Notices: Not Supported 00:16:16.155 Normal NVM Subsystem Shutdown event: Not Supported 00:16:16.155 Zone Descriptor Change Notices: Not Supported 00:16:16.155 Discovery Log Change Notices: Not Supported 00:16:16.155 Controller Attributes 00:16:16.155 128-bit Host Identifier: Supported 00:16:16.155 Non-Operational Permissive Mode: Not Supported 00:16:16.155 NVM Sets: Not Supported 00:16:16.155 Read Recovery Levels: Not Supported 00:16:16.155 Endurance Groups: Not Supported 00:16:16.155 Predictable Latency Mode: Not Supported 00:16:16.155 Traffic Based Keep ALive: Not Supported 00:16:16.155 Namespace Granularity: Not Supported 00:16:16.155 SQ Associations: Not Supported 00:16:16.155 UUID List: Not Supported 00:16:16.155 Multi-Domain Subsystem: Not Supported 00:16:16.155 Fixed Capacity Management: Not Supported 00:16:16.155 Variable Capacity Management: Not Supported 00:16:16.155 Delete Endurance Group: Not Supported 00:16:16.155 Delete NVM Set: Not Supported 00:16:16.155 Extended LBA Formats Supported: Not Supported 00:16:16.155 Flexible Data Placement Supported: Not Supported 00:16:16.155 00:16:16.155 Controller Memory Buffer Support 00:16:16.155 ================================ 00:16:16.155 Supported: No 00:16:16.155 00:16:16.155 Persistent Memory Region Support 00:16:16.155 ================================ 00:16:16.155 Supported: No 00:16:16.155 00:16:16.155 Admin Command Set Attributes 00:16:16.155 ============================ 00:16:16.155 Security Send/Receive: Not Supported 00:16:16.155 Format NVM: Not Supported 00:16:16.155 Firmware Activate/Download: Not Supported 00:16:16.155 Namespace Management: Not Supported 00:16:16.155 Device Self-Test: Not Supported 00:16:16.155 Directives: Not Supported 00:16:16.155 NVMe-MI: Not Supported 00:16:16.155 Virtualization Management: Not Supported 00:16:16.155 Doorbell Buffer Config: Not Supported 00:16:16.155 Get LBA Status Capability: Not Supported 00:16:16.155 Command & Feature Lockdown Capability: Not Supported 00:16:16.155 Abort Command Limit: 4 00:16:16.155 Async Event Request Limit: 4 00:16:16.155 Number of Firmware Slots: N/A 00:16:16.155 Firmware Slot 1 Read-Only: N/A 00:16:16.155 Firmware Activation Without Reset: N/A 00:16:16.155 Multiple Update Detection Support: N/A 00:16:16.155 Firmware Update Granularity: No Information Provided 00:16:16.155 Per-Namespace SMART Log: No 00:16:16.155 Asymmetric Namespace Access Log Page: Not Supported 00:16:16.155 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:16:16.155 Command Effects Log Page: Supported 00:16:16.155 Get Log Page Extended Data: Supported 00:16:16.155 Telemetry Log Pages: Not Supported 00:16:16.155 Persistent Event Log Pages: Not Supported 00:16:16.155 Supported Log Pages Log Page: May Support 00:16:16.155 Commands Supported & Effects Log Page: Not Supported 00:16:16.155 Feature Identifiers & Effects Log Page:May Support 00:16:16.155 NVMe-MI Commands & Effects Log Page: May Support 00:16:16.155 Data Area 4 for Telemetry Log: Not Supported 00:16:16.155 Error Log Page Entries Supported: 128 00:16:16.155 Keep Alive: Supported 00:16:16.155 Keep Alive Granularity: 10000 ms 00:16:16.155 00:16:16.155 NVM Command Set Attributes 00:16:16.155 ========================== 00:16:16.155 Submission Queue Entry Size 00:16:16.155 Max: 64 00:16:16.155 Min: 64 00:16:16.155 Completion Queue Entry Size 00:16:16.155 Max: 16 00:16:16.155 Min: 16 00:16:16.155 Number of Namespaces: 32 00:16:16.155 Compare Command: Supported 00:16:16.155 Write Uncorrectable Command: Not Supported 00:16:16.155 Dataset Management Command: Supported 00:16:16.155 Write Zeroes Command: Supported 00:16:16.155 Set Features Save Field: Not Supported 00:16:16.155 Reservations: Not Supported 00:16:16.155 Timestamp: Not Supported 00:16:16.155 Copy: Supported 00:16:16.155 Volatile Write Cache: Present 00:16:16.155 Atomic Write Unit (Normal): 1 00:16:16.155 Atomic Write Unit (PFail): 1 00:16:16.155 Atomic Compare & Write Unit: 1 00:16:16.155 Fused Compare & Write: Supported 00:16:16.155 Scatter-Gather List 00:16:16.155 SGL Command Set: Supported (Dword aligned) 00:16:16.155 SGL Keyed: Not Supported 00:16:16.155 SGL Bit Bucket Descriptor: Not Supported 00:16:16.155 SGL Metadata Pointer: Not Supported 00:16:16.155 Oversized SGL: Not Supported 00:16:16.155 SGL Metadata Address: Not Supported 00:16:16.155 SGL Offset: Not Supported 00:16:16.155 Transport SGL Data Block: Not Supported 00:16:16.155 Replay Protected Memory Block: Not Supported 00:16:16.155 00:16:16.155 Firmware Slot Information 00:16:16.155 ========================= 00:16:16.155 Active slot: 1 00:16:16.155 Slot 1 Firmware Revision: 24.01.1 00:16:16.155 00:16:16.155 00:16:16.155 Commands Supported and Effects 00:16:16.155 ============================== 00:16:16.155 Admin Commands 00:16:16.155 -------------- 00:16:16.155 Get Log Page (02h): Supported 00:16:16.155 Identify (06h): Supported 00:16:16.155 Abort (08h): Supported 00:16:16.155 Set Features (09h): Supported 00:16:16.155 Get Features (0Ah): Supported 00:16:16.155 Asynchronous Event Request (0Ch): Supported 00:16:16.155 Keep Alive (18h): Supported 00:16:16.155 I/O Commands 00:16:16.155 ------------ 00:16:16.155 Flush (00h): Supported LBA-Change 00:16:16.155 Write (01h): Supported LBA-Change 00:16:16.155 Read (02h): Supported 00:16:16.155 Compare (05h): Supported 00:16:16.155 Write Zeroes (08h): Supported LBA-Change 00:16:16.155 Dataset Management (09h): Supported LBA-Change 00:16:16.155 Copy (19h): Supported LBA-Change 00:16:16.155 Unknown (79h): Supported LBA-Change 00:16:16.155 Unknown (7Ah): Supported 00:16:16.155 00:16:16.155 Error Log 00:16:16.155 ========= 00:16:16.155 00:16:16.155 Arbitration 00:16:16.155 =========== 00:16:16.155 Arbitration Burst: 1 00:16:16.155 00:16:16.155 Power Management 00:16:16.155 ================ 00:16:16.155 Number of Power States: 1 00:16:16.155 Current Power State: Power State #0 00:16:16.155 Power State #0: 00:16:16.155 Max Power: 0.00 W 00:16:16.155 Non-Operational State: Operational 00:16:16.155 Entry Latency: Not Reported 00:16:16.155 Exit Latency: Not Reported 00:16:16.155 Relative Read Throughput: 0 00:16:16.155 Relative Read Latency: 0 00:16:16.155 Relative Write Throughput: 0 00:16:16.155 Relative Write Latency: 0 00:16:16.155 Idle Power: Not Reported 00:16:16.155 Active Power: Not Reported 00:16:16.155 Non-Operational Permissive Mode: Not Supported 00:16:16.155 00:16:16.155 Health Information 00:16:16.155 ================== 00:16:16.155 Critical Warnings: 00:16:16.155 Available Spare Space: OK 00:16:16.155 Temperature: OK 00:16:16.155 Device Reliability: OK 00:16:16.155 Read Only: No 00:16:16.155 Volatile Memory Backup: OK 00:16:16.155 Current Temperature: 0 Kelvin[2024-10-13 16:40:41.436104] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:16.155 [2024-10-13 16:40:41.436120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:16.155 [2024-10-13 16:40:41.436155] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:16:16.155 [2024-10-13 16:40:41.436172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:16.155 [2024-10-13 16:40:41.436183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:16.155 [2024-10-13 16:40:41.436192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:16.155 [2024-10-13 16:40:41.436202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:16.155 [2024-10-13 16:40:41.437406] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:16:16.155 [2024-10-13 16:40:41.437428] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:16:16.155 [2024-10-13 16:40:41.437805] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:16:16.155 [2024-10-13 16:40:41.437817] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:16:16.155 [2024-10-13 16:40:41.438773] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:16:16.155 [2024-10-13 16:40:41.438793] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:16:16.155 [2024-10-13 16:40:41.438846] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:16:16.155 [2024-10-13 16:40:41.442404] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:16.155 (-273 Celsius) 00:16:16.155 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:16.155 Available Spare: 0% 00:16:16.155 Available Spare Threshold: 0% 00:16:16.155 Life Percentage Used: 0% 00:16:16.155 Data Units Read: 0 00:16:16.155 Data Units Written: 0 00:16:16.155 Host Read Commands: 0 00:16:16.155 Host Write Commands: 0 00:16:16.155 Controller Busy Time: 0 minutes 00:16:16.155 Power Cycles: 0 00:16:16.155 Power On Hours: 0 hours 00:16:16.155 Unsafe Shutdowns: 0 00:16:16.155 Unrecoverable Media Errors: 0 00:16:16.155 Lifetime Error Log Entries: 0 00:16:16.155 Warning Temperature Time: 0 minutes 00:16:16.155 Critical Temperature Time: 0 minutes 00:16:16.155 00:16:16.155 Number of Queues 00:16:16.156 ================ 00:16:16.156 Number of I/O Submission Queues: 127 00:16:16.156 Number of I/O Completion Queues: 127 00:16:16.156 00:16:16.156 Active Namespaces 00:16:16.156 ================= 00:16:16.156 Namespace ID:1 00:16:16.156 Error Recovery Timeout: Unlimited 00:16:16.156 Command Set Identifier: NVM (00h) 00:16:16.156 Deallocate: Supported 00:16:16.156 Deallocated/Unwritten Error: Not Supported 00:16:16.156 Deallocated Read Value: Unknown 00:16:16.156 Deallocate in Write Zeroes: Not Supported 00:16:16.156 Deallocated Guard Field: 0xFFFF 00:16:16.156 Flush: Supported 00:16:16.156 Reservation: Supported 00:16:16.156 Namespace Sharing Capabilities: Multiple Controllers 00:16:16.156 Size (in LBAs): 131072 (0GiB) 00:16:16.156 Capacity (in LBAs): 131072 (0GiB) 00:16:16.156 Utilization (in LBAs): 131072 (0GiB) 00:16:16.156 NGUID: 771AE7C0AE894163A87695A5F003C563 00:16:16.156 UUID: 771ae7c0-ae89-4163-a876-95a5f003c563 00:16:16.156 Thin Provisioning: Not Supported 00:16:16.156 Per-NS Atomic Units: Yes 00:16:16.156 Atomic Boundary Size (Normal): 0 00:16:16.156 Atomic Boundary Size (PFail): 0 00:16:16.156 Atomic Boundary Offset: 0 00:16:16.156 Maximum Single Source Range Length: 65535 00:16:16.156 Maximum Copy Length: 65535 00:16:16.156 Maximum Source Range Count: 1 00:16:16.156 NGUID/EUI64 Never Reused: No 00:16:16.156 Namespace Write Protected: No 00:16:16.156 Number of LBA Formats: 1 00:16:16.156 Current LBA Format: LBA Format #00 00:16:16.156 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:16.156 00:16:16.156 16:40:41 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:16.156 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.419 Initializing NVMe Controllers 00:16:21.419 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:21.419 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:16:21.419 Initialization complete. Launching workers. 00:16:21.419 ======================================================== 00:16:21.420 Latency(us) 00:16:21.420 Device Information : IOPS MiB/s Average min max 00:16:21.420 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37661.00 147.11 3399.46 1141.94 7385.35 00:16:21.420 ======================================================== 00:16:21.420 Total : 37661.00 147.11 3399.46 1141.94 7385.35 00:16:21.420 00:16:21.420 16:40:46 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:21.420 EAL: No free 2048 kB hugepages reported on node 1 00:16:26.681 Initializing NVMe Controllers 00:16:26.681 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:26.681 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:16:26.681 Initialization complete. Launching workers. 00:16:26.681 ======================================================== 00:16:26.681 Latency(us) 00:16:26.681 Device Information : IOPS MiB/s Average min max 00:16:26.681 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16059.96 62.73 7975.39 5964.43 15130.20 00:16:26.681 ======================================================== 00:16:26.681 Total : 16059.96 62.73 7975.39 5964.43 15130.20 00:16:26.681 00:16:26.681 16:40:52 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:26.681 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.944 Initializing NVMe Controllers 00:16:31.944 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:31.944 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:31.944 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:16:31.944 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:16:31.944 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:16:31.944 Initialization complete. Launching workers. 00:16:31.944 Starting thread on core 2 00:16:31.944 Starting thread on core 3 00:16:31.944 Starting thread on core 1 00:16:31.944 16:40:57 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:16:31.944 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.224 Initializing NVMe Controllers 00:16:35.225 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:35.225 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:35.225 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:16:35.225 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:16:35.225 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:16:35.225 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:16:35.225 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:35.225 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:35.225 Initialization complete. Launching workers. 00:16:35.225 Starting thread on core 1 with urgent priority queue 00:16:35.225 Starting thread on core 2 with urgent priority queue 00:16:35.225 Starting thread on core 3 with urgent priority queue 00:16:35.225 Starting thread on core 0 with urgent priority queue 00:16:35.225 SPDK bdev Controller (SPDK1 ) core 0: 4854.33 IO/s 20.60 secs/100000 ios 00:16:35.225 SPDK bdev Controller (SPDK1 ) core 1: 4944.00 IO/s 20.23 secs/100000 ios 00:16:35.225 SPDK bdev Controller (SPDK1 ) core 2: 5233.67 IO/s 19.11 secs/100000 ios 00:16:35.225 SPDK bdev Controller (SPDK1 ) core 3: 5256.67 IO/s 19.02 secs/100000 ios 00:16:35.225 ======================================================== 00:16:35.225 00:16:35.225 16:41:00 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:35.225 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.790 Initializing NVMe Controllers 00:16:35.790 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:35.790 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:35.790 Namespace ID: 1 size: 0GB 00:16:35.790 Initialization complete. 00:16:35.790 INFO: using host memory buffer for IO 00:16:35.790 Hello world! 00:16:35.790 16:41:01 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:35.790 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.163 Initializing NVMe Controllers 00:16:37.163 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:37.163 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:37.163 Initialization complete. Launching workers. 00:16:37.163 submit (in ns) avg, min, max = 7083.3, 3462.2, 4013632.2 00:16:37.163 complete (in ns) avg, min, max = 23893.2, 2034.4, 6991558.9 00:16:37.163 00:16:37.163 Submit histogram 00:16:37.163 ================ 00:16:37.163 Range in us Cumulative Count 00:16:37.163 3.461 - 3.484: 0.2305% ( 32) 00:16:37.163 3.484 - 3.508: 0.9366% ( 98) 00:16:37.163 3.508 - 3.532: 3.3285% ( 332) 00:16:37.163 3.532 - 3.556: 7.7378% ( 612) 00:16:37.163 3.556 - 3.579: 15.8573% ( 1127) 00:16:37.163 3.579 - 3.603: 24.5101% ( 1201) 00:16:37.163 3.603 - 3.627: 34.3228% ( 1362) 00:16:37.163 3.627 - 3.650: 42.9467% ( 1197) 00:16:37.163 3.650 - 3.674: 50.0072% ( 980) 00:16:37.163 3.674 - 3.698: 55.5259% ( 766) 00:16:37.163 3.698 - 3.721: 60.1945% ( 648) 00:16:37.163 3.721 - 3.745: 63.3357% ( 436) 00:16:37.163 3.745 - 3.769: 66.3689% ( 421) 00:16:37.163 3.769 - 3.793: 70.0576% ( 512) 00:16:37.163 3.793 - 3.816: 73.4582% ( 472) 00:16:37.163 3.816 - 3.840: 77.5865% ( 573) 00:16:37.163 3.840 - 3.864: 81.6210% ( 560) 00:16:37.163 3.864 - 3.887: 84.6254% ( 417) 00:16:37.163 3.887 - 3.911: 87.1037% ( 344) 00:16:37.163 3.911 - 3.935: 88.9049% ( 250) 00:16:37.163 3.935 - 3.959: 90.3458% ( 200) 00:16:37.163 3.959 - 3.982: 91.4697% ( 156) 00:16:37.163 3.982 - 4.006: 92.3847% ( 127) 00:16:37.163 4.006 - 4.030: 93.2061% ( 114) 00:16:37.163 4.030 - 4.053: 94.0346% ( 115) 00:16:37.163 4.053 - 4.077: 94.7478% ( 99) 00:16:37.163 4.077 - 4.101: 95.3242% ( 80) 00:16:37.163 4.101 - 4.124: 95.6916% ( 51) 00:16:37.163 4.124 - 4.148: 95.9438% ( 35) 00:16:37.164 4.148 - 4.172: 96.1527% ( 29) 00:16:37.164 4.172 - 4.196: 96.3112% ( 22) 00:16:37.164 4.196 - 4.219: 96.4193% ( 15) 00:16:37.164 4.219 - 4.243: 96.5994% ( 25) 00:16:37.164 4.243 - 4.267: 96.6859% ( 12) 00:16:37.164 4.267 - 4.290: 96.7579% ( 10) 00:16:37.164 4.290 - 4.314: 96.8804% ( 17) 00:16:37.164 4.314 - 4.338: 96.9380% ( 8) 00:16:37.164 4.338 - 4.361: 96.9813% ( 6) 00:16:37.164 4.361 - 4.385: 97.0101% ( 4) 00:16:37.164 4.385 - 4.409: 97.0605% ( 7) 00:16:37.164 4.409 - 4.433: 97.1398% ( 11) 00:16:37.164 4.433 - 4.456: 97.1470% ( 1) 00:16:37.164 4.456 - 4.480: 97.1686% ( 3) 00:16:37.164 4.480 - 4.504: 97.1758% ( 1) 00:16:37.164 4.504 - 4.527: 97.1974% ( 3) 00:16:37.164 4.551 - 4.575: 97.2046% ( 1) 00:16:37.164 4.575 - 4.599: 97.2190% ( 2) 00:16:37.164 4.599 - 4.622: 97.2406% ( 3) 00:16:37.164 4.622 - 4.646: 97.2478% ( 1) 00:16:37.164 4.670 - 4.693: 97.2767% ( 4) 00:16:37.164 4.693 - 4.717: 97.2911% ( 2) 00:16:37.164 4.717 - 4.741: 97.3127% ( 3) 00:16:37.164 4.741 - 4.764: 97.3415% ( 4) 00:16:37.164 4.764 - 4.788: 97.3631% ( 3) 00:16:37.164 4.788 - 4.812: 97.3991% ( 5) 00:16:37.164 4.812 - 4.836: 97.4640% ( 9) 00:16:37.164 4.836 - 4.859: 97.5288% ( 9) 00:16:37.164 4.859 - 4.883: 97.5720% ( 6) 00:16:37.164 4.883 - 4.907: 97.6225% ( 7) 00:16:37.164 4.907 - 4.930: 97.6729% ( 7) 00:16:37.164 4.930 - 4.954: 97.7089% ( 5) 00:16:37.164 4.954 - 4.978: 97.7378% ( 4) 00:16:37.164 4.978 - 5.001: 97.7666% ( 4) 00:16:37.164 5.001 - 5.025: 97.8026% ( 5) 00:16:37.164 5.025 - 5.049: 97.8386% ( 5) 00:16:37.164 5.049 - 5.073: 97.8746% ( 5) 00:16:37.164 5.073 - 5.096: 97.9035% ( 4) 00:16:37.164 5.096 - 5.120: 97.9107% ( 1) 00:16:37.164 5.120 - 5.144: 97.9251% ( 2) 00:16:37.164 5.144 - 5.167: 97.9467% ( 3) 00:16:37.164 5.167 - 5.191: 97.9611% ( 2) 00:16:37.164 5.191 - 5.215: 97.9755% ( 2) 00:16:37.164 5.239 - 5.262: 98.0043% ( 4) 00:16:37.164 5.262 - 5.286: 98.0259% ( 3) 00:16:37.164 5.286 - 5.310: 98.0331% ( 1) 00:16:37.164 5.310 - 5.333: 98.0403% ( 1) 00:16:37.164 5.333 - 5.357: 98.0476% ( 1) 00:16:37.164 5.357 - 5.381: 98.0548% ( 1) 00:16:37.164 5.570 - 5.594: 98.0620% ( 1) 00:16:37.164 5.594 - 5.618: 98.0692% ( 1) 00:16:37.164 5.736 - 5.760: 98.0764% ( 1) 00:16:37.164 5.902 - 5.926: 98.0836% ( 1) 00:16:37.164 5.950 - 5.973: 98.0980% ( 2) 00:16:37.164 6.116 - 6.163: 98.1052% ( 1) 00:16:37.164 6.447 - 6.495: 98.1124% ( 1) 00:16:37.164 6.495 - 6.542: 98.1268% ( 2) 00:16:37.164 6.684 - 6.732: 98.1484% ( 3) 00:16:37.164 6.827 - 6.874: 98.1556% ( 1) 00:16:37.164 7.016 - 7.064: 98.1700% ( 2) 00:16:37.164 7.064 - 7.111: 98.1916% ( 3) 00:16:37.164 7.111 - 7.159: 98.1988% ( 1) 00:16:37.164 7.253 - 7.301: 98.2133% ( 2) 00:16:37.164 7.348 - 7.396: 98.2277% ( 2) 00:16:37.164 7.396 - 7.443: 98.2349% ( 1) 00:16:37.164 7.443 - 7.490: 98.2421% ( 1) 00:16:37.164 7.490 - 7.538: 98.2637% ( 3) 00:16:37.164 7.538 - 7.585: 98.2709% ( 1) 00:16:37.164 7.585 - 7.633: 98.2853% ( 2) 00:16:37.164 7.727 - 7.775: 98.2925% ( 1) 00:16:37.164 7.822 - 7.870: 98.3069% ( 2) 00:16:37.164 7.870 - 7.917: 98.3141% ( 1) 00:16:37.164 7.917 - 7.964: 98.3285% ( 2) 00:16:37.164 7.964 - 8.012: 98.3501% ( 3) 00:16:37.164 8.059 - 8.107: 98.3646% ( 2) 00:16:37.164 8.107 - 8.154: 98.3718% ( 1) 00:16:37.164 8.154 - 8.201: 98.3790% ( 1) 00:16:37.164 8.249 - 8.296: 98.3934% ( 2) 00:16:37.164 8.296 - 8.344: 98.4006% ( 1) 00:16:37.164 8.344 - 8.391: 98.4222% ( 3) 00:16:37.164 8.486 - 8.533: 98.4438% ( 3) 00:16:37.164 8.533 - 8.581: 98.4654% ( 3) 00:16:37.164 8.581 - 8.628: 98.4726% ( 1) 00:16:37.164 8.628 - 8.676: 98.4870% ( 2) 00:16:37.164 8.676 - 8.723: 98.4942% ( 1) 00:16:37.164 8.723 - 8.770: 98.5086% ( 2) 00:16:37.164 8.818 - 8.865: 98.5159% ( 1) 00:16:37.164 8.865 - 8.913: 98.5303% ( 2) 00:16:37.164 9.007 - 9.055: 98.5447% ( 2) 00:16:37.164 9.102 - 9.150: 98.5519% ( 1) 00:16:37.164 9.197 - 9.244: 98.5663% ( 2) 00:16:37.164 9.387 - 9.434: 98.5735% ( 1) 00:16:37.164 9.481 - 9.529: 98.5807% ( 1) 00:16:37.164 9.529 - 9.576: 98.5879% ( 1) 00:16:37.164 9.576 - 9.624: 98.6023% ( 2) 00:16:37.164 9.671 - 9.719: 98.6167% ( 2) 00:16:37.164 9.766 - 9.813: 98.6311% ( 2) 00:16:37.164 9.813 - 9.861: 98.6383% ( 1) 00:16:37.164 9.861 - 9.908: 98.6527% ( 2) 00:16:37.164 9.956 - 10.003: 98.6599% ( 1) 00:16:37.164 10.050 - 10.098: 98.6671% ( 1) 00:16:37.164 10.098 - 10.145: 98.6744% ( 1) 00:16:37.164 10.193 - 10.240: 98.6816% ( 1) 00:16:37.164 10.240 - 10.287: 98.6888% ( 1) 00:16:37.164 10.287 - 10.335: 98.6960% ( 1) 00:16:37.164 10.477 - 10.524: 98.7104% ( 2) 00:16:37.164 10.572 - 10.619: 98.7248% ( 2) 00:16:37.164 10.714 - 10.761: 98.7320% ( 1) 00:16:37.164 10.761 - 10.809: 98.7392% ( 1) 00:16:37.164 10.904 - 10.951: 98.7464% ( 1) 00:16:37.164 10.951 - 10.999: 98.7536% ( 1) 00:16:37.164 10.999 - 11.046: 98.7608% ( 1) 00:16:37.164 11.093 - 11.141: 98.7680% ( 1) 00:16:37.164 11.141 - 11.188: 98.7824% ( 2) 00:16:37.164 11.236 - 11.283: 98.8040% ( 3) 00:16:37.164 11.330 - 11.378: 98.8112% ( 1) 00:16:37.164 11.567 - 11.615: 98.8184% ( 1) 00:16:37.164 11.615 - 11.662: 98.8256% ( 1) 00:16:37.164 11.710 - 11.757: 98.8329% ( 1) 00:16:37.164 11.994 - 12.041: 98.8401% ( 1) 00:16:37.164 12.041 - 12.089: 98.8473% ( 1) 00:16:37.164 12.089 - 12.136: 98.8545% ( 1) 00:16:37.164 12.610 - 12.705: 98.8617% ( 1) 00:16:37.164 12.800 - 12.895: 98.8689% ( 1) 00:16:37.164 12.895 - 12.990: 98.8833% ( 2) 00:16:37.164 12.990 - 13.084: 98.8905% ( 1) 00:16:37.164 13.179 - 13.274: 98.9049% ( 2) 00:16:37.164 13.369 - 13.464: 98.9121% ( 1) 00:16:37.164 13.559 - 13.653: 98.9193% ( 1) 00:16:37.164 13.653 - 13.748: 98.9265% ( 1) 00:16:37.164 13.748 - 13.843: 98.9337% ( 1) 00:16:37.164 13.843 - 13.938: 98.9409% ( 1) 00:16:37.164 13.938 - 14.033: 98.9481% ( 1) 00:16:37.164 14.033 - 14.127: 98.9553% ( 1) 00:16:37.164 14.127 - 14.222: 98.9625% ( 1) 00:16:37.164 14.222 - 14.317: 98.9697% ( 1) 00:16:37.164 14.317 - 14.412: 98.9769% ( 1) 00:16:37.164 14.507 - 14.601: 98.9841% ( 1) 00:16:37.164 14.601 - 14.696: 98.9914% ( 1) 00:16:37.164 15.076 - 15.170: 98.9986% ( 1) 00:16:37.164 15.170 - 15.265: 99.0202% ( 3) 00:16:37.164 15.265 - 15.360: 99.0346% ( 2) 00:16:37.164 17.067 - 17.161: 99.0418% ( 1) 00:16:37.164 17.161 - 17.256: 99.0562% ( 2) 00:16:37.164 17.256 - 17.351: 99.0922% ( 5) 00:16:37.164 17.446 - 17.541: 99.1138% ( 3) 00:16:37.164 17.541 - 17.636: 99.1499% ( 5) 00:16:37.164 17.636 - 17.730: 99.2003% ( 7) 00:16:37.164 17.730 - 17.825: 99.2075% ( 1) 00:16:37.164 17.825 - 17.920: 99.2435% ( 5) 00:16:37.164 17.920 - 18.015: 99.3084% ( 9) 00:16:37.164 18.015 - 18.110: 99.3588% ( 7) 00:16:37.164 18.110 - 18.204: 99.4380% ( 11) 00:16:37.164 18.204 - 18.299: 99.5317% ( 13) 00:16:37.164 18.299 - 18.394: 99.6037% ( 10) 00:16:37.164 18.394 - 18.489: 99.7046% ( 14) 00:16:37.164 18.489 - 18.584: 99.7406% ( 5) 00:16:37.164 18.584 - 18.679: 99.7839% ( 6) 00:16:37.164 18.679 - 18.773: 99.8055% ( 3) 00:16:37.164 18.773 - 18.868: 99.8127% ( 1) 00:16:37.164 18.868 - 18.963: 99.8271% ( 2) 00:16:37.164 18.963 - 19.058: 99.8487% ( 3) 00:16:37.164 19.058 - 19.153: 99.8631% ( 2) 00:16:37.164 19.247 - 19.342: 99.8775% ( 2) 00:16:37.164 19.721 - 19.816: 99.8847% ( 1) 00:16:37.164 19.816 - 19.911: 99.8919% ( 1) 00:16:37.164 20.006 - 20.101: 99.8991% ( 1) 00:16:37.164 23.040 - 23.135: 99.9063% ( 1) 00:16:37.164 27.307 - 27.496: 99.9135% ( 1) 00:16:37.164 27.876 - 28.065: 99.9207% ( 1) 00:16:37.164 3980.705 - 4004.978: 99.9928% ( 10) 00:16:37.164 4004.978 - 4029.250: 100.0000% ( 1) 00:16:37.164 00:16:37.164 Complete histogram 00:16:37.164 ================== 00:16:37.164 Range in us Cumulative Count 00:16:37.164 2.027 - 2.039: 0.5476% ( 76) 00:16:37.164 2.039 - 2.050: 13.3285% ( 1774) 00:16:37.164 2.050 - 2.062: 17.9971% ( 648) 00:16:37.164 2.062 - 2.074: 25.6844% ( 1067) 00:16:37.164 2.074 - 2.086: 57.3271% ( 4392) 00:16:37.164 2.086 - 2.098: 63.5951% ( 870) 00:16:37.164 2.098 - 2.110: 65.3458% ( 243) 00:16:37.164 2.110 - 2.121: 68.7824% ( 477) 00:16:37.164 2.121 - 2.133: 69.2651% ( 67) 00:16:37.164 2.133 - 2.145: 74.5965% ( 740) 00:16:37.164 2.145 - 2.157: 82.9179% ( 1155) 00:16:37.164 2.157 - 2.169: 84.2867% ( 190) 00:16:37.164 2.169 - 2.181: 86.5058% ( 308) 00:16:37.164 2.181 - 2.193: 88.1412% ( 227) 00:16:37.164 2.193 - 2.204: 88.7680% ( 87) 00:16:37.164 2.204 - 2.216: 91.1527% ( 331) 00:16:37.164 2.216 - 2.228: 94.1787% ( 420) 00:16:37.164 2.228 - 2.240: 94.6974% ( 72) 00:16:37.164 2.240 - 2.252: 95.2594% ( 78) 00:16:37.164 2.252 - 2.264: 95.5115% ( 35) 00:16:37.164 2.264 - 2.276: 95.7709% ( 36) 00:16:37.164 2.276 - 2.287: 95.9942% ( 31) 00:16:37.164 2.287 - 2.299: 96.0519% ( 8) 00:16:37.164 2.299 - 2.311: 96.1023% ( 7) 00:16:37.164 2.311 - 2.323: 96.2896% ( 26) 00:16:37.164 2.323 - 2.335: 96.4553% ( 23) 00:16:37.165 2.335 - 2.347: 96.5634% ( 15) 00:16:37.165 2.347 - 2.359: 96.7435% ( 25) 00:16:37.165 2.359 - 2.370: 96.9164% ( 24) 00:16:37.165 2.370 - 2.382: 97.0821% ( 23) 00:16:37.165 2.382 - 2.394: 97.2983% ( 30) 00:16:37.165 2.394 - 2.406: 97.5216% ( 31) 00:16:37.165 2.406 - 2.418: 97.6441% ( 17) 00:16:37.165 2.418 - 2.430: 97.7810% ( 19) 00:16:37.165 2.430 - 2.441: 97.9899% ( 29) 00:16:37.165 2.441 - 2.453: 98.0692% ( 11) 00:16:37.165 2.453 - 2.465: 98.1700% ( 14) 00:16:37.165 2.465 - 2.477: 98.2781% ( 15) 00:16:37.165 2.477 - 2.489: 98.2997% ( 3) 00:16:37.165 2.489 - 2.501: 98.3790% ( 11) 00:16:37.165 2.501 - 2.513: 98.4078% ( 4) 00:16:37.165 2.513 - 2.524: 98.4582% ( 7) 00:16:37.165 2.524 - 2.536: 98.4798% ( 3) 00:16:37.165 2.536 - 2.548: 98.5086% ( 4) 00:16:37.165 2.548 - 2.560: 98.5231% ( 2) 00:16:37.165 2.560 - 2.572: 98.5303% ( 1) 00:16:37.165 2.572 - 2.584: 98.5375% ( 1) 00:16:37.165 2.667 - 2.679: 98.5447% ( 1) 00:16:37.165 2.702 - 2.714: 98.5519% ( 1) 00:16:37.165 2.797 - 2.809: 98.5591% ( 1) 00:16:37.165 2.856 - 2.868: 98.5663% ( 1) 00:16:37.165 3.224 - 3.247: 98.5807% ( 2) 00:16:37.165 3.271 - 3.295: 98.5951% ( 2) 00:16:37.165 3.295 - 3.319: 98.6167% ( 3) 00:16:37.165 3.319 - 3.342: 98.6383% ( 3) 00:16:37.165 3.342 - 3.366: 98.6527% ( 2) 00:16:37.165 3.366 - 3.390: 98.6599% ( 1) 00:16:37.165 3.390 - 3.413: 98.6671% ( 1) 00:16:37.165 3.484 - 3.508: 98.6744% ( 1) 00:16:37.165 3.532 - 3.556: 98.6888% ( 2) 00:16:37.165 3.556 - 3.579: 98.6960% ( 1) 00:16:37.165 3.579 - 3.603: 98.7032% ( 1) 00:16:37.165 3.603 - 3.627: 98.7104% ( 1) 00:16:37.165 3.627 - 3.650: 98.7176% ( 1) 00:16:37.165 3.650 - 3.674: 98.7320% ( 2) 00:16:37.165 3.674 - 3.698: 98.7392% ( 1) 00:16:37.165 3.698 - 3.721: 98.7536% ( 2) 00:16:37.165 3.721 - 3.745: 98.7608% ( 1) 00:16:37.165 3.745 - 3.769: 98.7680% ( 1) 00:16:37.165 3.887 - 3.911: 98.7752% ( 1) 00:16:37.165 5.831 - 5.855: 98.7824% ( 1) 00:16:37.165 5.902 - 5.926: 98.7968% ( 2) 00:16:37.165 6.210 - 6.258: 98.8040% ( 1) 00:16:37.165 6.684 - 6.732: 98.8112% ( 1) 00:16:37.165 6.921 - 6.969: 98.8256% ( 2) 00:16:37.165 7.016 - 7.064: 98.8329% ( 1) 00:16:37.165 7.159 - 7.206: 98.8401% ( 1) 00:16:37.165 7.253 - 7.301: 98.8473% ( 1) 00:16:37.165 7.490 - 7.538: 98.8545% ( 1) 00:16:37.165 7.633 - 7.680: 98.8617% ( 1) 00:16:37.165 7.775 - 7.822: 98.8689% ( 1) 00:16:37.165 7.917 - 7.964: 98.8761% ( 1) 00:16:37.165 8.107 - 8.154: 98.8833% ( 1) 00:16:37.165 8.296 - 8.344: 98.8905% ( 1) 00:16:37.165 8.960 - 9.007: 98.8977% ( 1) 00:16:37.165 9.244 - 9.292: 98.9049% ( 1) 00:16:37.165 9.387 - 9.434: 98.9121% ( 1) 00:16:37.165 9.576 - 9.624: 98.9193% ( 1) 00:16:37.165 15.550 - 15.644: 98.9265% ( 1) 00:16:37.165 15.644 - 15.739: 98.9553% ( 4) 00:16:37.165 15.739 - 15.834: 98.9769% ( 3) 00:16:37.165 15.834 - 15.929: 98.9986% ( 3) 00:16:37.165 15.929 - 16.024: 99.0346% ( 5) 00:16:37.165 16.024 - 16.119: 99.0706% ( 5) 00:16:37.165 16.119 - 16.213: 99.0850% ( 2) 00:16:37.165 16.213 - 16.308: 99.1138% ( 4) 00:16:37.165 16.308 - 16.403: 99.1499% ( 5) 00:16:37.165 16.403 - 16.498: 99.1787% ( 4) 00:16:37.165 16.498 - 16.593: 99.2147% ( 5) 00:16:37.165 16.593 - 16.687: 99.2435% ( 4) 00:16:37.165 16.687 - 16.782: 99.2651% ( 3) 00:16:37.165 16.782 - 16.877: 99.2867% ( 3) 00:16:37.165 16.877 - 16.972: 99.3012% ( 2) 00:16:37.165 16.972 - 17.067: 99.3156% ( 2) 00:16:37.165 17.067 - 17.161: 99.3372% ( 3) 00:16:37.165 17.161 - 17.256: 99.3588% ( 3) 00:16:37.165 17.256 - 17.351: 99.3660% ( 1) 00:16:37.165 17.351 - 17.446: 99.3876% ( 3) 00:16:37.165 17.541 - 17.636: 99.3948% ( 1) 00:16:37.165 17.636 - 17.730: 99.4020% ( 1) 00:16:37.165 17.825 - 17.920: 99.4092% ( 1) 00:16:37.165 17.920 - 18.015: 99.4164% ( 1) 00:16:37.165 18.204 - 18.299: 99.4236% ( 1) 00:16:37.165 18.299 - 18.394: 99.4308% ( 1) 00:16:37.165 18.489 - 18.584: 99.4380% ( 1) 00:16:37.165 18.584 - 18.679: 99.4524% ( 2) 00:16:37.165 1025.517 - 1031.585: 99.4597% ( 1) 00:16:37.165 1104.403 - 1110.471: 99.4669% ( 1) 00:16:37.165 3980.705 - 4004.978: 99.8919% ( 59) 00:16:37.165 4004.978 - 4029.250: 99.9928% ( 14) 00:16:37.165 6990.507 - 7039.052: 100.0000% ( 1) 00:16:37.165 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:37.165 [2024-10-13 16:41:02.553535] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:37.165 [ 00:16:37.165 { 00:16:37.165 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:37.165 "subtype": "Discovery", 00:16:37.165 "listen_addresses": [], 00:16:37.165 "allow_any_host": true, 00:16:37.165 "hosts": [] 00:16:37.165 }, 00:16:37.165 { 00:16:37.165 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:37.165 "subtype": "NVMe", 00:16:37.165 "listen_addresses": [ 00:16:37.165 { 00:16:37.165 "transport": "VFIOUSER", 00:16:37.165 "trtype": "VFIOUSER", 00:16:37.165 "adrfam": "IPv4", 00:16:37.165 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:37.165 "trsvcid": "0" 00:16:37.165 } 00:16:37.165 ], 00:16:37.165 "allow_any_host": true, 00:16:37.165 "hosts": [], 00:16:37.165 "serial_number": "SPDK1", 00:16:37.165 "model_number": "SPDK bdev Controller", 00:16:37.165 "max_namespaces": 32, 00:16:37.165 "min_cntlid": 1, 00:16:37.165 "max_cntlid": 65519, 00:16:37.165 "namespaces": [ 00:16:37.165 { 00:16:37.165 "nsid": 1, 00:16:37.165 "bdev_name": "Malloc1", 00:16:37.165 "name": "Malloc1", 00:16:37.165 "nguid": "771AE7C0AE894163A87695A5F003C563", 00:16:37.165 "uuid": "771ae7c0-ae89-4163-a876-95a5f003c563" 00:16:37.165 } 00:16:37.165 ] 00:16:37.165 }, 00:16:37.165 { 00:16:37.165 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:37.165 "subtype": "NVMe", 00:16:37.165 "listen_addresses": [ 00:16:37.165 { 00:16:37.165 "transport": "VFIOUSER", 00:16:37.165 "trtype": "VFIOUSER", 00:16:37.165 "adrfam": "IPv4", 00:16:37.165 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:37.165 "trsvcid": "0" 00:16:37.165 } 00:16:37.165 ], 00:16:37.165 "allow_any_host": true, 00:16:37.165 "hosts": [], 00:16:37.165 "serial_number": "SPDK2", 00:16:37.165 "model_number": "SPDK bdev Controller", 00:16:37.165 "max_namespaces": 32, 00:16:37.165 "min_cntlid": 1, 00:16:37.165 "max_cntlid": 65519, 00:16:37.165 "namespaces": [ 00:16:37.165 { 00:16:37.165 "nsid": 1, 00:16:37.165 "bdev_name": "Malloc2", 00:16:37.165 "name": "Malloc2", 00:16:37.165 "nguid": "93EA687F5AAA495292CD2DC046339FBB", 00:16:37.165 "uuid": "93ea687f-5aaa-4952-92cd-2dc046339fbb" 00:16:37.165 } 00:16:37.165 ] 00:16:37.165 } 00:16:37.165 ] 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1176084 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:37.165 16:41:02 -- common/autotest_common.sh@1244 -- # local i=0 00:16:37.165 16:41:02 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:37.165 16:41:02 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:37.165 16:41:02 -- common/autotest_common.sh@1255 -- # return 0 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:37.165 16:41:02 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:37.165 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.423 Malloc3 00:16:37.423 16:41:02 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:37.681 16:41:03 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:37.681 Asynchronous Event Request test 00:16:37.681 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:37.681 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:37.681 Registering asynchronous event callbacks... 00:16:37.681 Starting namespace attribute notice tests for all controllers... 00:16:37.681 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:37.681 aer_cb - Changed Namespace 00:16:37.681 Cleaning up... 00:16:37.939 [ 00:16:37.939 { 00:16:37.939 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:37.939 "subtype": "Discovery", 00:16:37.939 "listen_addresses": [], 00:16:37.939 "allow_any_host": true, 00:16:37.939 "hosts": [] 00:16:37.939 }, 00:16:37.939 { 00:16:37.939 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:37.939 "subtype": "NVMe", 00:16:37.939 "listen_addresses": [ 00:16:37.939 { 00:16:37.939 "transport": "VFIOUSER", 00:16:37.939 "trtype": "VFIOUSER", 00:16:37.939 "adrfam": "IPv4", 00:16:37.939 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:37.939 "trsvcid": "0" 00:16:37.939 } 00:16:37.939 ], 00:16:37.939 "allow_any_host": true, 00:16:37.939 "hosts": [], 00:16:37.939 "serial_number": "SPDK1", 00:16:37.939 "model_number": "SPDK bdev Controller", 00:16:37.939 "max_namespaces": 32, 00:16:37.939 "min_cntlid": 1, 00:16:37.939 "max_cntlid": 65519, 00:16:37.939 "namespaces": [ 00:16:37.939 { 00:16:37.939 "nsid": 1, 00:16:37.939 "bdev_name": "Malloc1", 00:16:37.939 "name": "Malloc1", 00:16:37.939 "nguid": "771AE7C0AE894163A87695A5F003C563", 00:16:37.939 "uuid": "771ae7c0-ae89-4163-a876-95a5f003c563" 00:16:37.939 }, 00:16:37.939 { 00:16:37.939 "nsid": 2, 00:16:37.939 "bdev_name": "Malloc3", 00:16:37.939 "name": "Malloc3", 00:16:37.939 "nguid": "0AD2C043D2214674A9B2F8841CB1CD2D", 00:16:37.939 "uuid": "0ad2c043-d221-4674-a9b2-f8841cb1cd2d" 00:16:37.939 } 00:16:37.939 ] 00:16:37.939 }, 00:16:37.939 { 00:16:37.939 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:37.939 "subtype": "NVMe", 00:16:37.939 "listen_addresses": [ 00:16:37.939 { 00:16:37.939 "transport": "VFIOUSER", 00:16:37.939 "trtype": "VFIOUSER", 00:16:37.939 "adrfam": "IPv4", 00:16:37.939 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:37.939 "trsvcid": "0" 00:16:37.939 } 00:16:37.939 ], 00:16:37.939 "allow_any_host": true, 00:16:37.939 "hosts": [], 00:16:37.939 "serial_number": "SPDK2", 00:16:37.939 "model_number": "SPDK bdev Controller", 00:16:37.939 "max_namespaces": 32, 00:16:37.939 "min_cntlid": 1, 00:16:37.939 "max_cntlid": 65519, 00:16:37.939 "namespaces": [ 00:16:37.939 { 00:16:37.939 "nsid": 1, 00:16:37.939 "bdev_name": "Malloc2", 00:16:37.939 "name": "Malloc2", 00:16:37.939 "nguid": "93EA687F5AAA495292CD2DC046339FBB", 00:16:37.939 "uuid": "93ea687f-5aaa-4952-92cd-2dc046339fbb" 00:16:37.939 } 00:16:37.939 ] 00:16:37.939 } 00:16:37.939 ] 00:16:37.939 16:41:03 -- target/nvmf_vfio_user.sh@44 -- # wait 1176084 00:16:37.939 16:41:03 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:37.939 16:41:03 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:37.939 16:41:03 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:37.939 16:41:03 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:37.939 [2024-10-13 16:41:03.391297] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:16:37.939 [2024-10-13 16:41:03.391342] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1176224 ] 00:16:37.939 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.939 [2024-10-13 16:41:03.424429] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:37.939 [2024-10-13 16:41:03.432727] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:37.939 [2024-10-13 16:41:03.432757] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7ff96b173000 00:16:37.939 [2024-10-13 16:41:03.433726] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.434734] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.435731] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.436737] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.437746] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.438750] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:37.939 [2024-10-13 16:41:03.439755] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:38.198 [2024-10-13 16:41:03.440776] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:38.198 [2024-10-13 16:41:03.441800] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:38.198 [2024-10-13 16:41:03.441822] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7ff969e6d000 00:16:38.198 [2024-10-13 16:41:03.444010] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:38.198 [2024-10-13 16:41:03.459057] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:38.198 [2024-10-13 16:41:03.459091] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:38.198 [2024-10-13 16:41:03.464190] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:38.198 [2024-10-13 16:41:03.464239] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:38.198 [2024-10-13 16:41:03.464320] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:38.198 [2024-10-13 16:41:03.464344] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:38.198 [2024-10-13 16:41:03.464355] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:38.198 [2024-10-13 16:41:03.465200] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:38.198 [2024-10-13 16:41:03.465220] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:38.198 [2024-10-13 16:41:03.465239] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:38.198 [2024-10-13 16:41:03.466206] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:38.198 [2024-10-13 16:41:03.466225] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:38.198 [2024-10-13 16:41:03.466238] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.467215] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:38.198 [2024-10-13 16:41:03.467235] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.468220] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:38.198 [2024-10-13 16:41:03.468238] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:38.198 [2024-10-13 16:41:03.468247] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.468258] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.468367] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:38.198 [2024-10-13 16:41:03.468388] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.468404] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:38.198 [2024-10-13 16:41:03.469234] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:38.198 [2024-10-13 16:41:03.470237] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:38.198 [2024-10-13 16:41:03.471246] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:38.198 [2024-10-13 16:41:03.472273] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:38.198 [2024-10-13 16:41:03.473254] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:38.198 [2024-10-13 16:41:03.473273] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:38.198 [2024-10-13 16:41:03.473282] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:38.198 [2024-10-13 16:41:03.473305] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:38.199 [2024-10-13 16:41:03.473317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.473335] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:38.199 [2024-10-13 16:41:03.473344] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:38.199 [2024-10-13 16:41:03.473364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.481407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.481430] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:38.199 [2024-10-13 16:41:03.481438] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:38.199 [2024-10-13 16:41:03.481445] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:38.199 [2024-10-13 16:41:03.481453] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:38.199 [2024-10-13 16:41:03.481460] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:38.199 [2024-10-13 16:41:03.481467] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:38.199 [2024-10-13 16:41:03.481475] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.481492] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.481509] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.489403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.489431] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.199 [2024-10-13 16:41:03.489446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.199 [2024-10-13 16:41:03.489458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.199 [2024-10-13 16:41:03.489470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.199 [2024-10-13 16:41:03.489479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.489494] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.489508] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.497405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.497423] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:38.199 [2024-10-13 16:41:03.497432] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.497442] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.497456] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.497471] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.505405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.505474] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.505489] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.505502] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:38.199 [2024-10-13 16:41:03.505511] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:38.199 [2024-10-13 16:41:03.505521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.513418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.513450] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:38.199 [2024-10-13 16:41:03.513465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.513479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.513492] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:38.199 [2024-10-13 16:41:03.513500] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:38.199 [2024-10-13 16:41:03.513510] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.521420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.521448] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.521464] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.521477] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:38.199 [2024-10-13 16:41:03.521486] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:38.199 [2024-10-13 16:41:03.521496] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.529417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.529438] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529450] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529464] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529474] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529482] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529490] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:38.199 [2024-10-13 16:41:03.529501] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:38.199 [2024-10-13 16:41:03.529510] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:38.199 [2024-10-13 16:41:03.529533] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.537408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.537434] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.545405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.545430] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.553403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.553428] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.561406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.561432] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:38.199 [2024-10-13 16:41:03.561442] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:38.199 [2024-10-13 16:41:03.561448] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:38.199 [2024-10-13 16:41:03.561453] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:38.199 [2024-10-13 16:41:03.561463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:38.199 [2024-10-13 16:41:03.561475] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:38.199 [2024-10-13 16:41:03.561483] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:38.199 [2024-10-13 16:41:03.561491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.561502] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:38.199 [2024-10-13 16:41:03.561509] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:38.199 [2024-10-13 16:41:03.561518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.561529] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:38.199 [2024-10-13 16:41:03.561537] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:38.199 [2024-10-13 16:41:03.561545] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:38.199 [2024-10-13 16:41:03.569406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.569434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.569450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:38.199 [2024-10-13 16:41:03.569466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:38.199 ===================================================== 00:16:38.199 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:38.199 ===================================================== 00:16:38.199 Controller Capabilities/Features 00:16:38.199 ================================ 00:16:38.199 Vendor ID: 4e58 00:16:38.199 Subsystem Vendor ID: 4e58 00:16:38.199 Serial Number: SPDK2 00:16:38.199 Model Number: SPDK bdev Controller 00:16:38.199 Firmware Version: 24.01.1 00:16:38.199 Recommended Arb Burst: 6 00:16:38.200 IEEE OUI Identifier: 8d 6b 50 00:16:38.200 Multi-path I/O 00:16:38.200 May have multiple subsystem ports: Yes 00:16:38.200 May have multiple controllers: Yes 00:16:38.200 Associated with SR-IOV VF: No 00:16:38.200 Max Data Transfer Size: 131072 00:16:38.200 Max Number of Namespaces: 32 00:16:38.200 Max Number of I/O Queues: 127 00:16:38.200 NVMe Specification Version (VS): 1.3 00:16:38.200 NVMe Specification Version (Identify): 1.3 00:16:38.200 Maximum Queue Entries: 256 00:16:38.200 Contiguous Queues Required: Yes 00:16:38.200 Arbitration Mechanisms Supported 00:16:38.200 Weighted Round Robin: Not Supported 00:16:38.200 Vendor Specific: Not Supported 00:16:38.200 Reset Timeout: 15000 ms 00:16:38.200 Doorbell Stride: 4 bytes 00:16:38.200 NVM Subsystem Reset: Not Supported 00:16:38.200 Command Sets Supported 00:16:38.200 NVM Command Set: Supported 00:16:38.200 Boot Partition: Not Supported 00:16:38.200 Memory Page Size Minimum: 4096 bytes 00:16:38.200 Memory Page Size Maximum: 4096 bytes 00:16:38.200 Persistent Memory Region: Not Supported 00:16:38.200 Optional Asynchronous Events Supported 00:16:38.200 Namespace Attribute Notices: Supported 00:16:38.200 Firmware Activation Notices: Not Supported 00:16:38.200 ANA Change Notices: Not Supported 00:16:38.200 PLE Aggregate Log Change Notices: Not Supported 00:16:38.200 LBA Status Info Alert Notices: Not Supported 00:16:38.200 EGE Aggregate Log Change Notices: Not Supported 00:16:38.200 Normal NVM Subsystem Shutdown event: Not Supported 00:16:38.200 Zone Descriptor Change Notices: Not Supported 00:16:38.200 Discovery Log Change Notices: Not Supported 00:16:38.200 Controller Attributes 00:16:38.200 128-bit Host Identifier: Supported 00:16:38.200 Non-Operational Permissive Mode: Not Supported 00:16:38.200 NVM Sets: Not Supported 00:16:38.200 Read Recovery Levels: Not Supported 00:16:38.200 Endurance Groups: Not Supported 00:16:38.200 Predictable Latency Mode: Not Supported 00:16:38.200 Traffic Based Keep ALive: Not Supported 00:16:38.200 Namespace Granularity: Not Supported 00:16:38.200 SQ Associations: Not Supported 00:16:38.200 UUID List: Not Supported 00:16:38.200 Multi-Domain Subsystem: Not Supported 00:16:38.200 Fixed Capacity Management: Not Supported 00:16:38.200 Variable Capacity Management: Not Supported 00:16:38.200 Delete Endurance Group: Not Supported 00:16:38.200 Delete NVM Set: Not Supported 00:16:38.200 Extended LBA Formats Supported: Not Supported 00:16:38.200 Flexible Data Placement Supported: Not Supported 00:16:38.200 00:16:38.200 Controller Memory Buffer Support 00:16:38.200 ================================ 00:16:38.200 Supported: No 00:16:38.200 00:16:38.200 Persistent Memory Region Support 00:16:38.200 ================================ 00:16:38.200 Supported: No 00:16:38.200 00:16:38.200 Admin Command Set Attributes 00:16:38.200 ============================ 00:16:38.200 Security Send/Receive: Not Supported 00:16:38.200 Format NVM: Not Supported 00:16:38.200 Firmware Activate/Download: Not Supported 00:16:38.200 Namespace Management: Not Supported 00:16:38.200 Device Self-Test: Not Supported 00:16:38.200 Directives: Not Supported 00:16:38.200 NVMe-MI: Not Supported 00:16:38.200 Virtualization Management: Not Supported 00:16:38.200 Doorbell Buffer Config: Not Supported 00:16:38.200 Get LBA Status Capability: Not Supported 00:16:38.200 Command & Feature Lockdown Capability: Not Supported 00:16:38.200 Abort Command Limit: 4 00:16:38.200 Async Event Request Limit: 4 00:16:38.200 Number of Firmware Slots: N/A 00:16:38.200 Firmware Slot 1 Read-Only: N/A 00:16:38.200 Firmware Activation Without Reset: N/A 00:16:38.200 Multiple Update Detection Support: N/A 00:16:38.200 Firmware Update Granularity: No Information Provided 00:16:38.200 Per-Namespace SMART Log: No 00:16:38.200 Asymmetric Namespace Access Log Page: Not Supported 00:16:38.200 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:38.200 Command Effects Log Page: Supported 00:16:38.200 Get Log Page Extended Data: Supported 00:16:38.200 Telemetry Log Pages: Not Supported 00:16:38.200 Persistent Event Log Pages: Not Supported 00:16:38.200 Supported Log Pages Log Page: May Support 00:16:38.200 Commands Supported & Effects Log Page: Not Supported 00:16:38.200 Feature Identifiers & Effects Log Page:May Support 00:16:38.200 NVMe-MI Commands & Effects Log Page: May Support 00:16:38.200 Data Area 4 for Telemetry Log: Not Supported 00:16:38.200 Error Log Page Entries Supported: 128 00:16:38.200 Keep Alive: Supported 00:16:38.200 Keep Alive Granularity: 10000 ms 00:16:38.200 00:16:38.200 NVM Command Set Attributes 00:16:38.200 ========================== 00:16:38.200 Submission Queue Entry Size 00:16:38.200 Max: 64 00:16:38.200 Min: 64 00:16:38.200 Completion Queue Entry Size 00:16:38.200 Max: 16 00:16:38.200 Min: 16 00:16:38.200 Number of Namespaces: 32 00:16:38.200 Compare Command: Supported 00:16:38.200 Write Uncorrectable Command: Not Supported 00:16:38.200 Dataset Management Command: Supported 00:16:38.200 Write Zeroes Command: Supported 00:16:38.200 Set Features Save Field: Not Supported 00:16:38.200 Reservations: Not Supported 00:16:38.200 Timestamp: Not Supported 00:16:38.200 Copy: Supported 00:16:38.200 Volatile Write Cache: Present 00:16:38.200 Atomic Write Unit (Normal): 1 00:16:38.200 Atomic Write Unit (PFail): 1 00:16:38.200 Atomic Compare & Write Unit: 1 00:16:38.200 Fused Compare & Write: Supported 00:16:38.200 Scatter-Gather List 00:16:38.200 SGL Command Set: Supported (Dword aligned) 00:16:38.200 SGL Keyed: Not Supported 00:16:38.200 SGL Bit Bucket Descriptor: Not Supported 00:16:38.200 SGL Metadata Pointer: Not Supported 00:16:38.200 Oversized SGL: Not Supported 00:16:38.200 SGL Metadata Address: Not Supported 00:16:38.200 SGL Offset: Not Supported 00:16:38.200 Transport SGL Data Block: Not Supported 00:16:38.200 Replay Protected Memory Block: Not Supported 00:16:38.200 00:16:38.200 Firmware Slot Information 00:16:38.200 ========================= 00:16:38.200 Active slot: 1 00:16:38.200 Slot 1 Firmware Revision: 24.01.1 00:16:38.200 00:16:38.200 00:16:38.200 Commands Supported and Effects 00:16:38.200 ============================== 00:16:38.200 Admin Commands 00:16:38.200 -------------- 00:16:38.200 Get Log Page (02h): Supported 00:16:38.200 Identify (06h): Supported 00:16:38.200 Abort (08h): Supported 00:16:38.200 Set Features (09h): Supported 00:16:38.200 Get Features (0Ah): Supported 00:16:38.200 Asynchronous Event Request (0Ch): Supported 00:16:38.200 Keep Alive (18h): Supported 00:16:38.200 I/O Commands 00:16:38.200 ------------ 00:16:38.200 Flush (00h): Supported LBA-Change 00:16:38.200 Write (01h): Supported LBA-Change 00:16:38.200 Read (02h): Supported 00:16:38.200 Compare (05h): Supported 00:16:38.200 Write Zeroes (08h): Supported LBA-Change 00:16:38.200 Dataset Management (09h): Supported LBA-Change 00:16:38.200 Copy (19h): Supported LBA-Change 00:16:38.200 Unknown (79h): Supported LBA-Change 00:16:38.200 Unknown (7Ah): Supported 00:16:38.200 00:16:38.200 Error Log 00:16:38.200 ========= 00:16:38.200 00:16:38.200 Arbitration 00:16:38.201 =========== 00:16:38.201 Arbitration Burst: 1 00:16:38.201 00:16:38.201 Power Management 00:16:38.201 ================ 00:16:38.201 Number of Power States: 1 00:16:38.201 Current Power State: Power State #0 00:16:38.201 Power State #0: 00:16:38.201 Max Power: 0.00 W 00:16:38.201 Non-Operational State: Operational 00:16:38.201 Entry Latency: Not Reported 00:16:38.201 Exit Latency: Not Reported 00:16:38.201 Relative Read Throughput: 0 00:16:38.201 Relative Read Latency: 0 00:16:38.201 Relative Write Throughput: 0 00:16:38.201 Relative Write Latency: 0 00:16:38.201 Idle Power: Not Reported 00:16:38.201 Active Power: Not Reported 00:16:38.201 Non-Operational Permissive Mode: Not Supported 00:16:38.201 00:16:38.201 Health Information 00:16:38.201 ================== 00:16:38.201 Critical Warnings: 00:16:38.201 Available Spare Space: OK 00:16:38.201 Temperature: OK 00:16:38.201 Device Reliability: OK 00:16:38.201 Read Only: No 00:16:38.201 Volatile Memory Backup: OK 00:16:38.201 Current Temperature: 0 Kelvin[2024-10-13 16:41:03.569583] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:38.201 [2024-10-13 16:41:03.577407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:38.201 [2024-10-13 16:41:03.577449] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:38.201 [2024-10-13 16:41:03.577466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.201 [2024-10-13 16:41:03.577477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.201 [2024-10-13 16:41:03.577487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.201 [2024-10-13 16:41:03.577496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.201 [2024-10-13 16:41:03.577577] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:38.201 [2024-10-13 16:41:03.577598] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:38.201 [2024-10-13 16:41:03.578619] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:38.201 [2024-10-13 16:41:03.578635] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:38.201 [2024-10-13 16:41:03.579588] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:38.201 [2024-10-13 16:41:03.579611] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:38.201 [2024-10-13 16:41:03.579662] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:38.201 [2024-10-13 16:41:03.580851] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:38.201 (-273 Celsius) 00:16:38.201 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:38.201 Available Spare: 0% 00:16:38.201 Available Spare Threshold: 0% 00:16:38.201 Life Percentage Used: 0% 00:16:38.201 Data Units Read: 0 00:16:38.201 Data Units Written: 0 00:16:38.201 Host Read Commands: 0 00:16:38.201 Host Write Commands: 0 00:16:38.201 Controller Busy Time: 0 minutes 00:16:38.201 Power Cycles: 0 00:16:38.201 Power On Hours: 0 hours 00:16:38.201 Unsafe Shutdowns: 0 00:16:38.201 Unrecoverable Media Errors: 0 00:16:38.201 Lifetime Error Log Entries: 0 00:16:38.201 Warning Temperature Time: 0 minutes 00:16:38.201 Critical Temperature Time: 0 minutes 00:16:38.201 00:16:38.201 Number of Queues 00:16:38.201 ================ 00:16:38.201 Number of I/O Submission Queues: 127 00:16:38.201 Number of I/O Completion Queues: 127 00:16:38.201 00:16:38.201 Active Namespaces 00:16:38.201 ================= 00:16:38.201 Namespace ID:1 00:16:38.201 Error Recovery Timeout: Unlimited 00:16:38.201 Command Set Identifier: NVM (00h) 00:16:38.201 Deallocate: Supported 00:16:38.201 Deallocated/Unwritten Error: Not Supported 00:16:38.201 Deallocated Read Value: Unknown 00:16:38.201 Deallocate in Write Zeroes: Not Supported 00:16:38.201 Deallocated Guard Field: 0xFFFF 00:16:38.201 Flush: Supported 00:16:38.201 Reservation: Supported 00:16:38.201 Namespace Sharing Capabilities: Multiple Controllers 00:16:38.201 Size (in LBAs): 131072 (0GiB) 00:16:38.201 Capacity (in LBAs): 131072 (0GiB) 00:16:38.201 Utilization (in LBAs): 131072 (0GiB) 00:16:38.201 NGUID: 93EA687F5AAA495292CD2DC046339FBB 00:16:38.201 UUID: 93ea687f-5aaa-4952-92cd-2dc046339fbb 00:16:38.201 Thin Provisioning: Not Supported 00:16:38.201 Per-NS Atomic Units: Yes 00:16:38.201 Atomic Boundary Size (Normal): 0 00:16:38.201 Atomic Boundary Size (PFail): 0 00:16:38.201 Atomic Boundary Offset: 0 00:16:38.201 Maximum Single Source Range Length: 65535 00:16:38.201 Maximum Copy Length: 65535 00:16:38.201 Maximum Source Range Count: 1 00:16:38.201 NGUID/EUI64 Never Reused: No 00:16:38.201 Namespace Write Protected: No 00:16:38.201 Number of LBA Formats: 1 00:16:38.201 Current LBA Format: LBA Format #00 00:16:38.201 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:38.201 00:16:38.201 16:41:03 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:38.201 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.462 Initializing NVMe Controllers 00:16:43.462 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:43.462 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:43.462 Initialization complete. Launching workers. 00:16:43.462 ======================================================== 00:16:43.462 Latency(us) 00:16:43.462 Device Information : IOPS MiB/s Average min max 00:16:43.462 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38153.48 149.04 3354.28 1114.37 8725.75 00:16:43.462 ======================================================== 00:16:43.462 Total : 38153.48 149.04 3354.28 1114.37 8725.75 00:16:43.462 00:16:43.462 16:41:08 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:43.720 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.982 Initializing NVMe Controllers 00:16:48.982 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:48.982 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:48.982 Initialization complete. Launching workers. 00:16:48.982 ======================================================== 00:16:48.982 Latency(us) 00:16:48.982 Device Information : IOPS MiB/s Average min max 00:16:48.982 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36338.62 141.95 3521.68 1136.44 8514.28 00:16:48.982 ======================================================== 00:16:48.982 Total : 36338.62 141.95 3521.68 1136.44 8514.28 00:16:48.982 00:16:48.982 16:41:14 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:48.982 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.244 Initializing NVMe Controllers 00:16:54.244 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:54.244 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:54.244 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:54.245 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:54.245 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:54.245 Initialization complete. Launching workers. 00:16:54.245 Starting thread on core 2 00:16:54.245 Starting thread on core 3 00:16:54.245 Starting thread on core 1 00:16:54.245 16:41:19 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:54.245 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.527 Initializing NVMe Controllers 00:16:57.527 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:57.527 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:57.527 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:57.527 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:57.527 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:57.527 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:57.527 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:57.527 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:57.527 Initialization complete. Launching workers. 00:16:57.528 Starting thread on core 1 with urgent priority queue 00:16:57.528 Starting thread on core 2 with urgent priority queue 00:16:57.528 Starting thread on core 3 with urgent priority queue 00:16:57.528 Starting thread on core 0 with urgent priority queue 00:16:57.528 SPDK bdev Controller (SPDK2 ) core 0: 5092.67 IO/s 19.64 secs/100000 ios 00:16:57.528 SPDK bdev Controller (SPDK2 ) core 1: 5236.67 IO/s 19.10 secs/100000 ios 00:16:57.528 SPDK bdev Controller (SPDK2 ) core 2: 5562.33 IO/s 17.98 secs/100000 ios 00:16:57.528 SPDK bdev Controller (SPDK2 ) core 3: 5481.33 IO/s 18.24 secs/100000 ios 00:16:57.528 ======================================================== 00:16:57.528 00:16:57.528 16:41:22 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:57.528 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.785 Initializing NVMe Controllers 00:16:57.786 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:57.786 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:57.786 Namespace ID: 1 size: 0GB 00:16:57.786 Initialization complete. 00:16:57.786 INFO: using host memory buffer for IO 00:16:57.786 Hello world! 00:16:57.786 16:41:23 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:57.786 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.160 Initializing NVMe Controllers 00:16:59.160 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:59.160 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:59.160 Initialization complete. Launching workers. 00:16:59.160 submit (in ns) avg, min, max = 8236.5, 3482.2, 4016942.2 00:16:59.160 complete (in ns) avg, min, max = 25914.8, 2037.8, 5000461.1 00:16:59.160 00:16:59.160 Submit histogram 00:16:59.160 ================ 00:16:59.160 Range in us Cumulative Count 00:16:59.160 3.461 - 3.484: 0.0145% ( 2) 00:16:59.160 3.484 - 3.508: 0.4124% ( 55) 00:16:59.160 3.508 - 3.532: 3.0823% ( 369) 00:16:59.160 3.532 - 3.556: 5.9909% ( 402) 00:16:59.160 3.556 - 3.579: 15.1074% ( 1260) 00:16:59.160 3.579 - 3.603: 26.3946% ( 1560) 00:16:59.160 3.603 - 3.627: 37.2766% ( 1504) 00:16:59.160 3.627 - 3.650: 43.8319% ( 906) 00:16:59.160 3.650 - 3.674: 48.9834% ( 712) 00:16:59.160 3.674 - 3.698: 55.1986% ( 859) 00:16:59.160 3.698 - 3.721: 60.2851% ( 703) 00:16:59.160 3.721 - 3.745: 63.8449% ( 492) 00:16:59.160 3.745 - 3.769: 66.1457% ( 318) 00:16:59.160 3.769 - 3.793: 69.3510% ( 443) 00:16:59.160 3.793 - 3.816: 72.7299% ( 467) 00:16:59.160 3.816 - 3.840: 77.2303% ( 622) 00:16:59.160 3.840 - 3.864: 81.4558% ( 584) 00:16:59.160 3.864 - 3.887: 84.2414% ( 385) 00:16:59.160 3.887 - 3.911: 86.6797% ( 337) 00:16:59.160 3.911 - 3.935: 88.5247% ( 255) 00:16:59.160 3.935 - 3.959: 90.0514% ( 211) 00:16:59.160 3.959 - 3.982: 91.1367% ( 150) 00:16:59.160 3.982 - 4.006: 92.2437% ( 153) 00:16:59.160 4.006 - 4.030: 92.9528% ( 98) 00:16:59.160 4.030 - 4.053: 93.9078% ( 132) 00:16:59.160 4.053 - 4.077: 94.8122% ( 125) 00:16:59.160 4.077 - 4.101: 95.3621% ( 76) 00:16:59.160 4.101 - 4.124: 95.7601% ( 55) 00:16:59.160 4.124 - 4.148: 96.0784% ( 44) 00:16:59.160 4.148 - 4.172: 96.3823% ( 42) 00:16:59.160 4.172 - 4.196: 96.5777% ( 27) 00:16:59.160 4.196 - 4.219: 96.7079% ( 18) 00:16:59.160 4.219 - 4.243: 96.8381% ( 18) 00:16:59.160 4.243 - 4.267: 96.9539% ( 16) 00:16:59.160 4.267 - 4.290: 97.0407% ( 12) 00:16:59.160 4.290 - 4.314: 97.1203% ( 11) 00:16:59.160 4.314 - 4.338: 97.1927% ( 10) 00:16:59.160 4.338 - 4.361: 97.2289% ( 5) 00:16:59.160 4.361 - 4.385: 97.2650% ( 5) 00:16:59.160 4.385 - 4.409: 97.3157% ( 7) 00:16:59.160 4.409 - 4.433: 97.3736% ( 8) 00:16:59.160 4.433 - 4.456: 97.3953% ( 3) 00:16:59.160 4.480 - 4.504: 97.4170% ( 3) 00:16:59.160 4.504 - 4.527: 97.4387% ( 3) 00:16:59.160 4.527 - 4.551: 97.4459% ( 1) 00:16:59.160 4.551 - 4.575: 97.4676% ( 3) 00:16:59.160 4.622 - 4.646: 97.4749% ( 1) 00:16:59.160 4.670 - 4.693: 97.4821% ( 1) 00:16:59.160 4.693 - 4.717: 97.4966% ( 2) 00:16:59.160 4.717 - 4.741: 97.5110% ( 2) 00:16:59.160 4.741 - 4.764: 97.5183% ( 1) 00:16:59.160 4.764 - 4.788: 97.5472% ( 4) 00:16:59.160 4.788 - 4.812: 97.5834% ( 5) 00:16:59.160 4.812 - 4.836: 97.6340% ( 7) 00:16:59.160 4.836 - 4.859: 97.6702% ( 5) 00:16:59.160 4.859 - 4.883: 97.7353% ( 9) 00:16:59.160 4.883 - 4.907: 97.7643% ( 4) 00:16:59.160 4.907 - 4.930: 97.8222% ( 8) 00:16:59.160 4.930 - 4.954: 97.8873% ( 9) 00:16:59.160 4.954 - 4.978: 97.9090% ( 3) 00:16:59.160 4.978 - 5.001: 97.9886% ( 11) 00:16:59.160 5.001 - 5.025: 98.0247% ( 5) 00:16:59.160 5.025 - 5.049: 98.0392% ( 2) 00:16:59.160 5.049 - 5.073: 98.0899% ( 7) 00:16:59.160 5.073 - 5.096: 98.1188% ( 4) 00:16:59.160 5.096 - 5.120: 98.1333% ( 2) 00:16:59.160 5.120 - 5.144: 98.1767% ( 6) 00:16:59.160 5.144 - 5.167: 98.2273% ( 7) 00:16:59.160 5.191 - 5.215: 98.2563% ( 4) 00:16:59.160 5.215 - 5.239: 98.2707% ( 2) 00:16:59.160 5.239 - 5.262: 98.3069% ( 5) 00:16:59.160 5.262 - 5.286: 98.3142% ( 1) 00:16:59.160 5.286 - 5.310: 98.3359% ( 3) 00:16:59.160 5.310 - 5.333: 98.3503% ( 2) 00:16:59.160 5.333 - 5.357: 98.3576% ( 1) 00:16:59.160 5.357 - 5.381: 98.3720% ( 2) 00:16:59.160 5.381 - 5.404: 98.3793% ( 1) 00:16:59.160 5.404 - 5.428: 98.4082% ( 4) 00:16:59.160 5.428 - 5.452: 98.4155% ( 1) 00:16:59.160 5.452 - 5.476: 98.4227% ( 1) 00:16:59.160 5.476 - 5.499: 98.4372% ( 2) 00:16:59.160 5.499 - 5.523: 98.4589% ( 3) 00:16:59.160 5.523 - 5.547: 98.4733% ( 2) 00:16:59.160 5.594 - 5.618: 98.4806% ( 1) 00:16:59.160 5.641 - 5.665: 98.4878% ( 1) 00:16:59.160 5.689 - 5.713: 98.5095% ( 3) 00:16:59.160 5.713 - 5.736: 98.5240% ( 2) 00:16:59.160 5.784 - 5.807: 98.5312% ( 1) 00:16:59.160 5.831 - 5.855: 98.5385% ( 1) 00:16:59.160 5.855 - 5.879: 98.5457% ( 1) 00:16:59.160 5.950 - 5.973: 98.5529% ( 1) 00:16:59.160 6.044 - 6.068: 98.5602% ( 1) 00:16:59.160 6.116 - 6.163: 98.5674% ( 1) 00:16:59.160 6.163 - 6.210: 98.5746% ( 1) 00:16:59.160 6.210 - 6.258: 98.5819% ( 1) 00:16:59.160 6.353 - 6.400: 98.5891% ( 1) 00:16:59.160 7.159 - 7.206: 98.5963% ( 1) 00:16:59.160 7.348 - 7.396: 98.6036% ( 1) 00:16:59.160 7.443 - 7.490: 98.6108% ( 1) 00:16:59.160 7.490 - 7.538: 98.6180% ( 1) 00:16:59.160 7.633 - 7.680: 98.6253% ( 1) 00:16:59.160 7.917 - 7.964: 98.6325% ( 1) 00:16:59.160 7.964 - 8.012: 98.6398% ( 1) 00:16:59.160 8.012 - 8.059: 98.6470% ( 1) 00:16:59.160 8.249 - 8.296: 98.6542% ( 1) 00:16:59.160 8.391 - 8.439: 98.6615% ( 1) 00:16:59.160 8.533 - 8.581: 98.6759% ( 2) 00:16:59.160 8.581 - 8.628: 98.6832% ( 1) 00:16:59.160 8.628 - 8.676: 98.7049% ( 3) 00:16:59.160 8.676 - 8.723: 98.7121% ( 1) 00:16:59.160 8.865 - 8.913: 98.7266% ( 2) 00:16:59.160 8.913 - 8.960: 98.7338% ( 1) 00:16:59.160 9.007 - 9.055: 98.7410% ( 1) 00:16:59.160 9.055 - 9.102: 98.7483% ( 1) 00:16:59.160 9.102 - 9.150: 98.7628% ( 2) 00:16:59.160 9.292 - 9.339: 98.7700% ( 1) 00:16:59.160 9.339 - 9.387: 98.7772% ( 1) 00:16:59.160 9.387 - 9.434: 98.7845% ( 1) 00:16:59.160 9.434 - 9.481: 98.7917% ( 1) 00:16:59.160 9.576 - 9.624: 98.7989% ( 1) 00:16:59.160 9.671 - 9.719: 98.8062% ( 1) 00:16:59.160 9.719 - 9.766: 98.8206% ( 2) 00:16:59.161 9.908 - 9.956: 98.8279% ( 1) 00:16:59.161 9.956 - 10.003: 98.8351% ( 1) 00:16:59.161 10.003 - 10.050: 98.8423% ( 1) 00:16:59.161 10.050 - 10.098: 98.8496% ( 1) 00:16:59.161 10.098 - 10.145: 98.8568% ( 1) 00:16:59.161 10.240 - 10.287: 98.8640% ( 1) 00:16:59.161 10.382 - 10.430: 98.8713% ( 1) 00:16:59.161 10.572 - 10.619: 98.8785% ( 1) 00:16:59.161 10.761 - 10.809: 98.8858% ( 1) 00:16:59.161 10.999 - 11.046: 98.8930% ( 1) 00:16:59.161 11.093 - 11.141: 98.9002% ( 1) 00:16:59.161 11.141 - 11.188: 98.9075% ( 1) 00:16:59.161 11.188 - 11.236: 98.9147% ( 1) 00:16:59.161 11.378 - 11.425: 98.9219% ( 1) 00:16:59.161 11.662 - 11.710: 98.9292% ( 1) 00:16:59.161 11.757 - 11.804: 98.9364% ( 1) 00:16:59.161 12.136 - 12.231: 98.9436% ( 1) 00:16:59.161 12.231 - 12.326: 98.9509% ( 1) 00:16:59.161 12.516 - 12.610: 98.9653% ( 2) 00:16:59.161 12.705 - 12.800: 98.9726% ( 1) 00:16:59.161 12.800 - 12.895: 98.9798% ( 1) 00:16:59.161 13.084 - 13.179: 98.9943% ( 2) 00:16:59.161 13.369 - 13.464: 99.0015% ( 1) 00:16:59.161 13.559 - 13.653: 99.0088% ( 1) 00:16:59.161 13.748 - 13.843: 99.0160% ( 1) 00:16:59.161 13.843 - 13.938: 99.0232% ( 1) 00:16:59.161 14.601 - 14.696: 99.0305% ( 1) 00:16:59.161 14.791 - 14.886: 99.0377% ( 1) 00:16:59.161 15.076 - 15.170: 99.0449% ( 1) 00:16:59.161 17.067 - 17.161: 99.0594% ( 2) 00:16:59.161 17.161 - 17.256: 99.0666% ( 1) 00:16:59.161 17.256 - 17.351: 99.0739% ( 1) 00:16:59.161 17.351 - 17.446: 99.0956% ( 3) 00:16:59.161 17.446 - 17.541: 99.1100% ( 2) 00:16:59.161 17.541 - 17.636: 99.1245% ( 2) 00:16:59.161 17.636 - 17.730: 99.1752% ( 7) 00:16:59.161 17.730 - 17.825: 99.2041% ( 4) 00:16:59.161 17.825 - 17.920: 99.2258% ( 3) 00:16:59.161 17.920 - 18.015: 99.2837% ( 8) 00:16:59.161 18.015 - 18.110: 99.3343% ( 7) 00:16:59.161 18.110 - 18.204: 99.3850% ( 7) 00:16:59.161 18.204 - 18.299: 99.4718% ( 12) 00:16:59.161 18.299 - 18.394: 99.5803% ( 15) 00:16:59.161 18.394 - 18.489: 99.6238% ( 6) 00:16:59.161 18.489 - 18.584: 99.6455% ( 3) 00:16:59.161 18.584 - 18.679: 99.6744% ( 4) 00:16:59.161 18.679 - 18.773: 99.6889% ( 2) 00:16:59.161 18.773 - 18.868: 99.6961% ( 1) 00:16:59.161 18.868 - 18.963: 99.7178% ( 3) 00:16:59.161 18.963 - 19.058: 99.7612% ( 6) 00:16:59.161 19.058 - 19.153: 99.7829% ( 3) 00:16:59.161 19.437 - 19.532: 99.7902% ( 1) 00:16:59.161 19.532 - 19.627: 99.8046% ( 2) 00:16:59.161 19.721 - 19.816: 99.8191% ( 2) 00:16:59.161 20.575 - 20.670: 99.8264% ( 1) 00:16:59.161 21.713 - 21.807: 99.8336% ( 1) 00:16:59.161 23.609 - 23.704: 99.8408% ( 1) 00:16:59.161 23.704 - 23.799: 99.8481% ( 1) 00:16:59.161 23.799 - 23.893: 99.8553% ( 1) 00:16:59.161 24.462 - 24.652: 99.8625% ( 1) 00:16:59.161 24.841 - 25.031: 99.8698% ( 1) 00:16:59.161 25.031 - 25.221: 99.8770% ( 1) 00:16:59.161 26.548 - 26.738: 99.8842% ( 1) 00:16:59.161 29.961 - 30.151: 99.8915% ( 1) 00:16:59.161 3980.705 - 4004.978: 99.9494% ( 8) 00:16:59.161 4004.978 - 4029.250: 100.0000% ( 7) 00:16:59.161 00:16:59.161 Complete histogram 00:16:59.161 ================== 00:16:59.161 Range in us Cumulative Count 00:16:59.161 2.027 - 2.039: 0.0289% ( 4) 00:16:59.161 2.039 - 2.050: 4.2544% ( 584) 00:16:59.161 2.050 - 2.062: 8.1904% ( 544) 00:16:59.161 2.062 - 2.074: 11.5694% ( 467) 00:16:59.161 2.074 - 2.086: 44.6422% ( 4571) 00:16:59.161 2.086 - 2.098: 60.3574% ( 2172) 00:16:59.161 2.098 - 2.110: 63.9100% ( 491) 00:16:59.161 2.110 - 2.121: 66.3845% ( 342) 00:16:59.161 2.121 - 2.133: 67.1876% ( 111) 00:16:59.161 2.133 - 2.145: 70.2409% ( 422) 00:16:59.161 2.145 - 2.157: 79.2128% ( 1240) 00:16:59.161 2.157 - 2.169: 82.4325% ( 445) 00:16:59.161 2.169 - 2.181: 84.0026% ( 217) 00:16:59.161 2.181 - 2.193: 85.5293% ( 211) 00:16:59.161 2.193 - 2.204: 86.0502% ( 72) 00:16:59.161 2.204 - 2.216: 87.9965% ( 269) 00:16:59.161 2.216 - 2.228: 92.3595% ( 603) 00:16:59.161 2.228 - 2.240: 93.7993% ( 199) 00:16:59.161 2.240 - 2.252: 94.3492% ( 76) 00:16:59.161 2.252 - 2.264: 94.7471% ( 55) 00:16:59.161 2.264 - 2.276: 94.9208% ( 24) 00:16:59.161 2.276 - 2.287: 95.2970% ( 52) 00:16:59.161 2.287 - 2.299: 95.4851% ( 26) 00:16:59.161 2.299 - 2.311: 95.5285% ( 6) 00:16:59.161 2.311 - 2.323: 95.6154% ( 12) 00:16:59.161 2.323 - 2.335: 95.7384% ( 17) 00:16:59.161 2.335 - 2.347: 95.8614% ( 17) 00:16:59.161 2.347 - 2.359: 96.0495% ( 26) 00:16:59.161 2.359 - 2.370: 96.3389% ( 40) 00:16:59.161 2.370 - 2.382: 96.5704% ( 32) 00:16:59.161 2.382 - 2.394: 96.7658% ( 27) 00:16:59.161 2.394 - 2.406: 96.9973% ( 32) 00:16:59.161 2.406 - 2.418: 97.1420% ( 20) 00:16:59.161 2.418 - 2.430: 97.3084% ( 23) 00:16:59.161 2.430 - 2.441: 97.4459% ( 19) 00:16:59.161 2.441 - 2.453: 97.6340% ( 26) 00:16:59.161 2.453 - 2.465: 97.7209% ( 12) 00:16:59.161 2.465 - 2.477: 97.7932% ( 10) 00:16:59.161 2.477 - 2.489: 97.9017% ( 15) 00:16:59.161 2.489 - 2.501: 97.9741% ( 10) 00:16:59.161 2.501 - 2.513: 98.0175% ( 6) 00:16:59.161 2.513 - 2.524: 98.0609% ( 6) 00:16:59.161 2.524 - 2.536: 98.0971% ( 5) 00:16:59.161 2.536 - 2.548: 98.1116% ( 2) 00:16:59.161 2.548 - 2.560: 98.1405% ( 4) 00:16:59.161 2.560 - 2.572: 98.1550% ( 2) 00:16:59.161 2.572 - 2.584: 98.1767% ( 3) 00:16:59.161 2.584 - 2.596: 98.1839% ( 1) 00:16:59.161 2.596 - 2.607: 98.2056% ( 3) 00:16:59.161 2.619 - 2.631: 98.2201% ( 2) 00:16:59.161 2.631 - 2.643: 98.2273% ( 1) 00:16:59.161 2.643 - 2.655: 98.2490% ( 3) 00:16:59.161 2.655 - 2.667: 98.2707% ( 3) 00:16:59.161 2.702 - 2.714: 98.2852% ( 2) 00:16:59.161 2.726 - 2.738: 98.3069% ( 3) 00:16:59.161 2.750 - 2.761: 98.3142% ( 1) 00:16:59.161 2.761 - 2.773: 98.3214% ( 1) 00:16:59.161 2.785 - 2.797: 98.3286% ( 1) 00:16:59.161 2.797 - 2.809: 98.3431% ( 2) 00:16:59.161 2.833 - 2.844: 98.3503% ( 1) 00:16:59.161 2.844 - 2.856: 98.3576% ( 1) 00:16:59.161 2.856 - 2.868: 98.3720% ( 2) 00:16:59.161 2.880 - 2.892: 98.3793% ( 1) 00:16:59.161 2.892 - 2.904: 98.3865% ( 1) 00:16:59.161 2.916 - 2.927: 98.3937% ( 1) 00:16:59.161 2.939 - 2.951: 98.4155% ( 3) 00:16:59.161 2.963 - 2.975: 98.4227% ( 1) 00:16:59.161 2.987 - 2.999: 98.4299% ( 1) 00:16:59.161 3.010 - 3.022: 98.4372% ( 1) 00:16:59.161 3.034 - 3.058: 98.4516% ( 2) 00:16:59.161 3.058 - 3.081: 98.4589% ( 1) 00:16:59.161 3.081 - 3.105: 98.4661% ( 1) 00:16:59.161 3.105 - 3.129: 98.4733% ( 1) 00:16:59.161 3.200 - 3.224: 98.4806% ( 1) 00:16:59.161 3.224 - 3.247: 98.4950% ( 2) 00:16:59.161 3.342 - 3.366: 98.5095% ( 2) 00:16:59.161 3.366 - 3.390: 98.5312% ( 3) 00:16:59.161 3.413 - 3.437: 98.5457% ( 2) 00:16:59.161 3.461 - 3.484: 98.5529% ( 1) 00:16:59.161 3.484 - 3.508: 98.5602% ( 1) 00:16:59.161 3.508 - 3.532: 98.5746% ( 2) 00:16:59.161 3.556 - 3.579: 98.5891% ( 2) 00:16:59.161 3.650 - 3.674: 98.5963% ( 1) 00:16:59.161 3.698 - 3.721: 98.6253% ( 4) 00:16:59.161 3.745 - 3.769: 98.6325% ( 1) 00:16:59.161 3.769 - 3.793: 98.6398% ( 1) 00:16:59.161 3.816 - 3.840: 98.6470% ( 1) 00:16:59.161 3.864 - 3.887: 98.6542% ( 1) 00:16:59.161 3.982 - 4.006: 98.6615% ( 1) 00:16:59.161 4.124 - 4.148: 98.6687% ( 1) 00:16:59.161 4.409 - 4.433: 98.6759% ( 1) 00:16:59.161 4.646 - 4.670: 98.6832% ( 1) 00:16:59.161 4.717 - 4.741: 98.6904% ( 1) 00:16:59.161 5.310 - 5.333: 98.6976% ( 1) 00:16:59.161 5.736 - 5.760: 98.7049% ( 1) 00:16:59.161 6.258 - 6.305: 98.7121% ( 1) 00:16:59.161 6.684 - 6.732: 98.7193% ( 1) 00:16:59.161 7.301 - 7.348: 98.7266% ( 1) 00:16:59.161 7.396 - 7.443: 98.7338% ( 1) 00:16:59.161 7.633 - 7.680: 98.7410% ( 1) 00:16:59.161 7.680 - 7.727: 98.7628% ( 3) 00:16:59.161 7.775 - 7.822: 98.7700% ( 1) 00:16:59.161 8.012 - 8.059: 98.7772% ( 1) 00:16:59.161 9.244 - 9.292: 98.7845% ( 1) 00:16:59.161 9.861 - 9.908: 98.7917% ( 1) 00:16:59.161 9.956 - 10.003: 98.7989% ( 1) 00:16:59.161 10.193 - 10.240: 98.8062% ( 1) 00:16:59.161 11.046 - 11.093: 98.8134% ( 1) 00:16:59.161 11.473 - 11.520: 98.8206% ( 1) 00:16:59.161 12.326 - 12.421: 98.8279% ( 1) 00:16:59.161 12.705 - 12.800: 98.8351% ( 1) 00:16:59.161 15.644 - 15.739: 98.8496% ( 2) 00:16:59.161 15.739 - 15.834: 98.8568% ( 1) 00:16:59.161 15.834 - 15.929: 98.8785% ( 3) 00:16:59.161 15.929 - 16.024: 98.9002% ( 3) 00:16:59.161 16.024 - 16.119: 98.9364% ( 5) 00:16:59.161 16.119 - 16.213: 98.9653% ( 4) 00:16:59.161 16.213 - 16.308: 99.0088% ( 6) 00:16:59.161 16.308 - 16.403: 99.0522% ( 6) 00:16:59.161 16.403 - 16.498: 99.1028% ( 7) 00:16:59.161 16.498 - 16.593: 99.1390% ( 5) 00:16:59.161 16.593 - 16.687: 99.1679% ( 4) 00:16:59.161 16.687 - 16.782: 99.2186% ( 7) 00:16:59.161 16.782 - 16.877: 99.2475% ( 4) 00:16:59.161 16.877 - 16.972: 99.2837% ( 5) 00:16:59.161 16.972 - 17.067: 99.2982% ( 2) 00:16:59.161 17.067 - 17.161: 99.3199% ( 3) 00:16:59.161 17.161 - 17.256: 99.3271% ( 1) 00:16:59.161 17.351 - 17.446: 99.3416% ( 2) 00:16:59.161 17.636 - 17.730: 99.3488% ( 1) 00:16:59.161 17.920 - 18.015: 99.3561% ( 1) 00:16:59.161 18.204 - 18.299: 99.3633% ( 1) 00:16:59.162 18.299 - 18.394: 99.3705% ( 1) 00:16:59.162 18.489 - 18.584: 99.3778% ( 1) 00:16:59.162 18.679 - 18.773: 99.3922% ( 2) 00:16:59.162 28.255 - 28.444: 99.3995% ( 1) 00:16:59.162 160.806 - 161.564: 99.4067% ( 1) 00:16:59.162 2038.898 - 2051.034: 99.4139% ( 1) 00:16:59.162 3980.705 - 4004.978: 99.7974% ( 53) 00:16:59.162 4004.978 - 4029.250: 99.9855% ( 26) 00:16:59.162 4053.523 - 4077.796: 99.9928% ( 1) 00:16:59.162 5000.154 - 5024.427: 100.0000% ( 1) 00:16:59.162 00:16:59.162 16:41:24 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:59.162 16:41:24 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:59.162 16:41:24 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:59.162 16:41:24 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:59.162 16:41:24 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:59.420 [ 00:16:59.420 { 00:16:59.420 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:59.420 "subtype": "Discovery", 00:16:59.420 "listen_addresses": [], 00:16:59.420 "allow_any_host": true, 00:16:59.420 "hosts": [] 00:16:59.420 }, 00:16:59.420 { 00:16:59.420 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:59.420 "subtype": "NVMe", 00:16:59.420 "listen_addresses": [ 00:16:59.420 { 00:16:59.420 "transport": "VFIOUSER", 00:16:59.420 "trtype": "VFIOUSER", 00:16:59.420 "adrfam": "IPv4", 00:16:59.420 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:59.420 "trsvcid": "0" 00:16:59.420 } 00:16:59.420 ], 00:16:59.420 "allow_any_host": true, 00:16:59.420 "hosts": [], 00:16:59.420 "serial_number": "SPDK1", 00:16:59.420 "model_number": "SPDK bdev Controller", 00:16:59.420 "max_namespaces": 32, 00:16:59.420 "min_cntlid": 1, 00:16:59.420 "max_cntlid": 65519, 00:16:59.420 "namespaces": [ 00:16:59.420 { 00:16:59.420 "nsid": 1, 00:16:59.420 "bdev_name": "Malloc1", 00:16:59.420 "name": "Malloc1", 00:16:59.420 "nguid": "771AE7C0AE894163A87695A5F003C563", 00:16:59.420 "uuid": "771ae7c0-ae89-4163-a876-95a5f003c563" 00:16:59.420 }, 00:16:59.420 { 00:16:59.420 "nsid": 2, 00:16:59.420 "bdev_name": "Malloc3", 00:16:59.420 "name": "Malloc3", 00:16:59.420 "nguid": "0AD2C043D2214674A9B2F8841CB1CD2D", 00:16:59.420 "uuid": "0ad2c043-d221-4674-a9b2-f8841cb1cd2d" 00:16:59.420 } 00:16:59.420 ] 00:16:59.420 }, 00:16:59.420 { 00:16:59.420 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:59.420 "subtype": "NVMe", 00:16:59.420 "listen_addresses": [ 00:16:59.420 { 00:16:59.420 "transport": "VFIOUSER", 00:16:59.420 "trtype": "VFIOUSER", 00:16:59.420 "adrfam": "IPv4", 00:16:59.420 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:59.420 "trsvcid": "0" 00:16:59.420 } 00:16:59.420 ], 00:16:59.420 "allow_any_host": true, 00:16:59.420 "hosts": [], 00:16:59.420 "serial_number": "SPDK2", 00:16:59.420 "model_number": "SPDK bdev Controller", 00:16:59.420 "max_namespaces": 32, 00:16:59.420 "min_cntlid": 1, 00:16:59.420 "max_cntlid": 65519, 00:16:59.420 "namespaces": [ 00:16:59.420 { 00:16:59.420 "nsid": 1, 00:16:59.420 "bdev_name": "Malloc2", 00:16:59.420 "name": "Malloc2", 00:16:59.420 "nguid": "93EA687F5AAA495292CD2DC046339FBB", 00:16:59.420 "uuid": "93ea687f-5aaa-4952-92cd-2dc046339fbb" 00:16:59.420 } 00:16:59.420 ] 00:16:59.420 } 00:16:59.420 ] 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1178818 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:59.420 16:41:24 -- common/autotest_common.sh@1244 -- # local i=0 00:16:59.420 16:41:24 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:59.420 16:41:24 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:59.420 16:41:24 -- common/autotest_common.sh@1255 -- # return 0 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:59.420 16:41:24 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:59.679 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.679 Malloc4 00:16:59.679 16:41:25 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:59.937 16:41:25 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:17:00.196 Asynchronous Event Request test 00:17:00.196 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:17:00.196 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:17:00.196 Registering asynchronous event callbacks... 00:17:00.196 Starting namespace attribute notice tests for all controllers... 00:17:00.196 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:17:00.196 aer_cb - Changed Namespace 00:17:00.196 Cleaning up... 00:17:00.196 [ 00:17:00.196 { 00:17:00.196 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:00.196 "subtype": "Discovery", 00:17:00.196 "listen_addresses": [], 00:17:00.196 "allow_any_host": true, 00:17:00.196 "hosts": [] 00:17:00.196 }, 00:17:00.196 { 00:17:00.196 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:17:00.196 "subtype": "NVMe", 00:17:00.196 "listen_addresses": [ 00:17:00.196 { 00:17:00.196 "transport": "VFIOUSER", 00:17:00.196 "trtype": "VFIOUSER", 00:17:00.196 "adrfam": "IPv4", 00:17:00.196 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:17:00.196 "trsvcid": "0" 00:17:00.196 } 00:17:00.196 ], 00:17:00.196 "allow_any_host": true, 00:17:00.196 "hosts": [], 00:17:00.196 "serial_number": "SPDK1", 00:17:00.196 "model_number": "SPDK bdev Controller", 00:17:00.196 "max_namespaces": 32, 00:17:00.196 "min_cntlid": 1, 00:17:00.196 "max_cntlid": 65519, 00:17:00.196 "namespaces": [ 00:17:00.196 { 00:17:00.196 "nsid": 1, 00:17:00.196 "bdev_name": "Malloc1", 00:17:00.196 "name": "Malloc1", 00:17:00.196 "nguid": "771AE7C0AE894163A87695A5F003C563", 00:17:00.196 "uuid": "771ae7c0-ae89-4163-a876-95a5f003c563" 00:17:00.196 }, 00:17:00.196 { 00:17:00.196 "nsid": 2, 00:17:00.196 "bdev_name": "Malloc3", 00:17:00.196 "name": "Malloc3", 00:17:00.196 "nguid": "0AD2C043D2214674A9B2F8841CB1CD2D", 00:17:00.196 "uuid": "0ad2c043-d221-4674-a9b2-f8841cb1cd2d" 00:17:00.196 } 00:17:00.196 ] 00:17:00.196 }, 00:17:00.196 { 00:17:00.196 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:17:00.196 "subtype": "NVMe", 00:17:00.196 "listen_addresses": [ 00:17:00.196 { 00:17:00.196 "transport": "VFIOUSER", 00:17:00.196 "trtype": "VFIOUSER", 00:17:00.196 "adrfam": "IPv4", 00:17:00.196 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:17:00.196 "trsvcid": "0" 00:17:00.196 } 00:17:00.196 ], 00:17:00.196 "allow_any_host": true, 00:17:00.196 "hosts": [], 00:17:00.196 "serial_number": "SPDK2", 00:17:00.196 "model_number": "SPDK bdev Controller", 00:17:00.196 "max_namespaces": 32, 00:17:00.196 "min_cntlid": 1, 00:17:00.196 "max_cntlid": 65519, 00:17:00.196 "namespaces": [ 00:17:00.196 { 00:17:00.196 "nsid": 1, 00:17:00.196 "bdev_name": "Malloc2", 00:17:00.196 "name": "Malloc2", 00:17:00.196 "nguid": "93EA687F5AAA495292CD2DC046339FBB", 00:17:00.196 "uuid": "93ea687f-5aaa-4952-92cd-2dc046339fbb" 00:17:00.196 }, 00:17:00.196 { 00:17:00.196 "nsid": 2, 00:17:00.196 "bdev_name": "Malloc4", 00:17:00.196 "name": "Malloc4", 00:17:00.196 "nguid": "BBE97402A3D645CBBF7F180E94E87E69", 00:17:00.196 "uuid": "bbe97402-a3d6-45cb-bf7f-180e94e87e69" 00:17:00.196 } 00:17:00.196 ] 00:17:00.196 } 00:17:00.196 ] 00:17:00.196 16:41:25 -- target/nvmf_vfio_user.sh@44 -- # wait 1178818 00:17:00.455 16:41:25 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:17:00.455 16:41:25 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1172931 00:17:00.455 16:41:25 -- common/autotest_common.sh@926 -- # '[' -z 1172931 ']' 00:17:00.455 16:41:25 -- common/autotest_common.sh@930 -- # kill -0 1172931 00:17:00.455 16:41:25 -- common/autotest_common.sh@931 -- # uname 00:17:00.455 16:41:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:00.455 16:41:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1172931 00:17:00.455 16:41:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:00.455 16:41:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:00.455 16:41:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1172931' 00:17:00.455 killing process with pid 1172931 00:17:00.455 16:41:25 -- common/autotest_common.sh@945 -- # kill 1172931 00:17:00.455 [2024-10-13 16:41:25.736452] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:17:00.455 16:41:25 -- common/autotest_common.sh@950 -- # wait 1172931 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1178969 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1178969' 00:17:00.714 Process pid: 1178969 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:17:00.714 16:41:26 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1178969 00:17:00.714 16:41:26 -- common/autotest_common.sh@819 -- # '[' -z 1178969 ']' 00:17:00.714 16:41:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:00.714 16:41:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:00.714 16:41:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:00.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:00.714 16:41:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:00.714 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:17:00.714 [2024-10-13 16:41:26.090851] thread.c:2927:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:17:00.714 [2024-10-13 16:41:26.091927] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:00.714 [2024-10-13 16:41:26.091987] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:00.714 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.714 [2024-10-13 16:41:26.154744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:00.972 [2024-10-13 16:41:26.242313] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:00.972 [2024-10-13 16:41:26.242479] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:00.972 [2024-10-13 16:41:26.242500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:00.972 [2024-10-13 16:41:26.242514] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:00.972 [2024-10-13 16:41:26.242596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:00.972 [2024-10-13 16:41:26.242653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.972 [2024-10-13 16:41:26.242771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:00.972 [2024-10-13 16:41:26.242774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:00.972 [2024-10-13 16:41:26.338748] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:17:00.972 [2024-10-13 16:41:26.338998] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:17:00.972 [2024-10-13 16:41:26.339279] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:17:00.972 [2024-10-13 16:41:26.340053] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:17:00.972 [2024-10-13 16:41:26.340165] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:17:01.911 16:41:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:01.911 16:41:27 -- common/autotest_common.sh@852 -- # return 0 00:17:01.911 16:41:27 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:17:02.568 16:41:28 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:17:03.133 Malloc1 00:17:03.133 16:41:28 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:17:03.392 16:41:28 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:17:03.650 16:41:29 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:17:04.216 16:41:29 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:17:04.216 16:41:29 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:17:04.216 16:41:29 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:17:04.216 Malloc2 00:17:04.216 16:41:29 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:17:04.473 16:41:29 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:17:04.731 16:41:30 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:17:04.989 16:41:30 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:17:04.989 16:41:30 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1178969 00:17:04.989 16:41:30 -- common/autotest_common.sh@926 -- # '[' -z 1178969 ']' 00:17:04.989 16:41:30 -- common/autotest_common.sh@930 -- # kill -0 1178969 00:17:04.989 16:41:30 -- common/autotest_common.sh@931 -- # uname 00:17:04.989 16:41:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:04.989 16:41:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1178969 00:17:05.247 16:41:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:05.247 16:41:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:05.247 16:41:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1178969' 00:17:05.247 killing process with pid 1178969 00:17:05.247 16:41:30 -- common/autotest_common.sh@945 -- # kill 1178969 00:17:05.247 16:41:30 -- common/autotest_common.sh@950 -- # wait 1178969 00:17:05.506 16:41:30 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:17:05.506 16:41:30 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:17:05.506 00:17:05.506 real 0m53.981s 00:17:05.506 user 3m33.844s 00:17:05.506 sys 0m4.482s 00:17:05.506 16:41:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:05.506 16:41:30 -- common/autotest_common.sh@10 -- # set +x 00:17:05.506 ************************************ 00:17:05.506 END TEST nvmf_vfio_user 00:17:05.506 ************************************ 00:17:05.506 16:41:30 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:17:05.506 16:41:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:05.506 16:41:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:05.506 16:41:30 -- common/autotest_common.sh@10 -- # set +x 00:17:05.506 ************************************ 00:17:05.506 START TEST nvmf_vfio_user_nvme_compliance 00:17:05.506 ************************************ 00:17:05.506 16:41:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:17:05.506 * Looking for test storage... 00:17:05.506 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:17:05.506 16:41:30 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:05.506 16:41:30 -- nvmf/common.sh@7 -- # uname -s 00:17:05.506 16:41:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:05.506 16:41:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:05.506 16:41:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:05.506 16:41:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:05.506 16:41:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:05.506 16:41:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:05.506 16:41:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:05.506 16:41:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:05.506 16:41:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:05.506 16:41:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:05.506 16:41:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.506 16:41:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.506 16:41:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:05.506 16:41:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:05.506 16:41:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:05.506 16:41:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:05.506 16:41:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:05.506 16:41:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:05.506 16:41:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:05.507 16:41:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.507 16:41:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.507 16:41:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.507 16:41:30 -- paths/export.sh@5 -- # export PATH 00:17:05.507 16:41:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.507 16:41:30 -- nvmf/common.sh@46 -- # : 0 00:17:05.507 16:41:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:05.507 16:41:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:05.507 16:41:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:05.507 16:41:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:05.507 16:41:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:05.507 16:41:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:05.507 16:41:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:05.507 16:41:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:05.507 16:41:30 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:05.507 16:41:30 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:05.507 16:41:30 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:17:05.507 16:41:30 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:17:05.507 16:41:30 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:17:05.507 16:41:30 -- compliance/compliance.sh@20 -- # nvmfpid=1179588 00:17:05.507 16:41:30 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:05.507 16:41:30 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1179588' 00:17:05.507 Process pid: 1179588 00:17:05.507 16:41:30 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:17:05.507 16:41:30 -- compliance/compliance.sh@24 -- # waitforlisten 1179588 00:17:05.507 16:41:30 -- common/autotest_common.sh@819 -- # '[' -z 1179588 ']' 00:17:05.507 16:41:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:05.507 16:41:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:05.507 16:41:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:05.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:05.507 16:41:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:05.507 16:41:30 -- common/autotest_common.sh@10 -- # set +x 00:17:05.507 [2024-10-13 16:41:30.940984] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:05.507 [2024-10-13 16:41:30.941064] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:05.507 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.507 [2024-10-13 16:41:31.001176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:05.765 [2024-10-13 16:41:31.084628] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:05.765 [2024-10-13 16:41:31.084787] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:05.765 [2024-10-13 16:41:31.084805] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:05.766 [2024-10-13 16:41:31.084818] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:05.766 [2024-10-13 16:41:31.084892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:05.766 [2024-10-13 16:41:31.084953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:05.766 [2024-10-13 16:41:31.084957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:06.700 16:41:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:06.700 16:41:31 -- common/autotest_common.sh@852 -- # return 0 00:17:06.700 16:41:31 -- compliance/compliance.sh@26 -- # sleep 1 00:17:07.633 16:41:32 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:17:07.633 16:41:32 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:17:07.633 16:41:32 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:17:07.633 16:41:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:07.633 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:17:07.633 16:41:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:07.633 16:41:32 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:17:07.633 16:41:32 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:17:07.633 16:41:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:07.633 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:17:07.633 malloc0 00:17:07.633 16:41:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:07.633 16:41:32 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:17:07.633 16:41:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:07.633 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:17:07.633 16:41:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:07.633 16:41:32 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:17:07.633 16:41:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:07.633 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:17:07.633 16:41:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:07.633 16:41:32 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:17:07.633 16:41:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:07.633 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:17:07.633 16:41:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:07.633 16:41:32 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:17:07.633 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.633 00:17:07.633 00:17:07.633 CUnit - A unit testing framework for C - Version 2.1-3 00:17:07.633 http://cunit.sourceforge.net/ 00:17:07.633 00:17:07.633 00:17:07.633 Suite: nvme_compliance 00:17:07.633 Test: admin_identify_ctrlr_verify_dptr ...[2024-10-13 16:41:33.106427] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:17:07.633 [2024-10-13 16:41:33.106505] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:17:07.633 [2024-10-13 16:41:33.106536] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:17:07.891 passed 00:17:07.891 Test: admin_identify_ctrlr_verify_fused ...passed 00:17:07.891 Test: admin_identify_ns ...[2024-10-13 16:41:33.342426] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:17:07.891 [2024-10-13 16:41:33.350421] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:17:08.148 passed 00:17:08.148 Test: admin_get_features_mandatory_features ...passed 00:17:08.148 Test: admin_get_features_optional_features ...passed 00:17:08.406 Test: admin_set_features_number_of_queues ...passed 00:17:08.406 Test: admin_get_log_page_mandatory_logs ...passed 00:17:08.664 Test: admin_get_log_page_with_lpo ...[2024-10-13 16:41:33.971409] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:17:08.664 passed 00:17:08.664 Test: fabric_property_get ...passed 00:17:08.664 Test: admin_delete_io_sq_use_admin_qid ...[2024-10-13 16:41:34.154163] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:17:08.922 passed 00:17:08.922 Test: admin_delete_io_sq_delete_sq_twice ...[2024-10-13 16:41:34.325420] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:17:08.922 [2024-10-13 16:41:34.341416] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:17:08.922 passed 00:17:09.180 Test: admin_delete_io_cq_use_admin_qid ...[2024-10-13 16:41:34.429247] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:17:09.180 passed 00:17:09.180 Test: admin_delete_io_cq_delete_cq_first ...[2024-10-13 16:41:34.590423] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:17:09.180 [2024-10-13 16:41:34.614424] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:17:09.180 passed 00:17:09.438 Test: admin_create_io_cq_verify_iv_pc ...[2024-10-13 16:41:34.704276] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:17:09.438 [2024-10-13 16:41:34.704330] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:17:09.438 passed 00:17:09.438 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-10-13 16:41:34.881407] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:17:09.438 [2024-10-13 16:41:34.889401] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:17:09.438 [2024-10-13 16:41:34.897406] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:17:09.438 [2024-10-13 16:41:34.905421] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:17:09.695 passed 00:17:09.695 Test: admin_create_io_sq_verify_pc ...[2024-10-13 16:41:35.036434] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:17:09.695 passed 00:17:11.069 Test: admin_create_io_qp_max_qps ...[2024-10-13 16:41:36.249424] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:17:11.326 passed 00:17:11.584 Test: admin_create_io_sq_shared_cq ...[2024-10-13 16:41:36.834419] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:17:11.584 passed 00:17:11.584 00:17:11.584 Run Summary: Type Total Ran Passed Failed Inactive 00:17:11.584 suites 1 1 n/a 0 0 00:17:11.584 tests 18 18 18 0 0 00:17:11.584 asserts 360 360 360 0 n/a 00:17:11.584 00:17:11.584 Elapsed time = 1.560 seconds 00:17:11.584 16:41:36 -- compliance/compliance.sh@42 -- # killprocess 1179588 00:17:11.584 16:41:36 -- common/autotest_common.sh@926 -- # '[' -z 1179588 ']' 00:17:11.584 16:41:36 -- common/autotest_common.sh@930 -- # kill -0 1179588 00:17:11.584 16:41:36 -- common/autotest_common.sh@931 -- # uname 00:17:11.584 16:41:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:11.584 16:41:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1179588 00:17:11.584 16:41:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:11.584 16:41:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:11.584 16:41:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1179588' 00:17:11.584 killing process with pid 1179588 00:17:11.584 16:41:36 -- common/autotest_common.sh@945 -- # kill 1179588 00:17:11.584 16:41:36 -- common/autotest_common.sh@950 -- # wait 1179588 00:17:11.843 16:41:37 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:17:11.843 16:41:37 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:17:11.843 00:17:11.843 real 0m6.384s 00:17:11.843 user 0m18.320s 00:17:11.843 sys 0m0.579s 00:17:11.843 16:41:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:11.843 16:41:37 -- common/autotest_common.sh@10 -- # set +x 00:17:11.843 ************************************ 00:17:11.843 END TEST nvmf_vfio_user_nvme_compliance 00:17:11.843 ************************************ 00:17:11.843 16:41:37 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:17:11.843 16:41:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:11.843 16:41:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:11.843 16:41:37 -- common/autotest_common.sh@10 -- # set +x 00:17:11.843 ************************************ 00:17:11.843 START TEST nvmf_vfio_user_fuzz 00:17:11.843 ************************************ 00:17:11.843 16:41:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:17:11.843 * Looking for test storage... 00:17:11.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.843 16:41:37 -- nvmf/common.sh@7 -- # uname -s 00:17:11.843 16:41:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.843 16:41:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.843 16:41:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.843 16:41:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.843 16:41:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.843 16:41:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.843 16:41:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.843 16:41:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.843 16:41:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.843 16:41:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.843 16:41:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.843 16:41:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.843 16:41:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.843 16:41:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.843 16:41:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.843 16:41:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.843 16:41:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.843 16:41:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.843 16:41:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.843 16:41:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.843 16:41:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.843 16:41:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.843 16:41:37 -- paths/export.sh@5 -- # export PATH 00:17:11.843 16:41:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.843 16:41:37 -- nvmf/common.sh@46 -- # : 0 00:17:11.843 16:41:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.843 16:41:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.843 16:41:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.843 16:41:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.843 16:41:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.843 16:41:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.843 16:41:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.843 16:41:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1180473 00:17:11.843 16:41:37 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:11.844 16:41:37 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1180473' 00:17:11.844 Process pid: 1180473 00:17:11.844 16:41:37 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:17:11.844 16:41:37 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1180473 00:17:11.844 16:41:37 -- common/autotest_common.sh@819 -- # '[' -z 1180473 ']' 00:17:11.844 16:41:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:11.844 16:41:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:11.844 16:41:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:11.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:11.844 16:41:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:11.844 16:41:37 -- common/autotest_common.sh@10 -- # set +x 00:17:13.216 16:41:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:13.216 16:41:38 -- common/autotest_common.sh@852 -- # return 0 00:17:13.216 16:41:38 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:17:14.149 16:41:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:14.149 16:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:14.149 16:41:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:17:14.149 16:41:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:14.149 16:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:14.149 malloc0 00:17:14.149 16:41:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:17:14.149 16:41:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:14.149 16:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:14.149 16:41:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:17:14.149 16:41:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:14.149 16:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:14.149 16:41:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:17:14.149 16:41:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:14.149 16:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:14.149 16:41:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:17:14.149 16:41:39 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:46.218 Fuzzing completed. Shutting down the fuzz application 00:17:46.218 00:17:46.218 Dumping successful admin opcodes: 00:17:46.218 8, 9, 10, 24, 00:17:46.218 Dumping successful io opcodes: 00:17:46.218 0, 00:17:46.218 NS: 0x200003a1ef00 I/O qp, Total commands completed: 645665, total successful commands: 2505, random_seed: 2125934720 00:17:46.218 NS: 0x200003a1ef00 admin qp, Total commands completed: 159853, total successful commands: 1289, random_seed: 412644160 00:17:46.218 16:42:10 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:46.218 16:42:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:46.218 16:42:10 -- common/autotest_common.sh@10 -- # set +x 00:17:46.218 16:42:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:46.218 16:42:10 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1180473 00:17:46.218 16:42:10 -- common/autotest_common.sh@926 -- # '[' -z 1180473 ']' 00:17:46.218 16:42:10 -- common/autotest_common.sh@930 -- # kill -0 1180473 00:17:46.218 16:42:10 -- common/autotest_common.sh@931 -- # uname 00:17:46.218 16:42:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:46.218 16:42:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1180473 00:17:46.218 16:42:10 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:46.218 16:42:10 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:46.218 16:42:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1180473' 00:17:46.218 killing process with pid 1180473 00:17:46.218 16:42:10 -- common/autotest_common.sh@945 -- # kill 1180473 00:17:46.218 16:42:10 -- common/autotest_common.sh@950 -- # wait 1180473 00:17:46.218 16:42:10 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:46.218 16:42:10 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:46.218 00:17:46.218 real 0m33.457s 00:17:46.218 user 0m35.032s 00:17:46.218 sys 0m23.394s 00:17:46.218 16:42:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:46.218 16:42:10 -- common/autotest_common.sh@10 -- # set +x 00:17:46.218 ************************************ 00:17:46.218 END TEST nvmf_vfio_user_fuzz 00:17:46.218 ************************************ 00:17:46.218 16:42:10 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:46.218 16:42:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:46.218 16:42:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:46.218 16:42:10 -- common/autotest_common.sh@10 -- # set +x 00:17:46.218 ************************************ 00:17:46.218 START TEST nvmf_host_management 00:17:46.218 ************************************ 00:17:46.218 16:42:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:46.218 * Looking for test storage... 00:17:46.218 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:46.218 16:42:10 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:46.218 16:42:10 -- nvmf/common.sh@7 -- # uname -s 00:17:46.218 16:42:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:46.218 16:42:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:46.218 16:42:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:46.218 16:42:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:46.218 16:42:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:46.218 16:42:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:46.218 16:42:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:46.218 16:42:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:46.218 16:42:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:46.218 16:42:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:46.218 16:42:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:46.218 16:42:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:46.218 16:42:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:46.218 16:42:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:46.218 16:42:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:46.218 16:42:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:46.218 16:42:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:46.218 16:42:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:46.218 16:42:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:46.218 16:42:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.218 16:42:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.218 16:42:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.218 16:42:10 -- paths/export.sh@5 -- # export PATH 00:17:46.218 16:42:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.218 16:42:10 -- nvmf/common.sh@46 -- # : 0 00:17:46.218 16:42:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:46.218 16:42:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:46.218 16:42:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:46.218 16:42:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:46.218 16:42:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:46.218 16:42:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:46.218 16:42:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:46.218 16:42:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:46.218 16:42:10 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:46.218 16:42:10 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:46.218 16:42:10 -- target/host_management.sh@104 -- # nvmftestinit 00:17:46.218 16:42:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:46.218 16:42:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:46.218 16:42:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:46.218 16:42:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:46.218 16:42:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:46.218 16:42:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:46.218 16:42:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:46.218 16:42:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:46.218 16:42:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:46.218 16:42:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:46.218 16:42:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:46.218 16:42:10 -- common/autotest_common.sh@10 -- # set +x 00:17:47.594 16:42:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:47.594 16:42:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:47.594 16:42:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:47.594 16:42:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:47.594 16:42:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:47.594 16:42:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:47.594 16:42:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:47.594 16:42:12 -- nvmf/common.sh@294 -- # net_devs=() 00:17:47.594 16:42:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:47.594 16:42:12 -- nvmf/common.sh@295 -- # e810=() 00:17:47.594 16:42:12 -- nvmf/common.sh@295 -- # local -ga e810 00:17:47.594 16:42:12 -- nvmf/common.sh@296 -- # x722=() 00:17:47.594 16:42:12 -- nvmf/common.sh@296 -- # local -ga x722 00:17:47.594 16:42:12 -- nvmf/common.sh@297 -- # mlx=() 00:17:47.594 16:42:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:47.594 16:42:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:47.594 16:42:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:47.594 16:42:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:47.594 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:47.594 16:42:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:47.594 16:42:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:47.594 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:47.594 16:42:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:47.594 16:42:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.594 16:42:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.594 16:42:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:47.594 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:47.594 16:42:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:47.594 16:42:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.594 16:42:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.594 16:42:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:47.594 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:47.594 16:42:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:47.594 16:42:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:47.594 16:42:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:47.594 16:42:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:47.594 16:42:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:47.594 16:42:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:47.594 16:42:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:47.594 16:42:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:47.594 16:42:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:47.594 16:42:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:47.594 16:42:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:47.594 16:42:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:47.594 16:42:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:47.594 16:42:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:47.594 16:42:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:47.594 16:42:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:47.594 16:42:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:47.594 16:42:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:47.594 16:42:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:47.594 16:42:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:47.594 16:42:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:47.594 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:47.594 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:17:47.594 00:17:47.594 --- 10.0.0.2 ping statistics --- 00:17:47.594 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.594 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:17:47.594 16:42:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:47.594 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:47.594 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:17:47.594 00:17:47.594 --- 10.0.0.1 ping statistics --- 00:17:47.594 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.594 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:17:47.594 16:42:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:47.594 16:42:12 -- nvmf/common.sh@410 -- # return 0 00:17:47.594 16:42:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:47.594 16:42:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:47.594 16:42:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:47.594 16:42:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:47.594 16:42:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:47.594 16:42:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:47.594 16:42:12 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:47.594 16:42:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:17:47.594 16:42:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:47.594 16:42:12 -- common/autotest_common.sh@10 -- # set +x 00:17:47.594 ************************************ 00:17:47.594 START TEST nvmf_host_management 00:17:47.594 ************************************ 00:17:47.594 16:42:13 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:17:47.594 16:42:13 -- target/host_management.sh@69 -- # starttarget 00:17:47.594 16:42:13 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:47.594 16:42:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:47.594 16:42:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:47.594 16:42:13 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 16:42:13 -- nvmf/common.sh@469 -- # nvmfpid=1186677 00:17:47.595 16:42:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:47.595 16:42:13 -- nvmf/common.sh@470 -- # waitforlisten 1186677 00:17:47.595 16:42:13 -- common/autotest_common.sh@819 -- # '[' -z 1186677 ']' 00:17:47.595 16:42:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.595 16:42:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:47.595 16:42:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.595 16:42:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:47.595 16:42:13 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 [2024-10-13 16:42:13.052311] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:47.595 [2024-10-13 16:42:13.052400] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.595 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.853 [2024-10-13 16:42:13.120125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:47.853 [2024-10-13 16:42:13.213679] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:47.853 [2024-10-13 16:42:13.213831] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:47.853 [2024-10-13 16:42:13.213848] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:47.853 [2024-10-13 16:42:13.213860] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:47.853 [2024-10-13 16:42:13.213921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.853 [2024-10-13 16:42:13.213981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:47.853 [2024-10-13 16:42:13.214041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:47.853 [2024-10-13 16:42:13.214043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:48.786 16:42:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:48.786 16:42:14 -- common/autotest_common.sh@852 -- # return 0 00:17:48.786 16:42:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:48.786 16:42:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 16:42:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:48.786 16:42:14 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:48.786 16:42:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 [2024-10-13 16:42:14.068130] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:48.786 16:42:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:48.786 16:42:14 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:48.786 16:42:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 16:42:14 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:48.786 16:42:14 -- target/host_management.sh@23 -- # cat 00:17:48.786 16:42:14 -- target/host_management.sh@30 -- # rpc_cmd 00:17:48.786 16:42:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 Malloc0 00:17:48.786 [2024-10-13 16:42:14.127106] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.786 16:42:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:48.786 16:42:14 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:48.786 16:42:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 16:42:14 -- target/host_management.sh@73 -- # perfpid=1186856 00:17:48.786 16:42:14 -- target/host_management.sh@74 -- # waitforlisten 1186856 /var/tmp/bdevperf.sock 00:17:48.786 16:42:14 -- common/autotest_common.sh@819 -- # '[' -z 1186856 ']' 00:17:48.786 16:42:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.786 16:42:14 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:48.786 16:42:14 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:48.786 16:42:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:48.786 16:42:14 -- nvmf/common.sh@520 -- # config=() 00:17:48.786 16:42:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.786 16:42:14 -- nvmf/common.sh@520 -- # local subsystem config 00:17:48.786 16:42:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:48.786 16:42:14 -- common/autotest_common.sh@10 -- # set +x 00:17:48.786 16:42:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:48.786 16:42:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:48.786 { 00:17:48.786 "params": { 00:17:48.786 "name": "Nvme$subsystem", 00:17:48.786 "trtype": "$TEST_TRANSPORT", 00:17:48.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:48.786 "adrfam": "ipv4", 00:17:48.786 "trsvcid": "$NVMF_PORT", 00:17:48.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:48.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:48.786 "hdgst": ${hdgst:-false}, 00:17:48.786 "ddgst": ${ddgst:-false} 00:17:48.786 }, 00:17:48.786 "method": "bdev_nvme_attach_controller" 00:17:48.786 } 00:17:48.786 EOF 00:17:48.786 )") 00:17:48.786 16:42:14 -- nvmf/common.sh@542 -- # cat 00:17:48.786 16:42:14 -- nvmf/common.sh@544 -- # jq . 00:17:48.786 16:42:14 -- nvmf/common.sh@545 -- # IFS=, 00:17:48.786 16:42:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:48.786 "params": { 00:17:48.786 "name": "Nvme0", 00:17:48.786 "trtype": "tcp", 00:17:48.786 "traddr": "10.0.0.2", 00:17:48.786 "adrfam": "ipv4", 00:17:48.786 "trsvcid": "4420", 00:17:48.786 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:48.786 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:48.786 "hdgst": false, 00:17:48.786 "ddgst": false 00:17:48.786 }, 00:17:48.786 "method": "bdev_nvme_attach_controller" 00:17:48.786 }' 00:17:48.786 [2024-10-13 16:42:14.196851] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:48.786 [2024-10-13 16:42:14.196931] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1186856 ] 00:17:48.786 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.786 [2024-10-13 16:42:14.258074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.045 [2024-10-13 16:42:14.343289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:49.302 Running I/O for 10 seconds... 00:17:49.870 16:42:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:49.870 16:42:15 -- common/autotest_common.sh@852 -- # return 0 00:17:49.870 16:42:15 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:49.870 16:42:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:49.870 16:42:15 -- common/autotest_common.sh@10 -- # set +x 00:17:49.870 16:42:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:49.870 16:42:15 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:49.870 16:42:15 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:49.870 16:42:15 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:49.870 16:42:15 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:49.870 16:42:15 -- target/host_management.sh@52 -- # local ret=1 00:17:49.870 16:42:15 -- target/host_management.sh@53 -- # local i 00:17:49.870 16:42:15 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:49.870 16:42:15 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:49.870 16:42:15 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:49.870 16:42:15 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:49.870 16:42:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:49.870 16:42:15 -- common/autotest_common.sh@10 -- # set +x 00:17:49.870 16:42:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:49.870 16:42:15 -- target/host_management.sh@55 -- # read_io_count=2439 00:17:49.870 16:42:15 -- target/host_management.sh@58 -- # '[' 2439 -ge 100 ']' 00:17:49.870 16:42:15 -- target/host_management.sh@59 -- # ret=0 00:17:49.870 16:42:15 -- target/host_management.sh@60 -- # break 00:17:49.870 16:42:15 -- target/host_management.sh@64 -- # return 0 00:17:49.870 16:42:15 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:49.870 16:42:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:49.870 16:42:15 -- common/autotest_common.sh@10 -- # set +x 00:17:49.870 [2024-10-13 16:42:15.226972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227153] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227286] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.870 [2024-10-13 16:42:15.227422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227455] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x117fad0 is same with the state(5) to be set 00:17:49.871 [2024-10-13 16:42:15.227900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.227945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.227976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.227993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.228978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.871 [2024-10-13 16:42:15.228992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.871 [2024-10-13 16:42:15.229006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.872 [2024-10-13 16:42:15.229868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.872 [2024-10-13 16:42:15.229963] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x24e8630 was disconnected and freed. reset controller. 00:17:49.872 [2024-10-13 16:42:15.231135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:49.872 16:42:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:49.872 16:42:15 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:49.872 16:42:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:49.872 16:42:15 -- common/autotest_common.sh@10 -- # set +x 00:17:49.872 task offset: 72448 on job bdev=Nvme0n1 fails 00:17:49.872 00:17:49.872 Latency(us) 00:17:49.872 [2024-10-13T14:42:15.373Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.872 [2024-10-13T14:42:15.373Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:49.872 [2024-10-13T14:42:15.373Z] Job: Nvme0n1 ended in about 0.67 seconds with error 00:17:49.872 Verification LBA range: start 0x0 length 0x400 00:17:49.872 Nvme0n1 : 0.67 3893.69 243.36 95.99 0.00 15804.88 2427.26 21845.33 00:17:49.872 [2024-10-13T14:42:15.373Z] =================================================================================================================== 00:17:49.872 [2024-10-13T14:42:15.373Z] Total : 3893.69 243.36 95.99 0.00 15804.88 2427.26 21845.33 00:17:49.872 [2024-10-13 16:42:15.233061] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:49.872 [2024-10-13 16:42:15.233092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24ee1d0 (9): Bad file descriptor 00:17:49.872 16:42:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:49.872 16:42:15 -- target/host_management.sh@87 -- # sleep 1 00:17:49.872 [2024-10-13 16:42:15.365522] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:50.805 16:42:16 -- target/host_management.sh@91 -- # kill -9 1186856 00:17:50.805 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1186856) - No such process 00:17:50.805 16:42:16 -- target/host_management.sh@91 -- # true 00:17:50.805 16:42:16 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:50.805 16:42:16 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:50.805 16:42:16 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:50.805 16:42:16 -- nvmf/common.sh@520 -- # config=() 00:17:50.805 16:42:16 -- nvmf/common.sh@520 -- # local subsystem config 00:17:50.805 16:42:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:50.805 16:42:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:50.805 { 00:17:50.805 "params": { 00:17:50.805 "name": "Nvme$subsystem", 00:17:50.805 "trtype": "$TEST_TRANSPORT", 00:17:50.805 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:50.805 "adrfam": "ipv4", 00:17:50.805 "trsvcid": "$NVMF_PORT", 00:17:50.805 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:50.805 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:50.805 "hdgst": ${hdgst:-false}, 00:17:50.805 "ddgst": ${ddgst:-false} 00:17:50.805 }, 00:17:50.805 "method": "bdev_nvme_attach_controller" 00:17:50.805 } 00:17:50.805 EOF 00:17:50.805 )") 00:17:50.805 16:42:16 -- nvmf/common.sh@542 -- # cat 00:17:50.805 16:42:16 -- nvmf/common.sh@544 -- # jq . 00:17:50.805 16:42:16 -- nvmf/common.sh@545 -- # IFS=, 00:17:50.805 16:42:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:50.805 "params": { 00:17:50.805 "name": "Nvme0", 00:17:50.805 "trtype": "tcp", 00:17:50.805 "traddr": "10.0.0.2", 00:17:50.805 "adrfam": "ipv4", 00:17:50.805 "trsvcid": "4420", 00:17:50.805 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:50.805 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:50.805 "hdgst": false, 00:17:50.805 "ddgst": false 00:17:50.805 }, 00:17:50.805 "method": "bdev_nvme_attach_controller" 00:17:50.805 }' 00:17:50.805 [2024-10-13 16:42:16.290083] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:50.805 [2024-10-13 16:42:16.290171] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1187140 ] 00:17:51.064 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.064 [2024-10-13 16:42:16.351583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.064 [2024-10-13 16:42:16.438211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:51.322 Running I/O for 1 seconds... 00:17:52.695 00:17:52.695 Latency(us) 00:17:52.695 [2024-10-13T14:42:18.196Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.695 [2024-10-13T14:42:18.196Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:52.695 Verification LBA range: start 0x0 length 0x400 00:17:52.695 Nvme0n1 : 1.01 4031.57 251.97 0.00 0.00 15609.43 1098.33 22719.15 00:17:52.695 [2024-10-13T14:42:18.196Z] =================================================================================================================== 00:17:52.695 [2024-10-13T14:42:18.196Z] Total : 4031.57 251.97 0.00 0.00 15609.43 1098.33 22719.15 00:17:52.695 16:42:18 -- target/host_management.sh@101 -- # stoptarget 00:17:52.695 16:42:18 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:52.695 16:42:18 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:52.695 16:42:18 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:52.695 16:42:18 -- target/host_management.sh@40 -- # nvmftestfini 00:17:52.695 16:42:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:52.695 16:42:18 -- nvmf/common.sh@116 -- # sync 00:17:52.695 16:42:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:52.695 16:42:18 -- nvmf/common.sh@119 -- # set +e 00:17:52.695 16:42:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:52.695 16:42:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:52.695 rmmod nvme_tcp 00:17:52.695 rmmod nvme_fabrics 00:17:52.695 rmmod nvme_keyring 00:17:52.695 16:42:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:52.695 16:42:18 -- nvmf/common.sh@123 -- # set -e 00:17:52.695 16:42:18 -- nvmf/common.sh@124 -- # return 0 00:17:52.695 16:42:18 -- nvmf/common.sh@477 -- # '[' -n 1186677 ']' 00:17:52.695 16:42:18 -- nvmf/common.sh@478 -- # killprocess 1186677 00:17:52.695 16:42:18 -- common/autotest_common.sh@926 -- # '[' -z 1186677 ']' 00:17:52.695 16:42:18 -- common/autotest_common.sh@930 -- # kill -0 1186677 00:17:52.695 16:42:18 -- common/autotest_common.sh@931 -- # uname 00:17:52.695 16:42:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:52.695 16:42:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1186677 00:17:52.695 16:42:18 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:52.695 16:42:18 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:52.695 16:42:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1186677' 00:17:52.695 killing process with pid 1186677 00:17:52.695 16:42:18 -- common/autotest_common.sh@945 -- # kill 1186677 00:17:52.695 16:42:18 -- common/autotest_common.sh@950 -- # wait 1186677 00:17:52.953 [2024-10-13 16:42:18.337724] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:52.953 16:42:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:52.953 16:42:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:52.953 16:42:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:52.953 16:42:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:52.953 16:42:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:52.953 16:42:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:52.953 16:42:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:52.953 16:42:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.485 16:42:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:55.485 00:17:55.485 real 0m7.412s 00:17:55.485 user 0m23.407s 00:17:55.485 sys 0m1.366s 00:17:55.485 16:42:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:55.485 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:17:55.485 ************************************ 00:17:55.485 END TEST nvmf_host_management 00:17:55.485 ************************************ 00:17:55.485 16:42:20 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:55.485 00:17:55.485 real 0m9.717s 00:17:55.485 user 0m24.240s 00:17:55.485 sys 0m2.845s 00:17:55.485 16:42:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:55.485 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:17:55.485 ************************************ 00:17:55.485 END TEST nvmf_host_management 00:17:55.485 ************************************ 00:17:55.485 16:42:20 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:55.485 16:42:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:55.485 16:42:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:55.485 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:17:55.485 ************************************ 00:17:55.485 START TEST nvmf_lvol 00:17:55.485 ************************************ 00:17:55.485 16:42:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:55.485 * Looking for test storage... 00:17:55.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:55.485 16:42:20 -- nvmf/common.sh@7 -- # uname -s 00:17:55.485 16:42:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:55.485 16:42:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:55.485 16:42:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:55.485 16:42:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:55.485 16:42:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:55.485 16:42:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:55.485 16:42:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:55.485 16:42:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:55.485 16:42:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:55.485 16:42:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:55.485 16:42:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:55.485 16:42:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:55.485 16:42:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:55.485 16:42:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:55.485 16:42:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:55.485 16:42:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:55.485 16:42:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:55.485 16:42:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:55.485 16:42:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:55.485 16:42:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.485 16:42:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.485 16:42:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.485 16:42:20 -- paths/export.sh@5 -- # export PATH 00:17:55.485 16:42:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.485 16:42:20 -- nvmf/common.sh@46 -- # : 0 00:17:55.485 16:42:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:55.485 16:42:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:55.485 16:42:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:55.485 16:42:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:55.485 16:42:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:55.485 16:42:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:55.485 16:42:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:55.485 16:42:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:55.485 16:42:20 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:55.485 16:42:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:55.485 16:42:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:55.485 16:42:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:55.485 16:42:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:55.485 16:42:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:55.485 16:42:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.485 16:42:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.485 16:42:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.485 16:42:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:55.485 16:42:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:55.485 16:42:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:55.485 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:17:57.385 16:42:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:57.385 16:42:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:57.385 16:42:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:57.385 16:42:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:57.385 16:42:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:57.385 16:42:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:57.385 16:42:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:57.385 16:42:22 -- nvmf/common.sh@294 -- # net_devs=() 00:17:57.385 16:42:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:57.385 16:42:22 -- nvmf/common.sh@295 -- # e810=() 00:17:57.385 16:42:22 -- nvmf/common.sh@295 -- # local -ga e810 00:17:57.385 16:42:22 -- nvmf/common.sh@296 -- # x722=() 00:17:57.385 16:42:22 -- nvmf/common.sh@296 -- # local -ga x722 00:17:57.385 16:42:22 -- nvmf/common.sh@297 -- # mlx=() 00:17:57.385 16:42:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:57.385 16:42:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:57.385 16:42:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:57.385 16:42:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:57.385 16:42:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:57.385 16:42:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:57.385 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:57.385 16:42:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:57.385 16:42:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:57.385 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:57.385 16:42:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:57.385 16:42:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:57.385 16:42:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:57.385 16:42:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:57.385 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:57.385 16:42:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:57.385 16:42:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:57.385 16:42:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:57.385 16:42:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:57.385 16:42:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:57.385 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:57.385 16:42:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:57.385 16:42:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:57.385 16:42:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:57.385 16:42:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:57.385 16:42:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:57.385 16:42:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:57.385 16:42:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:57.385 16:42:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:57.385 16:42:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:57.386 16:42:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:57.386 16:42:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:57.386 16:42:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:57.386 16:42:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:57.386 16:42:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:57.386 16:42:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:57.386 16:42:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:57.386 16:42:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:57.386 16:42:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:57.386 16:42:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:57.386 16:42:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:57.386 16:42:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:57.386 16:42:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:57.386 16:42:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:57.386 16:42:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:57.386 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:57.386 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:17:57.386 00:17:57.386 --- 10.0.0.2 ping statistics --- 00:17:57.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.386 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:17:57.386 16:42:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:57.386 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:57.386 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:17:57.386 00:17:57.386 --- 10.0.0.1 ping statistics --- 00:17:57.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.386 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:17:57.386 16:42:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:57.386 16:42:22 -- nvmf/common.sh@410 -- # return 0 00:17:57.386 16:42:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:57.386 16:42:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:57.386 16:42:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:57.386 16:42:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:57.386 16:42:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:57.386 16:42:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:57.386 16:42:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:57.386 16:42:22 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:57.386 16:42:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:57.386 16:42:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:57.386 16:42:22 -- common/autotest_common.sh@10 -- # set +x 00:17:57.386 16:42:22 -- nvmf/common.sh@469 -- # nvmfpid=1189372 00:17:57.386 16:42:22 -- nvmf/common.sh@470 -- # waitforlisten 1189372 00:17:57.386 16:42:22 -- common/autotest_common.sh@819 -- # '[' -z 1189372 ']' 00:17:57.386 16:42:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:57.386 16:42:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:57.386 16:42:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:57.386 16:42:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:57.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:57.386 16:42:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:57.386 16:42:22 -- common/autotest_common.sh@10 -- # set +x 00:17:57.386 [2024-10-13 16:42:22.833469] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:17:57.386 [2024-10-13 16:42:22.833544] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:57.386 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.644 [2024-10-13 16:42:22.903927] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:57.644 [2024-10-13 16:42:22.992352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:57.644 [2024-10-13 16:42:22.992551] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:57.644 [2024-10-13 16:42:22.992571] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:57.644 [2024-10-13 16:42:22.992586] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:57.644 [2024-10-13 16:42:22.992642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.644 [2024-10-13 16:42:22.992698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:57.644 [2024-10-13 16:42:22.992701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:58.579 16:42:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:58.579 16:42:23 -- common/autotest_common.sh@852 -- # return 0 00:17:58.579 16:42:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:58.579 16:42:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:58.579 16:42:23 -- common/autotest_common.sh@10 -- # set +x 00:17:58.579 16:42:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:58.579 16:42:23 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:58.579 [2024-10-13 16:42:24.034195] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:58.579 16:42:24 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:58.837 16:42:24 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:58.837 16:42:24 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:59.423 16:42:24 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:59.423 16:42:24 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:59.423 16:42:24 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:59.737 16:42:25 -- target/nvmf_lvol.sh@29 -- # lvs=354e6ddb-86de-4486-9681-7a6882057539 00:17:59.737 16:42:25 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 354e6ddb-86de-4486-9681-7a6882057539 lvol 20 00:18:00.020 16:42:25 -- target/nvmf_lvol.sh@32 -- # lvol=ec9c1b4f-08ca-4705-b9e3-237b7f25bd80 00:18:00.020 16:42:25 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:00.277 16:42:25 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ec9c1b4f-08ca-4705-b9e3-237b7f25bd80 00:18:00.534 16:42:25 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:00.792 [2024-10-13 16:42:26.134210] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:00.792 16:42:26 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:01.050 16:42:26 -- target/nvmf_lvol.sh@42 -- # perf_pid=1189820 00:18:01.050 16:42:26 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:18:01.050 16:42:26 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:18:01.050 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.984 16:42:27 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot ec9c1b4f-08ca-4705-b9e3-237b7f25bd80 MY_SNAPSHOT 00:18:02.242 16:42:27 -- target/nvmf_lvol.sh@47 -- # snapshot=40048426-0246-451d-860e-ca15518ec225 00:18:02.242 16:42:27 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize ec9c1b4f-08ca-4705-b9e3-237b7f25bd80 30 00:18:02.500 16:42:27 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 40048426-0246-451d-860e-ca15518ec225 MY_CLONE 00:18:03.064 16:42:28 -- target/nvmf_lvol.sh@49 -- # clone=736c9a01-242a-44ab-b7e9-f775fb8898f8 00:18:03.064 16:42:28 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 736c9a01-242a-44ab-b7e9-f775fb8898f8 00:18:03.631 16:42:28 -- target/nvmf_lvol.sh@53 -- # wait 1189820 00:18:11.742 Initializing NVMe Controllers 00:18:11.742 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:18:11.742 Controller IO queue size 128, less than required. 00:18:11.742 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:11.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:18:11.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:18:11.742 Initialization complete. Launching workers. 00:18:11.742 ======================================================== 00:18:11.742 Latency(us) 00:18:11.742 Device Information : IOPS MiB/s Average min max 00:18:11.742 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10904.00 42.59 11741.51 1860.54 67919.05 00:18:11.742 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10453.70 40.83 12252.16 2033.52 73199.85 00:18:11.742 ======================================================== 00:18:11.742 Total : 21357.70 83.43 11991.45 1860.54 73199.85 00:18:11.742 00:18:11.742 16:42:36 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:11.742 16:42:37 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ec9c1b4f-08ca-4705-b9e3-237b7f25bd80 00:18:12.003 16:42:37 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 354e6ddb-86de-4486-9681-7a6882057539 00:18:12.261 16:42:37 -- target/nvmf_lvol.sh@60 -- # rm -f 00:18:12.261 16:42:37 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:18:12.261 16:42:37 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:18:12.261 16:42:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.261 16:42:37 -- nvmf/common.sh@116 -- # sync 00:18:12.261 16:42:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.261 16:42:37 -- nvmf/common.sh@119 -- # set +e 00:18:12.261 16:42:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.261 16:42:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.261 rmmod nvme_tcp 00:18:12.261 rmmod nvme_fabrics 00:18:12.261 rmmod nvme_keyring 00:18:12.261 16:42:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.261 16:42:37 -- nvmf/common.sh@123 -- # set -e 00:18:12.261 16:42:37 -- nvmf/common.sh@124 -- # return 0 00:18:12.261 16:42:37 -- nvmf/common.sh@477 -- # '[' -n 1189372 ']' 00:18:12.261 16:42:37 -- nvmf/common.sh@478 -- # killprocess 1189372 00:18:12.261 16:42:37 -- common/autotest_common.sh@926 -- # '[' -z 1189372 ']' 00:18:12.261 16:42:37 -- common/autotest_common.sh@930 -- # kill -0 1189372 00:18:12.261 16:42:37 -- common/autotest_common.sh@931 -- # uname 00:18:12.261 16:42:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:12.261 16:42:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1189372 00:18:12.261 16:42:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:12.261 16:42:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:12.261 16:42:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1189372' 00:18:12.261 killing process with pid 1189372 00:18:12.261 16:42:37 -- common/autotest_common.sh@945 -- # kill 1189372 00:18:12.261 16:42:37 -- common/autotest_common.sh@950 -- # wait 1189372 00:18:12.519 16:42:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:12.519 16:42:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:12.519 16:42:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:12.519 16:42:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:12.519 16:42:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:12.519 16:42:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:12.519 16:42:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:12.519 16:42:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.052 16:42:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:15.052 00:18:15.052 real 0m19.552s 00:18:15.052 user 1m6.887s 00:18:15.052 sys 0m5.318s 00:18:15.052 16:42:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:15.052 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.052 ************************************ 00:18:15.052 END TEST nvmf_lvol 00:18:15.052 ************************************ 00:18:15.052 16:42:40 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:18:15.052 16:42:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:15.052 16:42:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:15.052 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.052 ************************************ 00:18:15.052 START TEST nvmf_lvs_grow 00:18:15.052 ************************************ 00:18:15.052 16:42:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:18:15.052 * Looking for test storage... 00:18:15.052 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:15.052 16:42:40 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:15.052 16:42:40 -- nvmf/common.sh@7 -- # uname -s 00:18:15.052 16:42:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:15.052 16:42:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:15.052 16:42:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:15.052 16:42:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:15.052 16:42:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:15.052 16:42:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:15.052 16:42:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:15.052 16:42:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:15.052 16:42:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:15.052 16:42:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:15.052 16:42:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.052 16:42:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.052 16:42:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:15.052 16:42:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:15.052 16:42:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:15.052 16:42:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:15.052 16:42:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:15.052 16:42:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:15.052 16:42:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:15.052 16:42:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.052 16:42:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.052 16:42:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.052 16:42:40 -- paths/export.sh@5 -- # export PATH 00:18:15.052 16:42:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.052 16:42:40 -- nvmf/common.sh@46 -- # : 0 00:18:15.052 16:42:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:15.052 16:42:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:15.052 16:42:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:15.052 16:42:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:15.052 16:42:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:15.052 16:42:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:15.052 16:42:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:15.052 16:42:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:15.052 16:42:40 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:15.052 16:42:40 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:15.052 16:42:40 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:18:15.052 16:42:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:15.052 16:42:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:15.052 16:42:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:15.052 16:42:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:15.052 16:42:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:15.052 16:42:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.052 16:42:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.052 16:42:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.052 16:42:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:15.052 16:42:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:15.052 16:42:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:15.052 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:18:16.953 16:42:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:16.953 16:42:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:16.953 16:42:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:16.953 16:42:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:16.953 16:42:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:16.953 16:42:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:16.953 16:42:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:16.953 16:42:42 -- nvmf/common.sh@294 -- # net_devs=() 00:18:16.953 16:42:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:16.953 16:42:42 -- nvmf/common.sh@295 -- # e810=() 00:18:16.953 16:42:42 -- nvmf/common.sh@295 -- # local -ga e810 00:18:16.953 16:42:42 -- nvmf/common.sh@296 -- # x722=() 00:18:16.953 16:42:42 -- nvmf/common.sh@296 -- # local -ga x722 00:18:16.953 16:42:42 -- nvmf/common.sh@297 -- # mlx=() 00:18:16.953 16:42:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:16.953 16:42:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:16.953 16:42:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.953 16:42:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:16.953 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:16.953 16:42:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.953 16:42:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:16.953 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:16.953 16:42:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.953 16:42:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.953 16:42:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.953 16:42:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:16.953 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:16.953 16:42:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.953 16:42:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.953 16:42:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.953 16:42:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:16.953 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:16.953 16:42:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:16.953 16:42:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:16.953 16:42:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:16.953 16:42:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:16.953 16:42:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:16.953 16:42:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:16.953 16:42:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:16.953 16:42:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:16.953 16:42:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:16.953 16:42:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:16.953 16:42:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:16.953 16:42:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:16.953 16:42:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:16.953 16:42:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:16.953 16:42:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:16.953 16:42:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:16.953 16:42:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:16.953 16:42:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:16.953 16:42:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:16.953 16:42:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:16.953 16:42:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:16.953 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:16.953 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:18:16.953 00:18:16.953 --- 10.0.0.2 ping statistics --- 00:18:16.953 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:16.953 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:18:16.953 16:42:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:16.953 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:16.953 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:18:16.953 00:18:16.953 --- 10.0.0.1 ping statistics --- 00:18:16.953 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:16.953 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:18:16.953 16:42:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:16.953 16:42:42 -- nvmf/common.sh@410 -- # return 0 00:18:16.953 16:42:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:16.953 16:42:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:16.953 16:42:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:16.953 16:42:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:16.953 16:42:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:16.953 16:42:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:16.953 16:42:42 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:18:16.953 16:42:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:16.953 16:42:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:16.953 16:42:42 -- common/autotest_common.sh@10 -- # set +x 00:18:16.953 16:42:42 -- nvmf/common.sh@469 -- # nvmfpid=1193126 00:18:16.953 16:42:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:16.953 16:42:42 -- nvmf/common.sh@470 -- # waitforlisten 1193126 00:18:16.954 16:42:42 -- common/autotest_common.sh@819 -- # '[' -z 1193126 ']' 00:18:16.954 16:42:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:16.954 16:42:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:16.954 16:42:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:16.954 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:16.954 16:42:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:16.954 16:42:42 -- common/autotest_common.sh@10 -- # set +x 00:18:16.954 [2024-10-13 16:42:42.238569] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:18:16.954 [2024-10-13 16:42:42.238646] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:16.954 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.954 [2024-10-13 16:42:42.307293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.954 [2024-10-13 16:42:42.397515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:16.954 [2024-10-13 16:42:42.397672] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:16.954 [2024-10-13 16:42:42.397691] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:16.954 [2024-10-13 16:42:42.397706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:16.954 [2024-10-13 16:42:42.397745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:17.887 16:42:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:17.887 16:42:43 -- common/autotest_common.sh@852 -- # return 0 00:18:17.887 16:42:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.887 16:42:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:17.887 16:42:43 -- common/autotest_common.sh@10 -- # set +x 00:18:17.887 16:42:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.887 16:42:43 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:18.146 [2024-10-13 16:42:43.548376] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:18:18.146 16:42:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:18:18.146 16:42:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:18.146 16:42:43 -- common/autotest_common.sh@10 -- # set +x 00:18:18.146 ************************************ 00:18:18.146 START TEST lvs_grow_clean 00:18:18.146 ************************************ 00:18:18.146 16:42:43 -- common/autotest_common.sh@1104 -- # lvs_grow 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:18.146 16:42:43 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:18.405 16:42:43 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:18.405 16:42:43 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d2390e32-a6dd-40e5-868f-64910e612275 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:18.970 16:42:44 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d2390e32-a6dd-40e5-868f-64910e612275 lvol 150 00:18:19.228 16:42:44 -- target/nvmf_lvs_grow.sh@33 -- # lvol=97475bb8-4e9a-49aa-abf1-6c3c056ea2dd 00:18:19.228 16:42:44 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:19.228 16:42:44 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:19.485 [2024-10-13 16:42:44.911737] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:19.485 [2024-10-13 16:42:44.911827] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:19.485 true 00:18:19.485 16:42:44 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:19.485 16:42:44 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:19.742 16:42:45 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:19.742 16:42:45 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:20.000 16:42:45 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 97475bb8-4e9a-49aa-abf1-6c3c056ea2dd 00:18:20.259 16:42:45 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:20.825 [2024-10-13 16:42:46.031262] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:20.825 16:42:46 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:20.825 16:42:46 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1193702 00:18:20.825 16:42:46 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:20.825 16:42:46 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:20.825 16:42:46 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1193702 /var/tmp/bdevperf.sock 00:18:20.825 16:42:46 -- common/autotest_common.sh@819 -- # '[' -z 1193702 ']' 00:18:20.825 16:42:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:20.825 16:42:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:20.825 16:42:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:20.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:20.825 16:42:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:20.825 16:42:46 -- common/autotest_common.sh@10 -- # set +x 00:18:21.083 [2024-10-13 16:42:46.338001] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:18:21.083 [2024-10-13 16:42:46.338096] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1193702 ] 00:18:21.083 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.083 [2024-10-13 16:42:46.399293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.083 [2024-10-13 16:42:46.488300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:22.017 16:42:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:22.017 16:42:47 -- common/autotest_common.sh@852 -- # return 0 00:18:22.017 16:42:47 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:22.274 Nvme0n1 00:18:22.274 16:42:47 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:22.532 [ 00:18:22.532 { 00:18:22.532 "name": "Nvme0n1", 00:18:22.532 "aliases": [ 00:18:22.532 "97475bb8-4e9a-49aa-abf1-6c3c056ea2dd" 00:18:22.532 ], 00:18:22.532 "product_name": "NVMe disk", 00:18:22.532 "block_size": 4096, 00:18:22.532 "num_blocks": 38912, 00:18:22.532 "uuid": "97475bb8-4e9a-49aa-abf1-6c3c056ea2dd", 00:18:22.532 "assigned_rate_limits": { 00:18:22.532 "rw_ios_per_sec": 0, 00:18:22.532 "rw_mbytes_per_sec": 0, 00:18:22.532 "r_mbytes_per_sec": 0, 00:18:22.532 "w_mbytes_per_sec": 0 00:18:22.532 }, 00:18:22.532 "claimed": false, 00:18:22.532 "zoned": false, 00:18:22.532 "supported_io_types": { 00:18:22.532 "read": true, 00:18:22.532 "write": true, 00:18:22.532 "unmap": true, 00:18:22.532 "write_zeroes": true, 00:18:22.532 "flush": true, 00:18:22.532 "reset": true, 00:18:22.532 "compare": true, 00:18:22.532 "compare_and_write": true, 00:18:22.532 "abort": true, 00:18:22.532 "nvme_admin": true, 00:18:22.532 "nvme_io": true 00:18:22.532 }, 00:18:22.532 "driver_specific": { 00:18:22.532 "nvme": [ 00:18:22.532 { 00:18:22.532 "trid": { 00:18:22.532 "trtype": "TCP", 00:18:22.532 "adrfam": "IPv4", 00:18:22.532 "traddr": "10.0.0.2", 00:18:22.532 "trsvcid": "4420", 00:18:22.532 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:22.532 }, 00:18:22.532 "ctrlr_data": { 00:18:22.532 "cntlid": 1, 00:18:22.532 "vendor_id": "0x8086", 00:18:22.532 "model_number": "SPDK bdev Controller", 00:18:22.532 "serial_number": "SPDK0", 00:18:22.532 "firmware_revision": "24.01.1", 00:18:22.532 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:22.532 "oacs": { 00:18:22.532 "security": 0, 00:18:22.532 "format": 0, 00:18:22.532 "firmware": 0, 00:18:22.532 "ns_manage": 0 00:18:22.532 }, 00:18:22.532 "multi_ctrlr": true, 00:18:22.532 "ana_reporting": false 00:18:22.532 }, 00:18:22.532 "vs": { 00:18:22.532 "nvme_version": "1.3" 00:18:22.532 }, 00:18:22.532 "ns_data": { 00:18:22.532 "id": 1, 00:18:22.532 "can_share": true 00:18:22.532 } 00:18:22.532 } 00:18:22.532 ], 00:18:22.532 "mp_policy": "active_passive" 00:18:22.532 } 00:18:22.532 } 00:18:22.532 ] 00:18:22.532 16:42:48 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1193856 00:18:22.532 16:42:48 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:22.532 16:42:48 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:22.790 Running I/O for 10 seconds... 00:18:23.724 Latency(us) 00:18:23.724 [2024-10-13T14:42:49.225Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:23.724 [2024-10-13T14:42:49.225Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.724 Nvme0n1 : 1.00 15306.00 59.79 0.00 0.00 0.00 0.00 0.00 00:18:23.724 [2024-10-13T14:42:49.225Z] =================================================================================================================== 00:18:23.724 [2024-10-13T14:42:49.225Z] Total : 15306.00 59.79 0.00 0.00 0.00 0.00 0.00 00:18:23.724 00:18:24.658 16:42:50 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:24.658 [2024-10-13T14:42:50.159Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:24.658 Nvme0n1 : 2.00 15280.50 59.69 0.00 0.00 0.00 0.00 0.00 00:18:24.658 [2024-10-13T14:42:50.159Z] =================================================================================================================== 00:18:24.658 [2024-10-13T14:42:50.159Z] Total : 15280.50 59.69 0.00 0.00 0.00 0.00 0.00 00:18:24.658 00:18:24.916 true 00:18:24.916 16:42:50 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:24.916 16:42:50 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:25.174 16:42:50 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:25.174 16:42:50 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:25.174 16:42:50 -- target/nvmf_lvs_grow.sh@65 -- # wait 1193856 00:18:25.740 [2024-10-13T14:42:51.241Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:25.740 Nvme0n1 : 3.00 15332.00 59.89 0.00 0.00 0.00 0.00 0.00 00:18:25.740 [2024-10-13T14:42:51.241Z] =================================================================================================================== 00:18:25.740 [2024-10-13T14:42:51.241Z] Total : 15332.00 59.89 0.00 0.00 0.00 0.00 0.00 00:18:25.740 00:18:26.673 [2024-10-13T14:42:52.174Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.674 Nvme0n1 : 4.00 15350.75 59.96 0.00 0.00 0.00 0.00 0.00 00:18:26.674 [2024-10-13T14:42:52.175Z] =================================================================================================================== 00:18:26.674 [2024-10-13T14:42:52.175Z] Total : 15350.75 59.96 0.00 0.00 0.00 0.00 0.00 00:18:26.674 00:18:28.048 [2024-10-13T14:42:53.549Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:28.048 Nvme0n1 : 5.00 15382.40 60.09 0.00 0.00 0.00 0.00 0.00 00:18:28.048 [2024-10-13T14:42:53.549Z] =================================================================================================================== 00:18:28.048 [2024-10-13T14:42:53.549Z] Total : 15382.40 60.09 0.00 0.00 0.00 0.00 0.00 00:18:28.048 00:18:28.615 [2024-10-13T14:42:54.116Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:28.615 Nvme0n1 : 6.00 15407.83 60.19 0.00 0.00 0.00 0.00 0.00 00:18:28.615 [2024-10-13T14:42:54.116Z] =================================================================================================================== 00:18:28.615 [2024-10-13T14:42:54.116Z] Total : 15407.83 60.19 0.00 0.00 0.00 0.00 0.00 00:18:28.615 00:18:29.989 [2024-10-13T14:42:55.490Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:29.989 Nvme0n1 : 7.00 15436.00 60.30 0.00 0.00 0.00 0.00 0.00 00:18:29.989 [2024-10-13T14:42:55.490Z] =================================================================================================================== 00:18:29.989 [2024-10-13T14:42:55.490Z] Total : 15436.00 60.30 0.00 0.00 0.00 0.00 0.00 00:18:29.989 00:18:30.924 [2024-10-13T14:42:56.425Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:30.924 Nvme0n1 : 8.00 15468.50 60.42 0.00 0.00 0.00 0.00 0.00 00:18:30.924 [2024-10-13T14:42:56.425Z] =================================================================================================================== 00:18:30.924 [2024-10-13T14:42:56.425Z] Total : 15468.50 60.42 0.00 0.00 0.00 0.00 0.00 00:18:30.924 00:18:31.859 [2024-10-13T14:42:57.360Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:31.859 Nvme0n1 : 9.00 15486.44 60.49 0.00 0.00 0.00 0.00 0.00 00:18:31.859 [2024-10-13T14:42:57.360Z] =================================================================================================================== 00:18:31.859 [2024-10-13T14:42:57.360Z] Total : 15486.44 60.49 0.00 0.00 0.00 0.00 0.00 00:18:31.859 00:18:32.794 [2024-10-13T14:42:58.295Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:32.794 Nvme0n1 : 10.00 15508.30 60.58 0.00 0.00 0.00 0.00 0.00 00:18:32.794 [2024-10-13T14:42:58.295Z] =================================================================================================================== 00:18:32.794 [2024-10-13T14:42:58.295Z] Total : 15508.30 60.58 0.00 0.00 0.00 0.00 0.00 00:18:32.794 00:18:32.794 00:18:32.794 Latency(us) 00:18:32.794 [2024-10-13T14:42:58.295Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.794 [2024-10-13T14:42:58.295Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:32.794 Nvme0n1 : 10.01 15513.32 60.60 0.00 0.00 8245.60 2257.35 17087.91 00:18:32.794 [2024-10-13T14:42:58.295Z] =================================================================================================================== 00:18:32.794 [2024-10-13T14:42:58.295Z] Total : 15513.32 60.60 0.00 0.00 8245.60 2257.35 17087.91 00:18:32.794 0 00:18:32.794 16:42:58 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1193702 00:18:32.794 16:42:58 -- common/autotest_common.sh@926 -- # '[' -z 1193702 ']' 00:18:32.794 16:42:58 -- common/autotest_common.sh@930 -- # kill -0 1193702 00:18:32.794 16:42:58 -- common/autotest_common.sh@931 -- # uname 00:18:32.794 16:42:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:32.794 16:42:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1193702 00:18:32.794 16:42:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:32.794 16:42:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:32.794 16:42:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1193702' 00:18:32.794 killing process with pid 1193702 00:18:32.794 16:42:58 -- common/autotest_common.sh@945 -- # kill 1193702 00:18:32.794 Received shutdown signal, test time was about 10.000000 seconds 00:18:32.794 00:18:32.794 Latency(us) 00:18:32.794 [2024-10-13T14:42:58.295Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.794 [2024-10-13T14:42:58.295Z] =================================================================================================================== 00:18:32.794 [2024-10-13T14:42:58.295Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:32.794 16:42:58 -- common/autotest_common.sh@950 -- # wait 1193702 00:18:33.052 16:42:58 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:33.310 16:42:58 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:33.310 16:42:58 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:33.568 16:42:58 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:33.568 16:42:58 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:33.568 16:42:58 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:33.826 [2024-10-13 16:42:59.187221] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:33.826 16:42:59 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:33.826 16:42:59 -- common/autotest_common.sh@640 -- # local es=0 00:18:33.826 16:42:59 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:33.826 16:42:59 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.826 16:42:59 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.826 16:42:59 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.826 16:42:59 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.826 16:42:59 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.826 16:42:59 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.826 16:42:59 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.826 16:42:59 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:33.826 16:42:59 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:34.084 request: 00:18:34.084 { 00:18:34.084 "uuid": "d2390e32-a6dd-40e5-868f-64910e612275", 00:18:34.084 "method": "bdev_lvol_get_lvstores", 00:18:34.084 "req_id": 1 00:18:34.084 } 00:18:34.084 Got JSON-RPC error response 00:18:34.084 response: 00:18:34.084 { 00:18:34.084 "code": -19, 00:18:34.084 "message": "No such device" 00:18:34.084 } 00:18:34.084 16:42:59 -- common/autotest_common.sh@643 -- # es=1 00:18:34.084 16:42:59 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:34.084 16:42:59 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:34.084 16:42:59 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:34.084 16:42:59 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:34.342 aio_bdev 00:18:34.342 16:42:59 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 97475bb8-4e9a-49aa-abf1-6c3c056ea2dd 00:18:34.342 16:42:59 -- common/autotest_common.sh@887 -- # local bdev_name=97475bb8-4e9a-49aa-abf1-6c3c056ea2dd 00:18:34.342 16:42:59 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:18:34.342 16:42:59 -- common/autotest_common.sh@889 -- # local i 00:18:34.342 16:42:59 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:18:34.342 16:42:59 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:18:34.342 16:42:59 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:34.600 16:42:59 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 97475bb8-4e9a-49aa-abf1-6c3c056ea2dd -t 2000 00:18:34.858 [ 00:18:34.858 { 00:18:34.858 "name": "97475bb8-4e9a-49aa-abf1-6c3c056ea2dd", 00:18:34.858 "aliases": [ 00:18:34.858 "lvs/lvol" 00:18:34.858 ], 00:18:34.858 "product_name": "Logical Volume", 00:18:34.858 "block_size": 4096, 00:18:34.858 "num_blocks": 38912, 00:18:34.858 "uuid": "97475bb8-4e9a-49aa-abf1-6c3c056ea2dd", 00:18:34.858 "assigned_rate_limits": { 00:18:34.858 "rw_ios_per_sec": 0, 00:18:34.858 "rw_mbytes_per_sec": 0, 00:18:34.858 "r_mbytes_per_sec": 0, 00:18:34.858 "w_mbytes_per_sec": 0 00:18:34.858 }, 00:18:34.858 "claimed": false, 00:18:34.858 "zoned": false, 00:18:34.858 "supported_io_types": { 00:18:34.858 "read": true, 00:18:34.858 "write": true, 00:18:34.858 "unmap": true, 00:18:34.858 "write_zeroes": true, 00:18:34.858 "flush": false, 00:18:34.858 "reset": true, 00:18:34.858 "compare": false, 00:18:34.858 "compare_and_write": false, 00:18:34.858 "abort": false, 00:18:34.858 "nvme_admin": false, 00:18:34.858 "nvme_io": false 00:18:34.858 }, 00:18:34.858 "driver_specific": { 00:18:34.858 "lvol": { 00:18:34.858 "lvol_store_uuid": "d2390e32-a6dd-40e5-868f-64910e612275", 00:18:34.858 "base_bdev": "aio_bdev", 00:18:34.858 "thin_provision": false, 00:18:34.858 "snapshot": false, 00:18:34.858 "clone": false, 00:18:34.858 "esnap_clone": false 00:18:34.858 } 00:18:34.858 } 00:18:34.858 } 00:18:34.858 ] 00:18:34.858 16:43:00 -- common/autotest_common.sh@895 -- # return 0 00:18:34.858 16:43:00 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:34.858 16:43:00 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:35.116 16:43:00 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:35.116 16:43:00 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:35.116 16:43:00 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:35.374 16:43:00 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:35.374 16:43:00 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 97475bb8-4e9a-49aa-abf1-6c3c056ea2dd 00:18:35.633 16:43:01 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d2390e32-a6dd-40e5-868f-64910e612275 00:18:35.891 16:43:01 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:36.148 00:18:36.148 real 0m18.024s 00:18:36.148 user 0m17.798s 00:18:36.148 sys 0m1.798s 00:18:36.148 16:43:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:36.148 16:43:01 -- common/autotest_common.sh@10 -- # set +x 00:18:36.148 ************************************ 00:18:36.148 END TEST lvs_grow_clean 00:18:36.148 ************************************ 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:36.148 16:43:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:36.148 16:43:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:36.148 16:43:01 -- common/autotest_common.sh@10 -- # set +x 00:18:36.148 ************************************ 00:18:36.148 START TEST lvs_grow_dirty 00:18:36.148 ************************************ 00:18:36.148 16:43:01 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:36.148 16:43:01 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:36.720 16:43:01 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:36.720 16:43:01 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:36.720 16:43:02 -- target/nvmf_lvs_grow.sh@28 -- # lvs=17a0fca7-9417-4cff-8e37-f3434899231f 00:18:36.720 16:43:02 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:37.028 16:43:02 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:37.028 16:43:02 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:37.028 16:43:02 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:37.028 16:43:02 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 17a0fca7-9417-4cff-8e37-f3434899231f lvol 150 00:18:37.316 16:43:02 -- target/nvmf_lvs_grow.sh@33 -- # lvol=bad71f31-4676-4f5d-b691-e60eb0794806 00:18:37.316 16:43:02 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:37.316 16:43:02 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:37.574 [2024-10-13 16:43:02.968742] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:37.574 [2024-10-13 16:43:02.968833] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:37.574 true 00:18:37.574 16:43:02 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:37.575 16:43:02 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:37.833 16:43:03 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:37.833 16:43:03 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:38.091 16:43:03 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bad71f31-4676-4f5d-b691-e60eb0794806 00:18:38.349 16:43:03 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:38.606 16:43:04 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:38.864 16:43:04 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1195940 00:18:38.864 16:43:04 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:38.864 16:43:04 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:38.864 16:43:04 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1195940 /var/tmp/bdevperf.sock 00:18:38.864 16:43:04 -- common/autotest_common.sh@819 -- # '[' -z 1195940 ']' 00:18:38.864 16:43:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:38.864 16:43:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:38.865 16:43:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:38.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:38.865 16:43:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:38.865 16:43:04 -- common/autotest_common.sh@10 -- # set +x 00:18:38.865 [2024-10-13 16:43:04.291925] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:18:38.865 [2024-10-13 16:43:04.292009] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1195940 ] 00:18:38.865 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.865 [2024-10-13 16:43:04.353782] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.122 [2024-10-13 16:43:04.443305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:39.122 16:43:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:39.122 16:43:04 -- common/autotest_common.sh@852 -- # return 0 00:18:39.122 16:43:04 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:39.688 Nvme0n1 00:18:39.688 16:43:04 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:39.688 [ 00:18:39.688 { 00:18:39.688 "name": "Nvme0n1", 00:18:39.688 "aliases": [ 00:18:39.688 "bad71f31-4676-4f5d-b691-e60eb0794806" 00:18:39.688 ], 00:18:39.688 "product_name": "NVMe disk", 00:18:39.688 "block_size": 4096, 00:18:39.688 "num_blocks": 38912, 00:18:39.688 "uuid": "bad71f31-4676-4f5d-b691-e60eb0794806", 00:18:39.688 "assigned_rate_limits": { 00:18:39.688 "rw_ios_per_sec": 0, 00:18:39.688 "rw_mbytes_per_sec": 0, 00:18:39.688 "r_mbytes_per_sec": 0, 00:18:39.688 "w_mbytes_per_sec": 0 00:18:39.688 }, 00:18:39.688 "claimed": false, 00:18:39.688 "zoned": false, 00:18:39.688 "supported_io_types": { 00:18:39.688 "read": true, 00:18:39.688 "write": true, 00:18:39.688 "unmap": true, 00:18:39.688 "write_zeroes": true, 00:18:39.688 "flush": true, 00:18:39.688 "reset": true, 00:18:39.688 "compare": true, 00:18:39.688 "compare_and_write": true, 00:18:39.688 "abort": true, 00:18:39.688 "nvme_admin": true, 00:18:39.688 "nvme_io": true 00:18:39.688 }, 00:18:39.688 "driver_specific": { 00:18:39.688 "nvme": [ 00:18:39.688 { 00:18:39.688 "trid": { 00:18:39.688 "trtype": "TCP", 00:18:39.688 "adrfam": "IPv4", 00:18:39.688 "traddr": "10.0.0.2", 00:18:39.688 "trsvcid": "4420", 00:18:39.688 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:39.688 }, 00:18:39.688 "ctrlr_data": { 00:18:39.688 "cntlid": 1, 00:18:39.688 "vendor_id": "0x8086", 00:18:39.688 "model_number": "SPDK bdev Controller", 00:18:39.688 "serial_number": "SPDK0", 00:18:39.688 "firmware_revision": "24.01.1", 00:18:39.688 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:39.688 "oacs": { 00:18:39.688 "security": 0, 00:18:39.688 "format": 0, 00:18:39.688 "firmware": 0, 00:18:39.688 "ns_manage": 0 00:18:39.688 }, 00:18:39.688 "multi_ctrlr": true, 00:18:39.688 "ana_reporting": false 00:18:39.688 }, 00:18:39.688 "vs": { 00:18:39.688 "nvme_version": "1.3" 00:18:39.688 }, 00:18:39.688 "ns_data": { 00:18:39.688 "id": 1, 00:18:39.688 "can_share": true 00:18:39.688 } 00:18:39.688 } 00:18:39.688 ], 00:18:39.688 "mp_policy": "active_passive" 00:18:39.688 } 00:18:39.688 } 00:18:39.688 ] 00:18:39.946 16:43:05 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1195960 00:18:39.946 16:43:05 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:39.946 16:43:05 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:39.946 Running I/O for 10 seconds... 00:18:40.881 Latency(us) 00:18:40.881 [2024-10-13T14:43:06.382Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:40.881 [2024-10-13T14:43:06.382Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:40.881 Nvme0n1 : 1.00 14749.00 57.61 0.00 0.00 0.00 0.00 0.00 00:18:40.881 [2024-10-13T14:43:06.382Z] =================================================================================================================== 00:18:40.881 [2024-10-13T14:43:06.382Z] Total : 14749.00 57.61 0.00 0.00 0.00 0.00 0.00 00:18:40.881 00:18:41.815 16:43:07 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:41.815 [2024-10-13T14:43:07.316Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:41.815 Nvme0n1 : 2.00 14906.00 58.23 0.00 0.00 0.00 0.00 0.00 00:18:41.815 [2024-10-13T14:43:07.316Z] =================================================================================================================== 00:18:41.815 [2024-10-13T14:43:07.316Z] Total : 14906.00 58.23 0.00 0.00 0.00 0.00 0.00 00:18:41.815 00:18:42.073 true 00:18:42.073 16:43:07 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:42.073 16:43:07 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:42.642 16:43:07 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:42.642 16:43:07 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:42.642 16:43:07 -- target/nvmf_lvs_grow.sh@65 -- # wait 1195960 00:18:42.905 [2024-10-13T14:43:08.406Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:42.905 Nvme0n1 : 3.00 15017.67 58.66 0.00 0.00 0.00 0.00 0.00 00:18:42.905 [2024-10-13T14:43:08.406Z] =================================================================================================================== 00:18:42.905 [2024-10-13T14:43:08.406Z] Total : 15017.67 58.66 0.00 0.00 0.00 0.00 0.00 00:18:42.905 00:18:43.839 [2024-10-13T14:43:09.340Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:43.839 Nvme0n1 : 4.00 15105.75 59.01 0.00 0.00 0.00 0.00 0.00 00:18:43.839 [2024-10-13T14:43:09.340Z] =================================================================================================================== 00:18:43.839 [2024-10-13T14:43:09.340Z] Total : 15105.75 59.01 0.00 0.00 0.00 0.00 0.00 00:18:43.839 00:18:45.214 [2024-10-13T14:43:10.715Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:45.214 Nvme0n1 : 5.00 15150.80 59.18 0.00 0.00 0.00 0.00 0.00 00:18:45.214 [2024-10-13T14:43:10.715Z] =================================================================================================================== 00:18:45.214 [2024-10-13T14:43:10.715Z] Total : 15150.80 59.18 0.00 0.00 0.00 0.00 0.00 00:18:45.214 00:18:46.148 [2024-10-13T14:43:11.649Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:46.148 Nvme0n1 : 6.00 15187.33 59.33 0.00 0.00 0.00 0.00 0.00 00:18:46.148 [2024-10-13T14:43:11.649Z] =================================================================================================================== 00:18:46.148 [2024-10-13T14:43:11.649Z] Total : 15187.33 59.33 0.00 0.00 0.00 0.00 0.00 00:18:46.148 00:18:47.082 [2024-10-13T14:43:12.583Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:47.082 Nvme0n1 : 7.00 15240.43 59.53 0.00 0.00 0.00 0.00 0.00 00:18:47.082 [2024-10-13T14:43:12.583Z] =================================================================================================================== 00:18:47.082 [2024-10-13T14:43:12.583Z] Total : 15240.43 59.53 0.00 0.00 0.00 0.00 0.00 00:18:47.082 00:18:48.016 [2024-10-13T14:43:13.517Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:48.016 Nvme0n1 : 8.00 15280.62 59.69 0.00 0.00 0.00 0.00 0.00 00:18:48.016 [2024-10-13T14:43:13.517Z] =================================================================================================================== 00:18:48.016 [2024-10-13T14:43:13.517Z] Total : 15280.62 59.69 0.00 0.00 0.00 0.00 0.00 00:18:48.016 00:18:48.951 [2024-10-13T14:43:14.452Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:48.951 Nvme0n1 : 9.00 15295.33 59.75 0.00 0.00 0.00 0.00 0.00 00:18:48.951 [2024-10-13T14:43:14.452Z] =================================================================================================================== 00:18:48.951 [2024-10-13T14:43:14.452Z] Total : 15295.33 59.75 0.00 0.00 0.00 0.00 0.00 00:18:48.951 00:18:49.885 [2024-10-13T14:43:15.386Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:49.885 Nvme0n1 : 10.00 15317.50 59.83 0.00 0.00 0.00 0.00 0.00 00:18:49.885 [2024-10-13T14:43:15.386Z] =================================================================================================================== 00:18:49.885 [2024-10-13T14:43:15.386Z] Total : 15317.50 59.83 0.00 0.00 0.00 0.00 0.00 00:18:49.885 00:18:49.885 00:18:49.885 Latency(us) 00:18:49.885 [2024-10-13T14:43:15.386Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:49.885 [2024-10-13T14:43:15.386Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:49.885 Nvme0n1 : 10.00 15321.27 59.85 0.00 0.00 8349.35 2245.21 16796.63 00:18:49.885 [2024-10-13T14:43:15.386Z] =================================================================================================================== 00:18:49.885 [2024-10-13T14:43:15.386Z] Total : 15321.27 59.85 0.00 0.00 8349.35 2245.21 16796.63 00:18:49.885 0 00:18:49.885 16:43:15 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1195940 00:18:49.885 16:43:15 -- common/autotest_common.sh@926 -- # '[' -z 1195940 ']' 00:18:49.885 16:43:15 -- common/autotest_common.sh@930 -- # kill -0 1195940 00:18:49.885 16:43:15 -- common/autotest_common.sh@931 -- # uname 00:18:49.885 16:43:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:49.885 16:43:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1195940 00:18:50.144 16:43:15 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:50.144 16:43:15 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:50.144 16:43:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1195940' 00:18:50.144 killing process with pid 1195940 00:18:50.144 16:43:15 -- common/autotest_common.sh@945 -- # kill 1195940 00:18:50.144 Received shutdown signal, test time was about 10.000000 seconds 00:18:50.144 00:18:50.144 Latency(us) 00:18:50.144 [2024-10-13T14:43:15.645Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:50.144 [2024-10-13T14:43:15.645Z] =================================================================================================================== 00:18:50.144 [2024-10-13T14:43:15.645Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:50.144 16:43:15 -- common/autotest_common.sh@950 -- # wait 1195940 00:18:50.144 16:43:15 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:50.710 16:43:15 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:50.710 16:43:15 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1193126 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@74 -- # wait 1193126 00:18:50.710 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1193126 Killed "${NVMF_APP[@]}" "$@" 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:50.710 16:43:16 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:50.710 16:43:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:50.710 16:43:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:50.710 16:43:16 -- common/autotest_common.sh@10 -- # set +x 00:18:50.710 16:43:16 -- nvmf/common.sh@469 -- # nvmfpid=1197321 00:18:50.710 16:43:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:50.710 16:43:16 -- nvmf/common.sh@470 -- # waitforlisten 1197321 00:18:50.710 16:43:16 -- common/autotest_common.sh@819 -- # '[' -z 1197321 ']' 00:18:50.710 16:43:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:50.710 16:43:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:50.710 16:43:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:50.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:50.710 16:43:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:50.710 16:43:16 -- common/autotest_common.sh@10 -- # set +x 00:18:50.968 [2024-10-13 16:43:16.246594] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:18:50.968 [2024-10-13 16:43:16.246690] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:50.968 EAL: No free 2048 kB hugepages reported on node 1 00:18:50.968 [2024-10-13 16:43:16.311436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:50.968 [2024-10-13 16:43:16.398666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:50.968 [2024-10-13 16:43:16.398804] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:50.968 [2024-10-13 16:43:16.398820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:50.968 [2024-10-13 16:43:16.398833] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:50.968 [2024-10-13 16:43:16.398862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:51.903 16:43:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:51.903 16:43:17 -- common/autotest_common.sh@852 -- # return 0 00:18:51.903 16:43:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:51.903 16:43:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:51.903 16:43:17 -- common/autotest_common.sh@10 -- # set +x 00:18:51.903 16:43:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:51.903 16:43:17 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:52.161 [2024-10-13 16:43:17.468633] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:52.161 [2024-10-13 16:43:17.468767] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:52.161 [2024-10-13 16:43:17.468823] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:52.161 16:43:17 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:52.161 16:43:17 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev bad71f31-4676-4f5d-b691-e60eb0794806 00:18:52.161 16:43:17 -- common/autotest_common.sh@887 -- # local bdev_name=bad71f31-4676-4f5d-b691-e60eb0794806 00:18:52.161 16:43:17 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:18:52.161 16:43:17 -- common/autotest_common.sh@889 -- # local i 00:18:52.161 16:43:17 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:18:52.161 16:43:17 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:18:52.161 16:43:17 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:52.421 16:43:17 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bad71f31-4676-4f5d-b691-e60eb0794806 -t 2000 00:18:52.678 [ 00:18:52.678 { 00:18:52.678 "name": "bad71f31-4676-4f5d-b691-e60eb0794806", 00:18:52.678 "aliases": [ 00:18:52.678 "lvs/lvol" 00:18:52.678 ], 00:18:52.678 "product_name": "Logical Volume", 00:18:52.678 "block_size": 4096, 00:18:52.678 "num_blocks": 38912, 00:18:52.678 "uuid": "bad71f31-4676-4f5d-b691-e60eb0794806", 00:18:52.678 "assigned_rate_limits": { 00:18:52.678 "rw_ios_per_sec": 0, 00:18:52.678 "rw_mbytes_per_sec": 0, 00:18:52.678 "r_mbytes_per_sec": 0, 00:18:52.678 "w_mbytes_per_sec": 0 00:18:52.678 }, 00:18:52.678 "claimed": false, 00:18:52.678 "zoned": false, 00:18:52.678 "supported_io_types": { 00:18:52.678 "read": true, 00:18:52.678 "write": true, 00:18:52.678 "unmap": true, 00:18:52.678 "write_zeroes": true, 00:18:52.678 "flush": false, 00:18:52.678 "reset": true, 00:18:52.678 "compare": false, 00:18:52.678 "compare_and_write": false, 00:18:52.678 "abort": false, 00:18:52.678 "nvme_admin": false, 00:18:52.678 "nvme_io": false 00:18:52.678 }, 00:18:52.678 "driver_specific": { 00:18:52.678 "lvol": { 00:18:52.678 "lvol_store_uuid": "17a0fca7-9417-4cff-8e37-f3434899231f", 00:18:52.678 "base_bdev": "aio_bdev", 00:18:52.678 "thin_provision": false, 00:18:52.678 "snapshot": false, 00:18:52.678 "clone": false, 00:18:52.678 "esnap_clone": false 00:18:52.678 } 00:18:52.678 } 00:18:52.678 } 00:18:52.678 ] 00:18:52.678 16:43:18 -- common/autotest_common.sh@895 -- # return 0 00:18:52.678 16:43:18 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:52.678 16:43:18 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:52.936 16:43:18 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:52.936 16:43:18 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:52.936 16:43:18 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:53.194 16:43:18 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:53.194 16:43:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:53.452 [2024-10-13 16:43:18.753685] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:53.452 16:43:18 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:53.452 16:43:18 -- common/autotest_common.sh@640 -- # local es=0 00:18:53.452 16:43:18 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:53.452 16:43:18 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:53.452 16:43:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:53.452 16:43:18 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:53.452 16:43:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:53.452 16:43:18 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:53.452 16:43:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:53.452 16:43:18 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:53.452 16:43:18 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:53.452 16:43:18 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:53.711 request: 00:18:53.711 { 00:18:53.711 "uuid": "17a0fca7-9417-4cff-8e37-f3434899231f", 00:18:53.711 "method": "bdev_lvol_get_lvstores", 00:18:53.711 "req_id": 1 00:18:53.711 } 00:18:53.711 Got JSON-RPC error response 00:18:53.711 response: 00:18:53.711 { 00:18:53.711 "code": -19, 00:18:53.711 "message": "No such device" 00:18:53.711 } 00:18:53.711 16:43:19 -- common/autotest_common.sh@643 -- # es=1 00:18:53.711 16:43:19 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:53.711 16:43:19 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:53.711 16:43:19 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:53.711 16:43:19 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:53.969 aio_bdev 00:18:53.969 16:43:19 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev bad71f31-4676-4f5d-b691-e60eb0794806 00:18:53.969 16:43:19 -- common/autotest_common.sh@887 -- # local bdev_name=bad71f31-4676-4f5d-b691-e60eb0794806 00:18:53.969 16:43:19 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:18:53.969 16:43:19 -- common/autotest_common.sh@889 -- # local i 00:18:53.969 16:43:19 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:18:53.969 16:43:19 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:18:53.969 16:43:19 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:54.226 16:43:19 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bad71f31-4676-4f5d-b691-e60eb0794806 -t 2000 00:18:54.484 [ 00:18:54.484 { 00:18:54.484 "name": "bad71f31-4676-4f5d-b691-e60eb0794806", 00:18:54.484 "aliases": [ 00:18:54.484 "lvs/lvol" 00:18:54.484 ], 00:18:54.484 "product_name": "Logical Volume", 00:18:54.484 "block_size": 4096, 00:18:54.484 "num_blocks": 38912, 00:18:54.484 "uuid": "bad71f31-4676-4f5d-b691-e60eb0794806", 00:18:54.484 "assigned_rate_limits": { 00:18:54.484 "rw_ios_per_sec": 0, 00:18:54.484 "rw_mbytes_per_sec": 0, 00:18:54.484 "r_mbytes_per_sec": 0, 00:18:54.484 "w_mbytes_per_sec": 0 00:18:54.484 }, 00:18:54.484 "claimed": false, 00:18:54.484 "zoned": false, 00:18:54.484 "supported_io_types": { 00:18:54.484 "read": true, 00:18:54.484 "write": true, 00:18:54.484 "unmap": true, 00:18:54.484 "write_zeroes": true, 00:18:54.484 "flush": false, 00:18:54.484 "reset": true, 00:18:54.484 "compare": false, 00:18:54.484 "compare_and_write": false, 00:18:54.484 "abort": false, 00:18:54.484 "nvme_admin": false, 00:18:54.484 "nvme_io": false 00:18:54.484 }, 00:18:54.484 "driver_specific": { 00:18:54.484 "lvol": { 00:18:54.484 "lvol_store_uuid": "17a0fca7-9417-4cff-8e37-f3434899231f", 00:18:54.484 "base_bdev": "aio_bdev", 00:18:54.484 "thin_provision": false, 00:18:54.484 "snapshot": false, 00:18:54.484 "clone": false, 00:18:54.484 "esnap_clone": false 00:18:54.484 } 00:18:54.484 } 00:18:54.484 } 00:18:54.484 ] 00:18:54.484 16:43:19 -- common/autotest_common.sh@895 -- # return 0 00:18:54.484 16:43:19 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:54.484 16:43:19 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:54.742 16:43:20 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:54.742 16:43:20 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:54.742 16:43:20 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:55.000 16:43:20 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:55.000 16:43:20 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete bad71f31-4676-4f5d-b691-e60eb0794806 00:18:55.258 16:43:20 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 17a0fca7-9417-4cff-8e37-f3434899231f 00:18:55.515 16:43:20 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:55.773 16:43:21 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:55.773 00:18:55.773 real 0m19.576s 00:18:55.773 user 0m49.698s 00:18:55.773 sys 0m4.481s 00:18:55.773 16:43:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:55.773 16:43:21 -- common/autotest_common.sh@10 -- # set +x 00:18:55.773 ************************************ 00:18:55.773 END TEST lvs_grow_dirty 00:18:55.773 ************************************ 00:18:55.773 16:43:21 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:55.773 16:43:21 -- common/autotest_common.sh@796 -- # type=--id 00:18:55.773 16:43:21 -- common/autotest_common.sh@797 -- # id=0 00:18:55.773 16:43:21 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:55.773 16:43:21 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:55.773 16:43:21 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:55.773 16:43:21 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:55.773 16:43:21 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:55.773 16:43:21 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:55.773 nvmf_trace.0 00:18:55.773 16:43:21 -- common/autotest_common.sh@811 -- # return 0 00:18:55.773 16:43:21 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:55.773 16:43:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:55.773 16:43:21 -- nvmf/common.sh@116 -- # sync 00:18:55.773 16:43:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:55.773 16:43:21 -- nvmf/common.sh@119 -- # set +e 00:18:55.773 16:43:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:55.773 16:43:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:55.773 rmmod nvme_tcp 00:18:55.773 rmmod nvme_fabrics 00:18:56.031 rmmod nvme_keyring 00:18:56.031 16:43:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:56.031 16:43:21 -- nvmf/common.sh@123 -- # set -e 00:18:56.031 16:43:21 -- nvmf/common.sh@124 -- # return 0 00:18:56.031 16:43:21 -- nvmf/common.sh@477 -- # '[' -n 1197321 ']' 00:18:56.031 16:43:21 -- nvmf/common.sh@478 -- # killprocess 1197321 00:18:56.031 16:43:21 -- common/autotest_common.sh@926 -- # '[' -z 1197321 ']' 00:18:56.031 16:43:21 -- common/autotest_common.sh@930 -- # kill -0 1197321 00:18:56.031 16:43:21 -- common/autotest_common.sh@931 -- # uname 00:18:56.031 16:43:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:56.031 16:43:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1197321 00:18:56.031 16:43:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:56.031 16:43:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:56.031 16:43:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1197321' 00:18:56.031 killing process with pid 1197321 00:18:56.031 16:43:21 -- common/autotest_common.sh@945 -- # kill 1197321 00:18:56.031 16:43:21 -- common/autotest_common.sh@950 -- # wait 1197321 00:18:56.291 16:43:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:56.291 16:43:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:56.291 16:43:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:56.291 16:43:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:56.291 16:43:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:56.291 16:43:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:56.291 16:43:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:56.291 16:43:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:58.196 16:43:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:58.196 00:18:58.196 real 0m43.585s 00:18:58.196 user 1m14.248s 00:18:58.196 sys 0m8.080s 00:18:58.196 16:43:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:58.196 16:43:23 -- common/autotest_common.sh@10 -- # set +x 00:18:58.196 ************************************ 00:18:58.196 END TEST nvmf_lvs_grow 00:18:58.196 ************************************ 00:18:58.196 16:43:23 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:58.196 16:43:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:58.196 16:43:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:58.196 16:43:23 -- common/autotest_common.sh@10 -- # set +x 00:18:58.196 ************************************ 00:18:58.196 START TEST nvmf_bdev_io_wait 00:18:58.196 ************************************ 00:18:58.196 16:43:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:58.455 * Looking for test storage... 00:18:58.455 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:58.455 16:43:23 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:58.455 16:43:23 -- nvmf/common.sh@7 -- # uname -s 00:18:58.455 16:43:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:58.455 16:43:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:58.455 16:43:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:58.455 16:43:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:58.455 16:43:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:58.455 16:43:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:58.455 16:43:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:58.455 16:43:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:58.455 16:43:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:58.455 16:43:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:58.455 16:43:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:58.455 16:43:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:58.455 16:43:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:58.455 16:43:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:58.455 16:43:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:58.455 16:43:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:58.455 16:43:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:58.455 16:43:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:58.455 16:43:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:58.455 16:43:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.455 16:43:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.455 16:43:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.455 16:43:23 -- paths/export.sh@5 -- # export PATH 00:18:58.455 16:43:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.455 16:43:23 -- nvmf/common.sh@46 -- # : 0 00:18:58.455 16:43:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:58.455 16:43:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:58.455 16:43:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:58.455 16:43:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:58.455 16:43:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:58.455 16:43:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:58.455 16:43:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:58.455 16:43:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:58.455 16:43:23 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:58.455 16:43:23 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:58.455 16:43:23 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:58.455 16:43:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:58.455 16:43:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:58.455 16:43:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:58.455 16:43:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:58.455 16:43:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:58.455 16:43:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:58.455 16:43:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:58.455 16:43:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:58.455 16:43:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:58.455 16:43:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:58.455 16:43:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:58.455 16:43:23 -- common/autotest_common.sh@10 -- # set +x 00:19:00.359 16:43:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:00.359 16:43:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:00.359 16:43:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:00.359 16:43:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:00.359 16:43:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:00.359 16:43:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:00.359 16:43:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:00.359 16:43:25 -- nvmf/common.sh@294 -- # net_devs=() 00:19:00.359 16:43:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:00.359 16:43:25 -- nvmf/common.sh@295 -- # e810=() 00:19:00.359 16:43:25 -- nvmf/common.sh@295 -- # local -ga e810 00:19:00.359 16:43:25 -- nvmf/common.sh@296 -- # x722=() 00:19:00.359 16:43:25 -- nvmf/common.sh@296 -- # local -ga x722 00:19:00.359 16:43:25 -- nvmf/common.sh@297 -- # mlx=() 00:19:00.359 16:43:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:00.359 16:43:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:00.359 16:43:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:00.359 16:43:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:00.359 16:43:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:00.359 16:43:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:00.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:00.359 16:43:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:00.359 16:43:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:00.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:00.359 16:43:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:00.359 16:43:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:00.359 16:43:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:00.359 16:43:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:00.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:00.359 16:43:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:00.359 16:43:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:00.359 16:43:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:00.359 16:43:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:00.359 16:43:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:00.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:00.359 16:43:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:00.359 16:43:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:00.359 16:43:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:00.359 16:43:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:00.359 16:43:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:00.359 16:43:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:00.359 16:43:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:00.359 16:43:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:00.359 16:43:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:00.359 16:43:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:00.359 16:43:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:00.359 16:43:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:00.359 16:43:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:00.359 16:43:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:00.359 16:43:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:00.359 16:43:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:00.359 16:43:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:00.618 16:43:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:00.618 16:43:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:00.618 16:43:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:00.618 16:43:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:00.618 16:43:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:00.618 16:43:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:00.618 16:43:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:00.618 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:00.618 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:19:00.618 00:19:00.618 --- 10.0.0.2 ping statistics --- 00:19:00.618 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:00.618 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:19:00.618 16:43:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:00.618 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:00.618 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:19:00.618 00:19:00.618 --- 10.0.0.1 ping statistics --- 00:19:00.618 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:00.618 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:19:00.618 16:43:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:00.618 16:43:25 -- nvmf/common.sh@410 -- # return 0 00:19:00.618 16:43:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:00.618 16:43:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:00.618 16:43:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:00.618 16:43:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:00.618 16:43:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:00.618 16:43:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:00.618 16:43:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:00.618 16:43:25 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:19:00.618 16:43:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:00.618 16:43:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:00.618 16:43:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.618 16:43:25 -- nvmf/common.sh@469 -- # nvmfpid=1200001 00:19:00.618 16:43:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:19:00.618 16:43:25 -- nvmf/common.sh@470 -- # waitforlisten 1200001 00:19:00.618 16:43:25 -- common/autotest_common.sh@819 -- # '[' -z 1200001 ']' 00:19:00.618 16:43:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:00.618 16:43:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:00.618 16:43:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:00.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:00.618 16:43:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:00.618 16:43:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.618 [2024-10-13 16:43:25.997115] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:00.618 [2024-10-13 16:43:25.997194] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:00.618 EAL: No free 2048 kB hugepages reported on node 1 00:19:00.618 [2024-10-13 16:43:26.063857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:00.876 [2024-10-13 16:43:26.151750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:00.876 [2024-10-13 16:43:26.151917] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:00.876 [2024-10-13 16:43:26.151935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:00.876 [2024-10-13 16:43:26.151948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:00.876 [2024-10-13 16:43:26.152000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:00.876 [2024-10-13 16:43:26.152060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:00.876 [2024-10-13 16:43:26.152089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:00.876 [2024-10-13 16:43:26.152091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:00.876 16:43:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:00.876 16:43:26 -- common/autotest_common.sh@852 -- # return 0 00:19:00.876 16:43:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:00.876 16:43:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:00.876 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.876 16:43:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:00.876 16:43:26 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:19:00.876 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.876 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.876 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:00.877 16:43:26 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:19:00.877 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.877 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.877 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:00.877 16:43:26 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:00.877 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.877 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.877 [2024-10-13 16:43:26.316391] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:00.877 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:00.877 16:43:26 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:00.877 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.877 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.877 Malloc0 00:19:00.877 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:00.877 16:43:26 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:00.877 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.877 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:00.877 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:00.877 16:43:26 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:00.877 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:00.877 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.135 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:01.135 16:43:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:01.135 16:43:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.135 [2024-10-13 16:43:26.383110] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:01.135 16:43:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1200028 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@30 -- # READ_PID=1200029 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1200031 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # config=() 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # local subsystem config 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:19:01.135 16:43:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:01.135 { 00:19:01.135 "params": { 00:19:01.135 "name": "Nvme$subsystem", 00:19:01.135 "trtype": "$TEST_TRANSPORT", 00:19:01.135 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:01.135 "adrfam": "ipv4", 00:19:01.135 "trsvcid": "$NVMF_PORT", 00:19:01.135 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:01.135 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:01.135 "hdgst": ${hdgst:-false}, 00:19:01.135 "ddgst": ${ddgst:-false} 00:19:01.135 }, 00:19:01.135 "method": "bdev_nvme_attach_controller" 00:19:01.135 } 00:19:01.135 EOF 00:19:01.135 )") 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # config=() 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1200034 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # local subsystem config 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@35 -- # sync 00:19:01.135 16:43:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:01.135 { 00:19:01.135 "params": { 00:19:01.135 "name": "Nvme$subsystem", 00:19:01.135 "trtype": "$TEST_TRANSPORT", 00:19:01.135 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:01.135 "adrfam": "ipv4", 00:19:01.135 "trsvcid": "$NVMF_PORT", 00:19:01.135 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:01.135 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:01.135 "hdgst": ${hdgst:-false}, 00:19:01.135 "ddgst": ${ddgst:-false} 00:19:01.135 }, 00:19:01.135 "method": "bdev_nvme_attach_controller" 00:19:01.135 } 00:19:01.135 EOF 00:19:01.135 )") 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # config=() 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # local subsystem config 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:19:01.135 16:43:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:01.135 { 00:19:01.135 "params": { 00:19:01.135 "name": "Nvme$subsystem", 00:19:01.135 "trtype": "$TEST_TRANSPORT", 00:19:01.135 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:01.135 "adrfam": "ipv4", 00:19:01.135 "trsvcid": "$NVMF_PORT", 00:19:01.135 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:01.135 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:01.135 "hdgst": ${hdgst:-false}, 00:19:01.135 "ddgst": ${ddgst:-false} 00:19:01.135 }, 00:19:01.135 "method": "bdev_nvme_attach_controller" 00:19:01.135 } 00:19:01.135 EOF 00:19:01.135 )") 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # config=() 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # cat 00:19:01.135 16:43:26 -- nvmf/common.sh@520 -- # local subsystem config 00:19:01.135 16:43:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:01.135 { 00:19:01.135 "params": { 00:19:01.135 "name": "Nvme$subsystem", 00:19:01.135 "trtype": "$TEST_TRANSPORT", 00:19:01.135 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:01.135 "adrfam": "ipv4", 00:19:01.135 "trsvcid": "$NVMF_PORT", 00:19:01.135 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:01.135 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:01.135 "hdgst": ${hdgst:-false}, 00:19:01.135 "ddgst": ${ddgst:-false} 00:19:01.135 }, 00:19:01.135 "method": "bdev_nvme_attach_controller" 00:19:01.135 } 00:19:01.135 EOF 00:19:01.135 )") 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # cat 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # cat 00:19:01.135 16:43:26 -- target/bdev_io_wait.sh@37 -- # wait 1200028 00:19:01.135 16:43:26 -- nvmf/common.sh@542 -- # cat 00:19:01.135 16:43:26 -- nvmf/common.sh@544 -- # jq . 00:19:01.135 16:43:26 -- nvmf/common.sh@544 -- # jq . 00:19:01.135 16:43:26 -- nvmf/common.sh@544 -- # jq . 00:19:01.135 16:43:26 -- nvmf/common.sh@544 -- # jq . 00:19:01.135 16:43:26 -- nvmf/common.sh@545 -- # IFS=, 00:19:01.135 16:43:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:01.135 "params": { 00:19:01.135 "name": "Nvme1", 00:19:01.135 "trtype": "tcp", 00:19:01.135 "traddr": "10.0.0.2", 00:19:01.135 "adrfam": "ipv4", 00:19:01.135 "trsvcid": "4420", 00:19:01.135 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:01.135 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:01.135 "hdgst": false, 00:19:01.135 "ddgst": false 00:19:01.135 }, 00:19:01.135 "method": "bdev_nvme_attach_controller" 00:19:01.135 }' 00:19:01.135 16:43:26 -- nvmf/common.sh@545 -- # IFS=, 00:19:01.135 16:43:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:01.136 "params": { 00:19:01.136 "name": "Nvme1", 00:19:01.136 "trtype": "tcp", 00:19:01.136 "traddr": "10.0.0.2", 00:19:01.136 "adrfam": "ipv4", 00:19:01.136 "trsvcid": "4420", 00:19:01.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:01.136 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:01.136 "hdgst": false, 00:19:01.136 "ddgst": false 00:19:01.136 }, 00:19:01.136 "method": "bdev_nvme_attach_controller" 00:19:01.136 }' 00:19:01.136 16:43:26 -- nvmf/common.sh@545 -- # IFS=, 00:19:01.136 16:43:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:01.136 "params": { 00:19:01.136 "name": "Nvme1", 00:19:01.136 "trtype": "tcp", 00:19:01.136 "traddr": "10.0.0.2", 00:19:01.136 "adrfam": "ipv4", 00:19:01.136 "trsvcid": "4420", 00:19:01.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:01.136 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:01.136 "hdgst": false, 00:19:01.136 "ddgst": false 00:19:01.136 }, 00:19:01.136 "method": "bdev_nvme_attach_controller" 00:19:01.136 }' 00:19:01.136 16:43:26 -- nvmf/common.sh@545 -- # IFS=, 00:19:01.136 16:43:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:01.136 "params": { 00:19:01.136 "name": "Nvme1", 00:19:01.136 "trtype": "tcp", 00:19:01.136 "traddr": "10.0.0.2", 00:19:01.136 "adrfam": "ipv4", 00:19:01.136 "trsvcid": "4420", 00:19:01.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:01.136 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:01.136 "hdgst": false, 00:19:01.136 "ddgst": false 00:19:01.136 }, 00:19:01.136 "method": "bdev_nvme_attach_controller" 00:19:01.136 }' 00:19:01.136 [2024-10-13 16:43:26.428616] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:01.136 [2024-10-13 16:43:26.428690] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:19:01.136 [2024-10-13 16:43:26.428866] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:01.136 [2024-10-13 16:43:26.428866] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:01.136 [2024-10-13 16:43:26.428867] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:01.136 [2024-10-13 16:43:26.428949] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-13 16:43:26.428950] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-13 16:43:26.428950] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:19:01.136 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:19:01.136 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:19:01.136 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.136 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.136 [2024-10-13 16:43:26.601165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.393 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.393 [2024-10-13 16:43:26.675191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:01.393 [2024-10-13 16:43:26.702102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.393 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.393 [2024-10-13 16:43:26.776150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:01.394 [2024-10-13 16:43:26.802546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.394 [2024-10-13 16:43:26.877414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:01.394 [2024-10-13 16:43:26.877524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.651 [2024-10-13 16:43:26.942964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:19:01.651 Running I/O for 1 seconds... 00:19:01.651 Running I/O for 1 seconds... 00:19:01.909 Running I/O for 1 seconds... 00:19:01.909 Running I/O for 1 seconds... 00:19:02.841 00:19:02.841 Latency(us) 00:19:02.841 [2024-10-13T14:43:28.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.841 [2024-10-13T14:43:28.342Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:19:02.841 Nvme1n1 : 1.02 6459.89 25.23 0.00 0.00 19609.10 9854.67 31068.92 00:19:02.841 [2024-10-13T14:43:28.342Z] =================================================================================================================== 00:19:02.841 [2024-10-13T14:43:28.342Z] Total : 6459.89 25.23 0.00 0.00 19609.10 9854.67 31068.92 00:19:02.841 00:19:02.841 Latency(us) 00:19:02.841 [2024-10-13T14:43:28.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.841 [2024-10-13T14:43:28.342Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:19:02.841 Nvme1n1 : 1.01 9554.10 37.32 0.00 0.00 13333.66 7330.32 24855.13 00:19:02.841 [2024-10-13T14:43:28.342Z] =================================================================================================================== 00:19:02.841 [2024-10-13T14:43:28.342Z] Total : 9554.10 37.32 0.00 0.00 13333.66 7330.32 24855.13 00:19:02.841 00:19:02.842 Latency(us) 00:19:02.842 [2024-10-13T14:43:28.343Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.842 [2024-10-13T14:43:28.343Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:19:02.842 Nvme1n1 : 1.01 6489.91 25.35 0.00 0.00 19664.60 5145.79 47962.64 00:19:02.842 [2024-10-13T14:43:28.343Z] =================================================================================================================== 00:19:02.842 [2024-10-13T14:43:28.343Z] Total : 6489.91 25.35 0.00 0.00 19664.60 5145.79 47962.64 00:19:02.842 00:19:02.842 Latency(us) 00:19:02.842 [2024-10-13T14:43:28.343Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.842 [2024-10-13T14:43:28.343Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:19:02.842 Nvme1n1 : 1.00 194413.48 759.43 0.00 0.00 655.89 253.35 892.02 00:19:02.842 [2024-10-13T14:43:28.343Z] =================================================================================================================== 00:19:02.842 [2024-10-13T14:43:28.343Z] Total : 194413.48 759.43 0.00 0.00 655.89 253.35 892.02 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@38 -- # wait 1200029 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@39 -- # wait 1200031 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@40 -- # wait 1200034 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:03.100 16:43:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.100 16:43:28 -- common/autotest_common.sh@10 -- # set +x 00:19:03.100 16:43:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:19:03.100 16:43:28 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:19:03.100 16:43:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:03.100 16:43:28 -- nvmf/common.sh@116 -- # sync 00:19:03.100 16:43:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:03.100 16:43:28 -- nvmf/common.sh@119 -- # set +e 00:19:03.100 16:43:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:03.100 16:43:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:03.100 rmmod nvme_tcp 00:19:03.100 rmmod nvme_fabrics 00:19:03.100 rmmod nvme_keyring 00:19:03.357 16:43:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:03.357 16:43:28 -- nvmf/common.sh@123 -- # set -e 00:19:03.357 16:43:28 -- nvmf/common.sh@124 -- # return 0 00:19:03.357 16:43:28 -- nvmf/common.sh@477 -- # '[' -n 1200001 ']' 00:19:03.357 16:43:28 -- nvmf/common.sh@478 -- # killprocess 1200001 00:19:03.358 16:43:28 -- common/autotest_common.sh@926 -- # '[' -z 1200001 ']' 00:19:03.358 16:43:28 -- common/autotest_common.sh@930 -- # kill -0 1200001 00:19:03.358 16:43:28 -- common/autotest_common.sh@931 -- # uname 00:19:03.358 16:43:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:03.358 16:43:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1200001 00:19:03.358 16:43:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:03.358 16:43:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:03.358 16:43:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1200001' 00:19:03.358 killing process with pid 1200001 00:19:03.358 16:43:28 -- common/autotest_common.sh@945 -- # kill 1200001 00:19:03.358 16:43:28 -- common/autotest_common.sh@950 -- # wait 1200001 00:19:03.617 16:43:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:03.617 16:43:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:03.617 16:43:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:03.617 16:43:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:03.617 16:43:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:03.617 16:43:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.617 16:43:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.617 16:43:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:05.517 16:43:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:05.517 00:19:05.517 real 0m7.267s 00:19:05.517 user 0m16.467s 00:19:05.517 sys 0m3.589s 00:19:05.517 16:43:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:05.517 16:43:30 -- common/autotest_common.sh@10 -- # set +x 00:19:05.517 ************************************ 00:19:05.517 END TEST nvmf_bdev_io_wait 00:19:05.517 ************************************ 00:19:05.517 16:43:30 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:19:05.517 16:43:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:05.517 16:43:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:05.517 16:43:30 -- common/autotest_common.sh@10 -- # set +x 00:19:05.517 ************************************ 00:19:05.517 START TEST nvmf_queue_depth 00:19:05.517 ************************************ 00:19:05.517 16:43:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:19:05.517 * Looking for test storage... 00:19:05.517 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:05.517 16:43:31 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:05.517 16:43:31 -- nvmf/common.sh@7 -- # uname -s 00:19:05.517 16:43:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:05.517 16:43:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:05.517 16:43:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:05.517 16:43:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:05.517 16:43:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:05.517 16:43:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:05.517 16:43:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:05.517 16:43:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:05.517 16:43:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:05.517 16:43:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:05.517 16:43:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:05.517 16:43:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:05.517 16:43:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:05.517 16:43:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:05.517 16:43:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:05.517 16:43:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:05.517 16:43:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:05.517 16:43:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:05.517 16:43:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:05.517 16:43:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.776 16:43:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.776 16:43:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.776 16:43:31 -- paths/export.sh@5 -- # export PATH 00:19:05.776 16:43:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.776 16:43:31 -- nvmf/common.sh@46 -- # : 0 00:19:05.776 16:43:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:05.776 16:43:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:05.776 16:43:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:05.776 16:43:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:05.776 16:43:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:05.776 16:43:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:05.776 16:43:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:05.776 16:43:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:05.776 16:43:31 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:19:05.776 16:43:31 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:19:05.776 16:43:31 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:05.776 16:43:31 -- target/queue_depth.sh@19 -- # nvmftestinit 00:19:05.776 16:43:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:05.776 16:43:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:05.776 16:43:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:05.776 16:43:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:05.776 16:43:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:05.776 16:43:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:05.776 16:43:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:05.776 16:43:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:05.776 16:43:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:05.776 16:43:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:05.776 16:43:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:05.776 16:43:31 -- common/autotest_common.sh@10 -- # set +x 00:19:07.677 16:43:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:07.677 16:43:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:07.677 16:43:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:07.677 16:43:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:07.677 16:43:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:07.677 16:43:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:07.677 16:43:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:07.677 16:43:32 -- nvmf/common.sh@294 -- # net_devs=() 00:19:07.677 16:43:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:07.677 16:43:32 -- nvmf/common.sh@295 -- # e810=() 00:19:07.677 16:43:32 -- nvmf/common.sh@295 -- # local -ga e810 00:19:07.677 16:43:32 -- nvmf/common.sh@296 -- # x722=() 00:19:07.677 16:43:32 -- nvmf/common.sh@296 -- # local -ga x722 00:19:07.677 16:43:32 -- nvmf/common.sh@297 -- # mlx=() 00:19:07.677 16:43:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:07.677 16:43:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:07.677 16:43:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:07.677 16:43:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:07.677 16:43:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:07.677 16:43:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:07.677 16:43:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:07.677 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:07.677 16:43:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:07.677 16:43:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:07.677 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:07.677 16:43:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:07.677 16:43:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:07.677 16:43:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:07.677 16:43:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:07.677 16:43:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:07.677 16:43:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:07.677 16:43:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:07.677 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:07.677 16:43:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:07.677 16:43:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:07.677 16:43:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:07.677 16:43:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:07.677 16:43:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:07.677 16:43:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:07.677 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:07.677 16:43:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:07.677 16:43:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:07.677 16:43:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:07.677 16:43:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:07.677 16:43:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:07.677 16:43:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:07.677 16:43:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:07.677 16:43:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:07.677 16:43:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:07.677 16:43:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:07.677 16:43:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:07.677 16:43:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:07.677 16:43:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:07.677 16:43:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:07.677 16:43:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:07.677 16:43:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:07.677 16:43:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:07.677 16:43:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:07.677 16:43:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:07.677 16:43:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:07.677 16:43:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:07.677 16:43:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:07.678 16:43:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:07.678 16:43:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:07.678 16:43:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:07.678 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:07.678 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:19:07.678 00:19:07.678 --- 10.0.0.2 ping statistics --- 00:19:07.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:07.678 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:19:07.678 16:43:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:07.678 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:07.678 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:19:07.678 00:19:07.678 --- 10.0.0.1 ping statistics --- 00:19:07.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:07.678 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:19:07.678 16:43:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:07.678 16:43:33 -- nvmf/common.sh@410 -- # return 0 00:19:07.678 16:43:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:07.678 16:43:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:07.678 16:43:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:07.678 16:43:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:07.678 16:43:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:07.678 16:43:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:07.678 16:43:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:07.678 16:43:33 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:19:07.678 16:43:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:07.678 16:43:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:07.678 16:43:33 -- common/autotest_common.sh@10 -- # set +x 00:19:07.678 16:43:33 -- nvmf/common.sh@469 -- # nvmfpid=1202270 00:19:07.678 16:43:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:07.678 16:43:33 -- nvmf/common.sh@470 -- # waitforlisten 1202270 00:19:07.678 16:43:33 -- common/autotest_common.sh@819 -- # '[' -z 1202270 ']' 00:19:07.678 16:43:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:07.678 16:43:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:07.678 16:43:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:07.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:07.678 16:43:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:07.678 16:43:33 -- common/autotest_common.sh@10 -- # set +x 00:19:07.936 [2024-10-13 16:43:33.211368] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:07.936 [2024-10-13 16:43:33.211475] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:07.936 EAL: No free 2048 kB hugepages reported on node 1 00:19:07.936 [2024-10-13 16:43:33.279721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:07.937 [2024-10-13 16:43:33.367470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:07.937 [2024-10-13 16:43:33.367632] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:07.937 [2024-10-13 16:43:33.367652] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:07.937 [2024-10-13 16:43:33.367666] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:07.937 [2024-10-13 16:43:33.367697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:08.973 16:43:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:08.973 16:43:34 -- common/autotest_common.sh@852 -- # return 0 00:19:08.974 16:43:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:08.974 16:43:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 16:43:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:08.974 16:43:34 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:08.974 16:43:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 [2024-10-13 16:43:34.187952] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:08.974 16:43:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:08.974 16:43:34 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:08.974 16:43:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 Malloc0 00:19:08.974 16:43:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:08.974 16:43:34 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:08.974 16:43:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 16:43:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:08.974 16:43:34 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:08.974 16:43:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 16:43:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:08.974 16:43:34 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:08.974 16:43:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 [2024-10-13 16:43:34.254200] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:08.974 16:43:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:08.974 16:43:34 -- target/queue_depth.sh@30 -- # bdevperf_pid=1202428 00:19:08.974 16:43:34 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:19:08.974 16:43:34 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:08.974 16:43:34 -- target/queue_depth.sh@33 -- # waitforlisten 1202428 /var/tmp/bdevperf.sock 00:19:08.974 16:43:34 -- common/autotest_common.sh@819 -- # '[' -z 1202428 ']' 00:19:08.974 16:43:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:08.974 16:43:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:08.974 16:43:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:08.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:08.974 16:43:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:08.974 16:43:34 -- common/autotest_common.sh@10 -- # set +x 00:19:08.974 [2024-10-13 16:43:34.299798] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:08.974 [2024-10-13 16:43:34.299866] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1202428 ] 00:19:08.974 EAL: No free 2048 kB hugepages reported on node 1 00:19:08.974 [2024-10-13 16:43:34.364192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:08.974 [2024-10-13 16:43:34.452751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:09.907 16:43:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:09.907 16:43:35 -- common/autotest_common.sh@852 -- # return 0 00:19:09.907 16:43:35 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:09.907 16:43:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:09.907 16:43:35 -- common/autotest_common.sh@10 -- # set +x 00:19:09.907 NVMe0n1 00:19:09.907 16:43:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:09.907 16:43:35 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:10.165 Running I/O for 10 seconds... 00:19:20.131 00:19:20.131 Latency(us) 00:19:20.131 [2024-10-13T14:43:45.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:20.131 [2024-10-13T14:43:45.632Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:19:20.131 Verification LBA range: start 0x0 length 0x4000 00:19:20.131 NVMe0n1 : 10.07 12222.45 47.74 0.00 0.00 83445.78 14951.92 63691.28 00:19:20.131 [2024-10-13T14:43:45.633Z] =================================================================================================================== 00:19:20.132 [2024-10-13T14:43:45.633Z] Total : 12222.45 47.74 0.00 0.00 83445.78 14951.92 63691.28 00:19:20.132 0 00:19:20.132 16:43:45 -- target/queue_depth.sh@39 -- # killprocess 1202428 00:19:20.132 16:43:45 -- common/autotest_common.sh@926 -- # '[' -z 1202428 ']' 00:19:20.132 16:43:45 -- common/autotest_common.sh@930 -- # kill -0 1202428 00:19:20.132 16:43:45 -- common/autotest_common.sh@931 -- # uname 00:19:20.132 16:43:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:20.132 16:43:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1202428 00:19:20.132 16:43:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:20.132 16:43:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:20.132 16:43:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1202428' 00:19:20.132 killing process with pid 1202428 00:19:20.132 16:43:45 -- common/autotest_common.sh@945 -- # kill 1202428 00:19:20.132 Received shutdown signal, test time was about 10.000000 seconds 00:19:20.132 00:19:20.132 Latency(us) 00:19:20.132 [2024-10-13T14:43:45.633Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:20.132 [2024-10-13T14:43:45.633Z] =================================================================================================================== 00:19:20.132 [2024-10-13T14:43:45.633Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:20.132 16:43:45 -- common/autotest_common.sh@950 -- # wait 1202428 00:19:20.390 16:43:45 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:19:20.390 16:43:45 -- target/queue_depth.sh@43 -- # nvmftestfini 00:19:20.390 16:43:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:20.390 16:43:45 -- nvmf/common.sh@116 -- # sync 00:19:20.390 16:43:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:20.390 16:43:45 -- nvmf/common.sh@119 -- # set +e 00:19:20.390 16:43:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:20.390 16:43:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:20.390 rmmod nvme_tcp 00:19:20.390 rmmod nvme_fabrics 00:19:20.648 rmmod nvme_keyring 00:19:20.648 16:43:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:20.648 16:43:45 -- nvmf/common.sh@123 -- # set -e 00:19:20.648 16:43:45 -- nvmf/common.sh@124 -- # return 0 00:19:20.648 16:43:45 -- nvmf/common.sh@477 -- # '[' -n 1202270 ']' 00:19:20.648 16:43:45 -- nvmf/common.sh@478 -- # killprocess 1202270 00:19:20.648 16:43:45 -- common/autotest_common.sh@926 -- # '[' -z 1202270 ']' 00:19:20.648 16:43:45 -- common/autotest_common.sh@930 -- # kill -0 1202270 00:19:20.648 16:43:45 -- common/autotest_common.sh@931 -- # uname 00:19:20.648 16:43:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:20.648 16:43:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1202270 00:19:20.648 16:43:45 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:20.648 16:43:45 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:20.648 16:43:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1202270' 00:19:20.648 killing process with pid 1202270 00:19:20.648 16:43:45 -- common/autotest_common.sh@945 -- # kill 1202270 00:19:20.648 16:43:45 -- common/autotest_common.sh@950 -- # wait 1202270 00:19:20.907 16:43:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:20.907 16:43:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:20.907 16:43:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:20.907 16:43:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:20.907 16:43:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:20.907 16:43:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:20.907 16:43:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:20.907 16:43:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:22.810 16:43:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:22.810 00:19:22.810 real 0m17.292s 00:19:22.810 user 0m24.831s 00:19:22.810 sys 0m3.141s 00:19:22.810 16:43:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:22.810 16:43:48 -- common/autotest_common.sh@10 -- # set +x 00:19:22.810 ************************************ 00:19:22.810 END TEST nvmf_queue_depth 00:19:22.810 ************************************ 00:19:22.811 16:43:48 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:22.811 16:43:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:22.811 16:43:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:22.811 16:43:48 -- common/autotest_common.sh@10 -- # set +x 00:19:22.811 ************************************ 00:19:22.811 START TEST nvmf_multipath 00:19:22.811 ************************************ 00:19:22.811 16:43:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:23.070 * Looking for test storage... 00:19:23.070 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:23.070 16:43:48 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:23.070 16:43:48 -- nvmf/common.sh@7 -- # uname -s 00:19:23.070 16:43:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:23.070 16:43:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:23.070 16:43:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:23.070 16:43:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:23.070 16:43:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:23.070 16:43:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:23.070 16:43:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:23.070 16:43:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:23.070 16:43:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:23.070 16:43:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:23.070 16:43:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.070 16:43:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.070 16:43:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:23.070 16:43:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:23.070 16:43:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:23.070 16:43:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:23.070 16:43:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:23.070 16:43:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:23.070 16:43:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:23.070 16:43:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.070 16:43:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.070 16:43:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.070 16:43:48 -- paths/export.sh@5 -- # export PATH 00:19:23.070 16:43:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.070 16:43:48 -- nvmf/common.sh@46 -- # : 0 00:19:23.070 16:43:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:23.070 16:43:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:23.070 16:43:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:23.070 16:43:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:23.070 16:43:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:23.070 16:43:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:23.070 16:43:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:23.070 16:43:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:23.070 16:43:48 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:23.070 16:43:48 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:23.070 16:43:48 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:19:23.070 16:43:48 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:23.070 16:43:48 -- target/multipath.sh@43 -- # nvmftestinit 00:19:23.070 16:43:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:23.070 16:43:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:23.070 16:43:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:23.070 16:43:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:23.070 16:43:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:23.070 16:43:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.070 16:43:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.070 16:43:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:23.070 16:43:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:23.070 16:43:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:23.070 16:43:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:23.070 16:43:48 -- common/autotest_common.sh@10 -- # set +x 00:19:24.978 16:43:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:24.978 16:43:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:24.978 16:43:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:24.978 16:43:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:24.978 16:43:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:24.978 16:43:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:24.978 16:43:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:24.978 16:43:50 -- nvmf/common.sh@294 -- # net_devs=() 00:19:24.978 16:43:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:24.978 16:43:50 -- nvmf/common.sh@295 -- # e810=() 00:19:24.978 16:43:50 -- nvmf/common.sh@295 -- # local -ga e810 00:19:24.978 16:43:50 -- nvmf/common.sh@296 -- # x722=() 00:19:24.978 16:43:50 -- nvmf/common.sh@296 -- # local -ga x722 00:19:24.978 16:43:50 -- nvmf/common.sh@297 -- # mlx=() 00:19:24.978 16:43:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:24.978 16:43:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:24.978 16:43:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:24.978 16:43:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:24.978 16:43:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:24.978 16:43:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:24.978 16:43:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:24.978 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:24.978 16:43:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:24.978 16:43:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:24.978 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:24.978 16:43:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:24.978 16:43:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:24.978 16:43:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:24.978 16:43:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:24.978 16:43:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:24.978 16:43:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:24.978 16:43:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:24.978 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:24.978 16:43:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:24.978 16:43:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:24.978 16:43:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:24.978 16:43:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:24.978 16:43:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:24.979 16:43:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:24.979 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:24.979 16:43:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:24.979 16:43:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:24.979 16:43:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:24.979 16:43:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:24.979 16:43:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:24.979 16:43:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:24.979 16:43:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:24.979 16:43:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:24.979 16:43:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:24.979 16:43:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:24.979 16:43:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:24.979 16:43:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:24.979 16:43:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:24.979 16:43:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:24.979 16:43:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:24.979 16:43:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:24.979 16:43:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:24.979 16:43:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:24.979 16:43:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:24.979 16:43:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:24.979 16:43:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:24.979 16:43:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:24.979 16:43:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:24.979 16:43:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:24.979 16:43:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:24.979 16:43:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:24.979 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:24.979 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:19:24.979 00:19:24.979 --- 10.0.0.2 ping statistics --- 00:19:24.979 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:24.979 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:19:25.237 16:43:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:25.237 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:25.237 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:19:25.237 00:19:25.237 --- 10.0.0.1 ping statistics --- 00:19:25.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:25.237 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:19:25.237 16:43:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:25.237 16:43:50 -- nvmf/common.sh@410 -- # return 0 00:19:25.237 16:43:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:25.237 16:43:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:25.237 16:43:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:25.237 16:43:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:25.237 16:43:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:25.237 16:43:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:25.237 16:43:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:25.237 16:43:50 -- target/multipath.sh@45 -- # '[' -z ']' 00:19:25.237 16:43:50 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:19:25.237 only one NIC for nvmf test 00:19:25.237 16:43:50 -- target/multipath.sh@47 -- # nvmftestfini 00:19:25.237 16:43:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:25.237 16:43:50 -- nvmf/common.sh@116 -- # sync 00:19:25.237 16:43:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:25.237 16:43:50 -- nvmf/common.sh@119 -- # set +e 00:19:25.237 16:43:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:25.237 16:43:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:25.237 rmmod nvme_tcp 00:19:25.237 rmmod nvme_fabrics 00:19:25.237 rmmod nvme_keyring 00:19:25.237 16:43:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:25.237 16:43:50 -- nvmf/common.sh@123 -- # set -e 00:19:25.237 16:43:50 -- nvmf/common.sh@124 -- # return 0 00:19:25.237 16:43:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:25.237 16:43:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:25.237 16:43:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:25.237 16:43:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:25.237 16:43:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:25.237 16:43:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:25.237 16:43:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.237 16:43:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.237 16:43:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:27.141 16:43:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:27.141 16:43:52 -- target/multipath.sh@48 -- # exit 0 00:19:27.141 16:43:52 -- target/multipath.sh@1 -- # nvmftestfini 00:19:27.141 16:43:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:27.141 16:43:52 -- nvmf/common.sh@116 -- # sync 00:19:27.141 16:43:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:27.141 16:43:52 -- nvmf/common.sh@119 -- # set +e 00:19:27.141 16:43:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:27.141 16:43:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:27.141 16:43:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:27.141 16:43:52 -- nvmf/common.sh@123 -- # set -e 00:19:27.141 16:43:52 -- nvmf/common.sh@124 -- # return 0 00:19:27.141 16:43:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:27.141 16:43:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:27.141 16:43:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:27.141 16:43:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:27.141 16:43:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:27.141 16:43:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:27.141 16:43:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.141 16:43:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:27.141 16:43:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:27.141 16:43:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:27.141 00:19:27.141 real 0m4.340s 00:19:27.141 user 0m0.849s 00:19:27.141 sys 0m1.498s 00:19:27.141 16:43:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:27.141 16:43:52 -- common/autotest_common.sh@10 -- # set +x 00:19:27.141 ************************************ 00:19:27.141 END TEST nvmf_multipath 00:19:27.141 ************************************ 00:19:27.141 16:43:52 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:27.141 16:43:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:27.141 16:43:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:27.399 16:43:52 -- common/autotest_common.sh@10 -- # set +x 00:19:27.399 ************************************ 00:19:27.399 START TEST nvmf_zcopy 00:19:27.399 ************************************ 00:19:27.399 16:43:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:27.399 * Looking for test storage... 00:19:27.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:27.399 16:43:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:27.399 16:43:52 -- nvmf/common.sh@7 -- # uname -s 00:19:27.399 16:43:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:27.399 16:43:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:27.399 16:43:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:27.399 16:43:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:27.399 16:43:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:27.399 16:43:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:27.399 16:43:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:27.400 16:43:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:27.400 16:43:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:27.400 16:43:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:27.400 16:43:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:27.400 16:43:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:27.400 16:43:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:27.400 16:43:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:27.400 16:43:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:27.400 16:43:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:27.400 16:43:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:27.400 16:43:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:27.400 16:43:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:27.400 16:43:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.400 16:43:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.400 16:43:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.400 16:43:52 -- paths/export.sh@5 -- # export PATH 00:19:27.400 16:43:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.400 16:43:52 -- nvmf/common.sh@46 -- # : 0 00:19:27.400 16:43:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:27.400 16:43:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:27.400 16:43:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:27.400 16:43:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:27.400 16:43:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:27.400 16:43:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:27.400 16:43:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:27.400 16:43:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:27.400 16:43:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:19:27.400 16:43:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:27.400 16:43:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:27.400 16:43:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:27.400 16:43:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:27.400 16:43:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:27.400 16:43:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.400 16:43:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:27.400 16:43:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:27.400 16:43:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:27.400 16:43:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:27.400 16:43:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:27.400 16:43:52 -- common/autotest_common.sh@10 -- # set +x 00:19:29.301 16:43:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:29.301 16:43:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:29.301 16:43:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:29.301 16:43:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:29.301 16:43:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:29.301 16:43:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:29.301 16:43:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:29.301 16:43:54 -- nvmf/common.sh@294 -- # net_devs=() 00:19:29.301 16:43:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:29.301 16:43:54 -- nvmf/common.sh@295 -- # e810=() 00:19:29.301 16:43:54 -- nvmf/common.sh@295 -- # local -ga e810 00:19:29.301 16:43:54 -- nvmf/common.sh@296 -- # x722=() 00:19:29.301 16:43:54 -- nvmf/common.sh@296 -- # local -ga x722 00:19:29.301 16:43:54 -- nvmf/common.sh@297 -- # mlx=() 00:19:29.301 16:43:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:29.301 16:43:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:29.301 16:43:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:29.301 16:43:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:29.301 16:43:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:29.301 16:43:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:29.302 16:43:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:29.302 16:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:29.302 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:29.302 16:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:29.302 16:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:29.302 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:29.302 16:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:29.302 16:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.302 16:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.302 16:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:29.302 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:29.302 16:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.302 16:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:29.302 16:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.302 16:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.302 16:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:29.302 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:29.302 16:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.302 16:43:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:29.302 16:43:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:29.302 16:43:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:29.302 16:43:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:29.302 16:43:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:29.302 16:43:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:29.302 16:43:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:29.302 16:43:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:29.302 16:43:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:29.302 16:43:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:29.302 16:43:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:29.302 16:43:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:29.302 16:43:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:29.302 16:43:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:29.302 16:43:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:29.302 16:43:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:29.561 16:43:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:29.561 16:43:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:29.561 16:43:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:29.561 16:43:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:29.561 16:43:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:29.561 16:43:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:29.561 16:43:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:29.561 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:29.561 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:19:29.561 00:19:29.561 --- 10.0.0.2 ping statistics --- 00:19:29.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:29.561 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:19:29.561 16:43:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:29.561 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:29.561 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:19:29.561 00:19:29.561 --- 10.0.0.1 ping statistics --- 00:19:29.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:29.561 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:19:29.561 16:43:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:29.561 16:43:54 -- nvmf/common.sh@410 -- # return 0 00:19:29.561 16:43:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:29.561 16:43:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:29.561 16:43:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:29.561 16:43:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:29.561 16:43:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:29.561 16:43:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:29.561 16:43:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:29.561 16:43:55 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:19:29.561 16:43:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:29.561 16:43:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:29.561 16:43:55 -- common/autotest_common.sh@10 -- # set +x 00:19:29.561 16:43:55 -- nvmf/common.sh@469 -- # nvmfpid=1207677 00:19:29.561 16:43:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:29.561 16:43:55 -- nvmf/common.sh@470 -- # waitforlisten 1207677 00:19:29.561 16:43:55 -- common/autotest_common.sh@819 -- # '[' -z 1207677 ']' 00:19:29.561 16:43:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:29.561 16:43:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:29.561 16:43:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:29.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:29.561 16:43:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:29.561 16:43:55 -- common/autotest_common.sh@10 -- # set +x 00:19:29.561 [2024-10-13 16:43:55.054591] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:29.561 [2024-10-13 16:43:55.054652] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:29.820 EAL: No free 2048 kB hugepages reported on node 1 00:19:29.820 [2024-10-13 16:43:55.120473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:29.820 [2024-10-13 16:43:55.218211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:29.820 [2024-10-13 16:43:55.218375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:29.820 [2024-10-13 16:43:55.218405] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:29.820 [2024-10-13 16:43:55.218424] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:29.820 [2024-10-13 16:43:55.218468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:30.754 16:43:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:30.754 16:43:56 -- common/autotest_common.sh@852 -- # return 0 00:19:30.754 16:43:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:30.754 16:43:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 16:43:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:30.754 16:43:56 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:19:30.754 16:43:56 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 [2024-10-13 16:43:56.084747] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 [2024-10-13 16:43:56.100928] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 malloc0 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:30.754 16:43:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:30.754 16:43:56 -- common/autotest_common.sh@10 -- # set +x 00:19:30.754 16:43:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:30.754 16:43:56 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:19:30.754 16:43:56 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:19:30.754 16:43:56 -- nvmf/common.sh@520 -- # config=() 00:19:30.754 16:43:56 -- nvmf/common.sh@520 -- # local subsystem config 00:19:30.754 16:43:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:30.754 16:43:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:30.754 { 00:19:30.754 "params": { 00:19:30.754 "name": "Nvme$subsystem", 00:19:30.754 "trtype": "$TEST_TRANSPORT", 00:19:30.754 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:30.754 "adrfam": "ipv4", 00:19:30.754 "trsvcid": "$NVMF_PORT", 00:19:30.754 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:30.754 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:30.754 "hdgst": ${hdgst:-false}, 00:19:30.754 "ddgst": ${ddgst:-false} 00:19:30.754 }, 00:19:30.754 "method": "bdev_nvme_attach_controller" 00:19:30.754 } 00:19:30.754 EOF 00:19:30.754 )") 00:19:30.754 16:43:56 -- nvmf/common.sh@542 -- # cat 00:19:30.754 16:43:56 -- nvmf/common.sh@544 -- # jq . 00:19:30.754 16:43:56 -- nvmf/common.sh@545 -- # IFS=, 00:19:30.754 16:43:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:30.754 "params": { 00:19:30.754 "name": "Nvme1", 00:19:30.754 "trtype": "tcp", 00:19:30.754 "traddr": "10.0.0.2", 00:19:30.754 "adrfam": "ipv4", 00:19:30.754 "trsvcid": "4420", 00:19:30.754 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:30.754 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:30.754 "hdgst": false, 00:19:30.754 "ddgst": false 00:19:30.754 }, 00:19:30.754 "method": "bdev_nvme_attach_controller" 00:19:30.754 }' 00:19:30.754 [2024-10-13 16:43:56.174285] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:30.754 [2024-10-13 16:43:56.174360] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1207834 ] 00:19:30.754 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.754 [2024-10-13 16:43:56.237975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:31.012 [2024-10-13 16:43:56.333081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:31.270 Running I/O for 10 seconds... 00:19:41.241 00:19:41.241 Latency(us) 00:19:41.241 [2024-10-13T14:44:06.742Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:41.241 [2024-10-13T14:44:06.742Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:41.241 Verification LBA range: start 0x0 length 0x1000 00:19:41.241 Nvme1n1 : 10.01 8669.80 67.73 0.00 0.00 14728.66 825.27 23301.69 00:19:41.241 [2024-10-13T14:44:06.742Z] =================================================================================================================== 00:19:41.241 [2024-10-13T14:44:06.742Z] Total : 8669.80 67.73 0.00 0.00 14728.66 825.27 23301.69 00:19:41.500 16:44:06 -- target/zcopy.sh@39 -- # perfpid=1209182 00:19:41.500 16:44:06 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:41.500 16:44:06 -- common/autotest_common.sh@10 -- # set +x 00:19:41.500 16:44:06 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:41.500 16:44:06 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:41.500 16:44:06 -- nvmf/common.sh@520 -- # config=() 00:19:41.500 16:44:06 -- nvmf/common.sh@520 -- # local subsystem config 00:19:41.500 16:44:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:41.500 16:44:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:41.500 { 00:19:41.500 "params": { 00:19:41.500 "name": "Nvme$subsystem", 00:19:41.500 "trtype": "$TEST_TRANSPORT", 00:19:41.500 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:41.500 "adrfam": "ipv4", 00:19:41.500 "trsvcid": "$NVMF_PORT", 00:19:41.500 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:41.500 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:41.500 "hdgst": ${hdgst:-false}, 00:19:41.500 "ddgst": ${ddgst:-false} 00:19:41.500 }, 00:19:41.500 "method": "bdev_nvme_attach_controller" 00:19:41.500 } 00:19:41.500 EOF 00:19:41.500 )") 00:19:41.500 16:44:06 -- nvmf/common.sh@542 -- # cat 00:19:41.500 [2024-10-13 16:44:06.932762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.932809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 16:44:06 -- nvmf/common.sh@544 -- # jq . 00:19:41.500 16:44:06 -- nvmf/common.sh@545 -- # IFS=, 00:19:41.500 16:44:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:41.500 "params": { 00:19:41.500 "name": "Nvme1", 00:19:41.500 "trtype": "tcp", 00:19:41.500 "traddr": "10.0.0.2", 00:19:41.500 "adrfam": "ipv4", 00:19:41.500 "trsvcid": "4420", 00:19:41.500 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:41.500 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:41.500 "hdgst": false, 00:19:41.500 "ddgst": false 00:19:41.500 }, 00:19:41.500 "method": "bdev_nvme_attach_controller" 00:19:41.500 }' 00:19:41.500 [2024-10-13 16:44:06.940712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.940738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.948724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.948748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.956755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.956779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.964769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.964793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.970188] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:41.500 [2024-10-13 16:44:06.970263] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1209182 ] 00:19:41.500 [2024-10-13 16:44:06.972789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.972814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.980811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.980835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.988834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.988858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 [2024-10-13 16:44:06.996855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.500 [2024-10-13 16:44:06.996879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.500 EAL: No free 2048 kB hugepages reported on node 1 00:19:41.758 [2024-10-13 16:44:07.004877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.004901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.012897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.012921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.020918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.020942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.028941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.028965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.033504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:41.759 [2024-10-13 16:44:07.036976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.037005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.045018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.045058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.053010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.053036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.061036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.061064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.069055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.069082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.077074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.077100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.085111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.085142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.093155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.093196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.101143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.101168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.109167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.109191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.117189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.117213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.125219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.125245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.127534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:41.759 [2024-10-13 16:44:07.133234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.133259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.141259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.141285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.149310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.149349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.157337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.157379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.165363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.165416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.173391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.173440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.181411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.181452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.189430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.189471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.197426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.197453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.205473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.205513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.213496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.213539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.221512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.221555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.229501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.229525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.237522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.237546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.245568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.245599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:41.759 [2024-10-13 16:44:07.253577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:41.759 [2024-10-13 16:44:07.253604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.261598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.261624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.269641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.269670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.277647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.277674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.285673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.285701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.293689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.293714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.017 [2024-10-13 16:44:07.302490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.017 [2024-10-13 16:44:07.302521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.309737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.309764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 Running I/O for 5 seconds... 00:19:42.018 [2024-10-13 16:44:07.317761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.317788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.333051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.333085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.345238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.345270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.357796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.357828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.370199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.370231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.382276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.382308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.394521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.394552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.406415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.406445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.419353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.419383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.431893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.431925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.444407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.444438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.457244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.457275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.470036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.470067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.482378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.482417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.494533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.494565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.506273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.506304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.018 [2024-10-13 16:44:07.518046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.018 [2024-10-13 16:44:07.518077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.529820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.529852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.542260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.542292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.554135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.554166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.566419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.566460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.578509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.578540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.591210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.591241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.603697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.603727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.616114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.616145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.628292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.628323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.640474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.640505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.653159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.653189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.667462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.667493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.678833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.678864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.690873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.690905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.703301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.703332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.715240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.715272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.727852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.727884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.740052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.740084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.752079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.752111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.764028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.764059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.276 [2024-10-13 16:44:07.776284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.276 [2024-10-13 16:44:07.776315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.788469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.788501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.800850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.800889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.814294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.814325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.825858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.825890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.838262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.838294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.851066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.851097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.863678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.863708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.875865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.875896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.887921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.887952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.899722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.899753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.911403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.911434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.923508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.923540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.935890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.935921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.947775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.947807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.961506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.961538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.972879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.972911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.985131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.985163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:07.996846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:07.996877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:08.009101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:08.009132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:08.021419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:08.021451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.535 [2024-10-13 16:44:08.033373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.535 [2024-10-13 16:44:08.033431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.793 [2024-10-13 16:44:08.045388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.793 [2024-10-13 16:44:08.045427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.793 [2024-10-13 16:44:08.057771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.793 [2024-10-13 16:44:08.057802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.793 [2024-10-13 16:44:08.069845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.793 [2024-10-13 16:44:08.069876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.793 [2024-10-13 16:44:08.081714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.793 [2024-10-13 16:44:08.081745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.094096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.094127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.106234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.106265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.118556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.118588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.130504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.130535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.142733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.142764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.155134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.155165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.167470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.167502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.179649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.179679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.191146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.191177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.203700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.203731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.216014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.216045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.229832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.229864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.241665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.241696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.253490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.253521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.265464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.265504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.277723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.277754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:42.794 [2024-10-13 16:44:08.289847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:42.794 [2024-10-13 16:44:08.289878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.301963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.301994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.314338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.314369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.326859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.326891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.339259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.339290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.351678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.351709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.363959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.363990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.376168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.376199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.388129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.388161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.400288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.400318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.412792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.412824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.425462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.425493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.437495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.437527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.449690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.449720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.461625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.461656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.473772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.473803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.486027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.486057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.498853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.498894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.511452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.511483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.523684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.523715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.536573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.536603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.052 [2024-10-13 16:44:08.548388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.052 [2024-10-13 16:44:08.548427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.310 [2024-10-13 16:44:08.560405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.310 [2024-10-13 16:44:08.560437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.310 [2024-10-13 16:44:08.572633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.310 [2024-10-13 16:44:08.572664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.310 [2024-10-13 16:44:08.584661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.310 [2024-10-13 16:44:08.584691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.310 [2024-10-13 16:44:08.596899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.310 [2024-10-13 16:44:08.596930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.609167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.609198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.621256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.621286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.633206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.633237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.644670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.644701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.656589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.656620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.669472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.669504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.681724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.681755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.694095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.694126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.705824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.705854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.717853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.717884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.730090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.730122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.741544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.741576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.753182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.753213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.764817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.764848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.776798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.776829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.788449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.788479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.311 [2024-10-13 16:44:08.800625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.311 [2024-10-13 16:44:08.800655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.812578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.812609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.826504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.826535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.837517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.837549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.849673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.849704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.861478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.861510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.872889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.872921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.884996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.885027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.896505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.896536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.907491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.907523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.919652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.919683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.931494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.931525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.943799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.943830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.955484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.955516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.967294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.967325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.979175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.979206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:08.991160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:08.991191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.003612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.003643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.015317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.015348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.027540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.027571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.039575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.039606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.051707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.051738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.569 [2024-10-13 16:44:09.064045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.569 [2024-10-13 16:44:09.064076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.075859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.075890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.088473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.088504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.101255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.101286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.113712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.113745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.126243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.126275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.138019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.138050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.150413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.150447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.162292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.162322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.174867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.174899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.186838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.186869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.198563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.198594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.211087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.211118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.222915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.222946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.234537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.234578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.247208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.247241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.259365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.259406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.271087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.271118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.283299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.283330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.295452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.295483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.306908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.306939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:43.828 [2024-10-13 16:44:09.318949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:43.828 [2024-10-13 16:44:09.318980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.331212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.331242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.343127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.343157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.355576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.355607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.367903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.367934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.380160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.380191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.392208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.392239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.406272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.406312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.418084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.418115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.429681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.429712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.442209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.442239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.454528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.454559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.466701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.466731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.479362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.479404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.491811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.491842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.504034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.504065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.515624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.515654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.527327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.527358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.539104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.539136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.551000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.551030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.562593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.562624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.574181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.574212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.087 [2024-10-13 16:44:09.585886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.087 [2024-10-13 16:44:09.585917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.597590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.597621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.609550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.609582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.621350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.621381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.633454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.633493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.645854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.645884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.657723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.345 [2024-10-13 16:44:09.657753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.345 [2024-10-13 16:44:09.669635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.669665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.681647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.681678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.692996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.693027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.704911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.704941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.717378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.717420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.729144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.729175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.741249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.741279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.755050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.755081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.767206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.767237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.779034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.779065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.790964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.790994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.803042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.803073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.815161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.815192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.827249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.827280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.346 [2024-10-13 16:44:09.839401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.346 [2024-10-13 16:44:09.839432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.851128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.851160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.862851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.862891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.875605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.875636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.887447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.887478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.899793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.899824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.912459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.912490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.924245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.924276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.936595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.936626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.948982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.949014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.961450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.961481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.973655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.973686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.985468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.985500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:09.997323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:09.997355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.009807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.009840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.021748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.021781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.034189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.034220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.047329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.047361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.059767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.059798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.072094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.072126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.084252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.084284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.604 [2024-10-13 16:44:10.096721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.604 [2024-10-13 16:44:10.096763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.109082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.109114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.121583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.121615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.134190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.134221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.146623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.146653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.159486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.159518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.172053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.172083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.184360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.184391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.196383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.196426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.208240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.208270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.220830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.220861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.233099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.233129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.245049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.245081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.257275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.257306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.269177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.269208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.280780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.280810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.293115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.293146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.305375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.305416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.317924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.317956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.330181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.330222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.342109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.342139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:44.863 [2024-10-13 16:44:10.354239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:44.863 [2024-10-13 16:44:10.354270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.366373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.366415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.378680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.378711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.391111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.391142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.403382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.403426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.415826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.415857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.428521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.428552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.441160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.441190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.452710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.452741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.466693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.466723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.478329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.478359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.490760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.490790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.503533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.503565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.516263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.516294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.528491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.528522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.540467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.540498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.552330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.552361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.564645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.564676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.577087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.577117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.588910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.588941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.600813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.600844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.122 [2024-10-13 16:44:10.613099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.122 [2024-10-13 16:44:10.613129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.625039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.625071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.637308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.637339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.649364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.649402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.662189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.662221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.676465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.676496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.380 [2024-10-13 16:44:10.687890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.380 [2024-10-13 16:44:10.687921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.699949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.699980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.711648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.711678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.723576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.723607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.735022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.735052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.748786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.748817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.759902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.759933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.771855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.771886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.783707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.783737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.795116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.795147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.806843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.806874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.818335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.818365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.830369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.830410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.842589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.842620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.854683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.854714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.866934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.866965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.381 [2024-10-13 16:44:10.879033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.381 [2024-10-13 16:44:10.879064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.639 [2024-10-13 16:44:10.891004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.639 [2024-10-13 16:44:10.891035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.639 [2024-10-13 16:44:10.903493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.639 [2024-10-13 16:44:10.903523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.639 [2024-10-13 16:44:10.915918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.639 [2024-10-13 16:44:10.915948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.639 [2024-10-13 16:44:10.928538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.928569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:10.942918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.942950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:10.954482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.954514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:10.966849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.966880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:10.979107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.979139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:10.991039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:10.991070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.002702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.002732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.014259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.014289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.025857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.025887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.038049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.038080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.050642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.050674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.062624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.062656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.074712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.074742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.086586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.086617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.098542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.098573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.111132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.111163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.123103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.123134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.640 [2024-10-13 16:44:11.134779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.640 [2024-10-13 16:44:11.134811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.146894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.146926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.158812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.158844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.171539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.171570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.184008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.184039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.196822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.196853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.209053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.209085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.221756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.221790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.898 [2024-10-13 16:44:11.234156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.898 [2024-10-13 16:44:11.234188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.246536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.246577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.258456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.258487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.270462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.270492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.282839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.282870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.295088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.295119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.307298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.307329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.320833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.320865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.332572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.332603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.344605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.344637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.356227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.356258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.368044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.368074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.380082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.380112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:45.899 [2024-10-13 16:44:11.392647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:45.899 [2024-10-13 16:44:11.392678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.405208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.405239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.417467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.417498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.429661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.429692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.442070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.442101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.454273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.454304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.466247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.466278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.478241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.478280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.490559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.490590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.502974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.503004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.515100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.515131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.157 [2024-10-13 16:44:11.527559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.157 [2024-10-13 16:44:11.527589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.539571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.539602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.553533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.553564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.565153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.565184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.577471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.577501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.589178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.589209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.601181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.601212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.614692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.614722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.625561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.625592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.637734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.637764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.158 [2024-10-13 16:44:11.649999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.158 [2024-10-13 16:44:11.650029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.662078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.662109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.673990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.674021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.686224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.686255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.698405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.698436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.710500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.710541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.722599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.722630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.734899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.734930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.747525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.747556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.759584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.759614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.772315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.772346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.783896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.783927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.795712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.795743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.807328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.807358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.819610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.819641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.831800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.831831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.844304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.844336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.856456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.856487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.868161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.868192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.882131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.882162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.893632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.416 [2024-10-13 16:44:11.893662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.416 [2024-10-13 16:44:11.905606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.417 [2024-10-13 16:44:11.905636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.918093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.918124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.930536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.930569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.942804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.942845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.954890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.954920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.966867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.966898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.979165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.979197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:11.991973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:11.992003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.003835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.003866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.016026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.016057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.027853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.027885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.040060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.040091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.052027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.052058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.064510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.064540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.078530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.078561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.090554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.090585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.102552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.102583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.114942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.114973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.127160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.127191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.139536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.139569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.151343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.151374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.163555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.163586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.675 [2024-10-13 16:44:12.175560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.675 [2024-10-13 16:44:12.175608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.187032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.187063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.198804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.198834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.210773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.210804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.222606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.222637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.234574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.234606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.249020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.249051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.261051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.261083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.273718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.273753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.285619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.285650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.298594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.298625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.310432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.310463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.322541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.322573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.334427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.334470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.339241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.339271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 00:19:46.934 Latency(us) 00:19:46.934 [2024-10-13T14:44:12.435Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:46.934 [2024-10-13T14:44:12.435Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:46.934 Nvme1n1 : 5.01 10463.25 81.74 0.00 0.00 12214.71 5485.61 26214.40 00:19:46.934 [2024-10-13T14:44:12.435Z] =================================================================================================================== 00:19:46.934 [2024-10-13T14:44:12.435Z] Total : 10463.25 81.74 0.00 0.00 12214.71 5485.61 26214.40 00:19:46.934 [2024-10-13 16:44:12.347299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.347328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.355288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.355319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.363363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.363425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.371383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.371447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.379419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.379484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.387438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.387497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.395467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.395524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.403490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.403551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.411501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.411552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.419516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.419566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:46.934 [2024-10-13 16:44:12.427546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:46.934 [2024-10-13 16:44:12.427599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.435571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.435621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.443598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.443651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.451607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.451659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.459629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.459680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.467655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.467707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.475686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.475735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.483674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.483715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.491669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.491695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.499731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.499777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.507767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.507818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.515783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.515827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.523762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.523789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.531813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.531852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.539858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.539908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.547879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.547925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.555854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.555880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.563874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.563899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 [2024-10-13 16:44:12.571896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:47.193 [2024-10-13 16:44:12.571921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:47.193 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1209182) - No such process 00:19:47.193 16:44:12 -- target/zcopy.sh@49 -- # wait 1209182 00:19:47.193 16:44:12 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:47.193 16:44:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:47.193 16:44:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.193 16:44:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:47.193 16:44:12 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:47.193 16:44:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:47.193 16:44:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.193 delay0 00:19:47.193 16:44:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:47.193 16:44:12 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:47.193 16:44:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:47.193 16:44:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.193 16:44:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:47.193 16:44:12 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:47.193 EAL: No free 2048 kB hugepages reported on node 1 00:19:47.451 [2024-10-13 16:44:12.733514] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:54.009 [2024-10-13 16:44:18.806259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8035d0 is same with the state(5) to be set 00:19:54.009 Initializing NVMe Controllers 00:19:54.009 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:54.009 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:54.009 Initialization complete. Launching workers. 00:19:54.009 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 131 00:19:54.009 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 418, failed to submit 33 00:19:54.009 success 281, unsuccess 137, failed 0 00:19:54.009 16:44:18 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:54.009 16:44:18 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:54.009 16:44:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.009 16:44:18 -- nvmf/common.sh@116 -- # sync 00:19:54.009 16:44:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.009 16:44:18 -- nvmf/common.sh@119 -- # set +e 00:19:54.009 16:44:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.009 16:44:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.009 rmmod nvme_tcp 00:19:54.009 rmmod nvme_fabrics 00:19:54.009 rmmod nvme_keyring 00:19:54.009 16:44:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.009 16:44:18 -- nvmf/common.sh@123 -- # set -e 00:19:54.009 16:44:18 -- nvmf/common.sh@124 -- # return 0 00:19:54.009 16:44:18 -- nvmf/common.sh@477 -- # '[' -n 1207677 ']' 00:19:54.009 16:44:18 -- nvmf/common.sh@478 -- # killprocess 1207677 00:19:54.009 16:44:18 -- common/autotest_common.sh@926 -- # '[' -z 1207677 ']' 00:19:54.009 16:44:18 -- common/autotest_common.sh@930 -- # kill -0 1207677 00:19:54.009 16:44:18 -- common/autotest_common.sh@931 -- # uname 00:19:54.009 16:44:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:54.009 16:44:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1207677 00:19:54.009 16:44:18 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:54.009 16:44:18 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:54.009 16:44:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1207677' 00:19:54.009 killing process with pid 1207677 00:19:54.009 16:44:18 -- common/autotest_common.sh@945 -- # kill 1207677 00:19:54.009 16:44:18 -- common/autotest_common.sh@950 -- # wait 1207677 00:19:54.009 16:44:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:54.009 16:44:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:54.009 16:44:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:54.009 16:44:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:54.009 16:44:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:54.009 16:44:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:54.009 16:44:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:54.009 16:44:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:55.912 16:44:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:55.912 00:19:55.912 real 0m28.537s 00:19:55.912 user 0m41.392s 00:19:55.912 sys 0m8.269s 00:19:55.912 16:44:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:55.912 16:44:21 -- common/autotest_common.sh@10 -- # set +x 00:19:55.912 ************************************ 00:19:55.912 END TEST nvmf_zcopy 00:19:55.912 ************************************ 00:19:55.912 16:44:21 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:55.912 16:44:21 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:55.912 16:44:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:55.912 16:44:21 -- common/autotest_common.sh@10 -- # set +x 00:19:55.912 ************************************ 00:19:55.912 START TEST nvmf_nmic 00:19:55.912 ************************************ 00:19:55.912 16:44:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:55.912 * Looking for test storage... 00:19:55.912 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:55.912 16:44:21 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:55.912 16:44:21 -- nvmf/common.sh@7 -- # uname -s 00:19:55.912 16:44:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:55.912 16:44:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:55.912 16:44:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:55.912 16:44:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:55.912 16:44:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:55.912 16:44:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:55.912 16:44:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:55.912 16:44:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:55.912 16:44:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:55.912 16:44:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:55.912 16:44:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:55.912 16:44:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:55.912 16:44:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:55.912 16:44:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:55.912 16:44:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:55.912 16:44:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:55.912 16:44:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:55.912 16:44:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:55.912 16:44:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:55.912 16:44:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.912 16:44:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.912 16:44:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.912 16:44:21 -- paths/export.sh@5 -- # export PATH 00:19:55.912 16:44:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.912 16:44:21 -- nvmf/common.sh@46 -- # : 0 00:19:55.912 16:44:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:55.912 16:44:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:55.912 16:44:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:55.912 16:44:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:55.912 16:44:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:55.912 16:44:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:55.912 16:44:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:55.912 16:44:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:55.912 16:44:21 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:55.912 16:44:21 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:55.912 16:44:21 -- target/nmic.sh@14 -- # nvmftestinit 00:19:55.912 16:44:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:55.912 16:44:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:55.912 16:44:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:55.912 16:44:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:55.912 16:44:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:55.912 16:44:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:55.912 16:44:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:55.912 16:44:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:55.912 16:44:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:55.912 16:44:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:55.912 16:44:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:55.912 16:44:21 -- common/autotest_common.sh@10 -- # set +x 00:19:57.850 16:44:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:57.850 16:44:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:57.850 16:44:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:57.850 16:44:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:57.850 16:44:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:57.850 16:44:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:57.850 16:44:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:57.850 16:44:23 -- nvmf/common.sh@294 -- # net_devs=() 00:19:57.850 16:44:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:57.850 16:44:23 -- nvmf/common.sh@295 -- # e810=() 00:19:57.850 16:44:23 -- nvmf/common.sh@295 -- # local -ga e810 00:19:57.850 16:44:23 -- nvmf/common.sh@296 -- # x722=() 00:19:57.850 16:44:23 -- nvmf/common.sh@296 -- # local -ga x722 00:19:57.850 16:44:23 -- nvmf/common.sh@297 -- # mlx=() 00:19:57.850 16:44:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:57.850 16:44:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:57.850 16:44:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:57.850 16:44:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:57.850 16:44:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.850 16:44:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:57.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:57.850 16:44:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.850 16:44:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:57.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:57.850 16:44:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.850 16:44:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.850 16:44:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.850 16:44:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:57.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:57.850 16:44:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.850 16:44:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.850 16:44:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.850 16:44:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.850 16:44:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:57.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:57.850 16:44:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.850 16:44:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:57.850 16:44:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:57.850 16:44:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:57.850 16:44:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:57.850 16:44:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:57.850 16:44:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:57.850 16:44:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:57.850 16:44:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:57.850 16:44:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:57.850 16:44:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:57.850 16:44:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:57.850 16:44:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:57.850 16:44:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:57.850 16:44:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:57.850 16:44:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:57.850 16:44:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:58.135 16:44:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:58.135 16:44:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:58.135 16:44:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:58.135 16:44:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:58.135 16:44:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:58.135 16:44:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:58.135 16:44:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:58.135 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:58.135 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:19:58.135 00:19:58.135 --- 10.0.0.2 ping statistics --- 00:19:58.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.135 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:19:58.135 16:44:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:58.135 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:58.135 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:19:58.135 00:19:58.135 --- 10.0.0.1 ping statistics --- 00:19:58.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.135 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:19:58.135 16:44:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:58.135 16:44:23 -- nvmf/common.sh@410 -- # return 0 00:19:58.135 16:44:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:58.135 16:44:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:58.135 16:44:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:58.135 16:44:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:58.135 16:44:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:58.135 16:44:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:58.135 16:44:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:58.135 16:44:23 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:58.135 16:44:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:58.135 16:44:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:58.135 16:44:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.135 16:44:23 -- nvmf/common.sh@469 -- # nvmfpid=1212498 00:19:58.135 16:44:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:58.135 16:44:23 -- nvmf/common.sh@470 -- # waitforlisten 1212498 00:19:58.135 16:44:23 -- common/autotest_common.sh@819 -- # '[' -z 1212498 ']' 00:19:58.135 16:44:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:58.135 16:44:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:58.135 16:44:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:58.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:58.135 16:44:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:58.135 16:44:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.135 [2024-10-13 16:44:23.475367] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:19:58.135 [2024-10-13 16:44:23.475489] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:58.135 EAL: No free 2048 kB hugepages reported on node 1 00:19:58.135 [2024-10-13 16:44:23.545149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:58.393 [2024-10-13 16:44:23.640564] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:58.393 [2024-10-13 16:44:23.640704] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:58.393 [2024-10-13 16:44:23.640722] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:58.393 [2024-10-13 16:44:23.640735] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:58.393 [2024-10-13 16:44:23.640798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:58.393 [2024-10-13 16:44:23.640851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:58.393 [2024-10-13 16:44:23.640827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:58.393 [2024-10-13 16:44:23.640854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:59.327 16:44:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:59.327 16:44:24 -- common/autotest_common.sh@852 -- # return 0 00:19:59.327 16:44:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:59.327 16:44:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 16:44:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.327 16:44:24 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 [2024-10-13 16:44:24.506187] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 Malloc0 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 [2024-10-13 16:44:24.559877] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:59.327 test case1: single bdev can't be used in multiple subsystems 00:19:59.327 16:44:24 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.327 16:44:24 -- target/nmic.sh@28 -- # nmic_status=0 00:19:59.327 16:44:24 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:59.327 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.327 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.327 [2024-10-13 16:44:24.583694] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:59.327 [2024-10-13 16:44:24.583724] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:59.327 [2024-10-13 16:44:24.583754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:59.327 request: 00:19:59.327 { 00:19:59.327 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:59.327 "namespace": { 00:19:59.327 "bdev_name": "Malloc0" 00:19:59.327 }, 00:19:59.327 "method": "nvmf_subsystem_add_ns", 00:19:59.327 "req_id": 1 00:19:59.327 } 00:19:59.327 Got JSON-RPC error response 00:19:59.327 response: 00:19:59.327 { 00:19:59.327 "code": -32602, 00:19:59.327 "message": "Invalid parameters" 00:19:59.327 } 00:19:59.328 16:44:24 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:19:59.328 16:44:24 -- target/nmic.sh@29 -- # nmic_status=1 00:19:59.328 16:44:24 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:59.328 16:44:24 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:59.328 Adding namespace failed - expected result. 00:19:59.328 16:44:24 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:59.328 test case2: host connect to nvmf target in multiple paths 00:19:59.328 16:44:24 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:59.328 16:44:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.328 16:44:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.328 [2024-10-13 16:44:24.591831] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:59.328 16:44:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.328 16:44:24 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:59.893 16:44:25 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:20:00.458 16:44:25 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:20:00.459 16:44:25 -- common/autotest_common.sh@1177 -- # local i=0 00:20:00.459 16:44:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:00.459 16:44:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:00.459 16:44:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:02.985 16:44:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:02.985 16:44:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:02.985 16:44:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:20:02.985 16:44:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:02.985 16:44:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:02.985 16:44:27 -- common/autotest_common.sh@1187 -- # return 0 00:20:02.985 16:44:27 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:20:02.985 [global] 00:20:02.985 thread=1 00:20:02.985 invalidate=1 00:20:02.985 rw=write 00:20:02.985 time_based=1 00:20:02.985 runtime=1 00:20:02.985 ioengine=libaio 00:20:02.985 direct=1 00:20:02.985 bs=4096 00:20:02.985 iodepth=1 00:20:02.985 norandommap=0 00:20:02.985 numjobs=1 00:20:02.985 00:20:02.985 verify_dump=1 00:20:02.985 verify_backlog=512 00:20:02.985 verify_state_save=0 00:20:02.985 do_verify=1 00:20:02.985 verify=crc32c-intel 00:20:02.985 [job0] 00:20:02.985 filename=/dev/nvme0n1 00:20:02.985 Could not set queue depth (nvme0n1) 00:20:02.985 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:02.985 fio-3.35 00:20:02.985 Starting 1 thread 00:20:03.921 00:20:03.921 job0: (groupid=0, jobs=1): err= 0: pid=1213155: Sun Oct 13 16:44:29 2024 00:20:03.921 read: IOPS=22, BW=89.2KiB/s (91.4kB/s)(92.0KiB/1031msec) 00:20:03.921 slat (nsec): min=8536, max=33168, avg=29564.70, stdev=7284.23 00:20:03.921 clat (usec): min=40871, max=42028, avg=41325.92, stdev=492.28 00:20:03.921 lat (usec): min=40903, max=42045, avg=41355.49, stdev=492.16 00:20:03.921 clat percentiles (usec): 00:20:03.921 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:20:03.921 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:03.921 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:20:03.921 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:03.921 | 99.99th=[42206] 00:20:03.921 write: IOPS=496, BW=1986KiB/s (2034kB/s)(2048KiB/1031msec); 0 zone resets 00:20:03.921 slat (nsec): min=7003, max=44433, avg=9595.86, stdev=3916.08 00:20:03.921 clat (usec): min=124, max=276, avg=143.39, stdev=12.68 00:20:03.921 lat (usec): min=133, max=301, avg=152.98, stdev=14.09 00:20:03.921 clat percentiles (usec): 00:20:03.921 | 1.00th=[ 127], 5.00th=[ 130], 10.00th=[ 133], 20.00th=[ 135], 00:20:03.921 | 30.00th=[ 137], 40.00th=[ 139], 50.00th=[ 141], 60.00th=[ 145], 00:20:03.921 | 70.00th=[ 147], 80.00th=[ 151], 90.00th=[ 157], 95.00th=[ 165], 00:20:03.921 | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 277], 99.95th=[ 277], 00:20:03.921 | 99.99th=[ 277] 00:20:03.921 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:20:03.921 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:03.921 lat (usec) : 250=95.33%, 500=0.37% 00:20:03.921 lat (msec) : 50=4.30% 00:20:03.921 cpu : usr=0.19%, sys=0.49%, ctx=535, majf=0, minf=1 00:20:03.921 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:03.921 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.921 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.921 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.921 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:03.921 00:20:03.921 Run status group 0 (all jobs): 00:20:03.921 READ: bw=89.2KiB/s (91.4kB/s), 89.2KiB/s-89.2KiB/s (91.4kB/s-91.4kB/s), io=92.0KiB (94.2kB), run=1031-1031msec 00:20:03.921 WRITE: bw=1986KiB/s (2034kB/s), 1986KiB/s-1986KiB/s (2034kB/s-2034kB/s), io=2048KiB (2097kB), run=1031-1031msec 00:20:03.921 00:20:03.921 Disk stats (read/write): 00:20:03.921 nvme0n1: ios=69/512, merge=0/0, ticks=813/73, in_queue=886, util=91.48% 00:20:03.921 16:44:29 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:04.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:20:04.179 16:44:29 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:04.179 16:44:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:04.179 16:44:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:04.179 16:44:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:04.179 16:44:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:04.179 16:44:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:04.179 16:44:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:04.179 16:44:29 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:20:04.179 16:44:29 -- target/nmic.sh@53 -- # nvmftestfini 00:20:04.179 16:44:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:04.179 16:44:29 -- nvmf/common.sh@116 -- # sync 00:20:04.179 16:44:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:04.179 16:44:29 -- nvmf/common.sh@119 -- # set +e 00:20:04.179 16:44:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:04.179 16:44:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:04.179 rmmod nvme_tcp 00:20:04.179 rmmod nvme_fabrics 00:20:04.179 rmmod nvme_keyring 00:20:04.179 16:44:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:04.179 16:44:29 -- nvmf/common.sh@123 -- # set -e 00:20:04.179 16:44:29 -- nvmf/common.sh@124 -- # return 0 00:20:04.179 16:44:29 -- nvmf/common.sh@477 -- # '[' -n 1212498 ']' 00:20:04.179 16:44:29 -- nvmf/common.sh@478 -- # killprocess 1212498 00:20:04.179 16:44:29 -- common/autotest_common.sh@926 -- # '[' -z 1212498 ']' 00:20:04.179 16:44:29 -- common/autotest_common.sh@930 -- # kill -0 1212498 00:20:04.179 16:44:29 -- common/autotest_common.sh@931 -- # uname 00:20:04.179 16:44:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:04.179 16:44:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1212498 00:20:04.179 16:44:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:04.179 16:44:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:04.179 16:44:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1212498' 00:20:04.179 killing process with pid 1212498 00:20:04.179 16:44:29 -- common/autotest_common.sh@945 -- # kill 1212498 00:20:04.179 16:44:29 -- common/autotest_common.sh@950 -- # wait 1212498 00:20:04.438 16:44:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:04.438 16:44:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:04.438 16:44:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:04.438 16:44:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:04.438 16:44:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:04.438 16:44:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:04.438 16:44:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:04.438 16:44:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:06.969 16:44:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:06.969 00:20:06.969 real 0m10.634s 00:20:06.969 user 0m25.689s 00:20:06.969 sys 0m2.356s 00:20:06.969 16:44:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:06.969 16:44:31 -- common/autotest_common.sh@10 -- # set +x 00:20:06.969 ************************************ 00:20:06.969 END TEST nvmf_nmic 00:20:06.969 ************************************ 00:20:06.969 16:44:31 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:20:06.969 16:44:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:06.969 16:44:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:06.969 16:44:31 -- common/autotest_common.sh@10 -- # set +x 00:20:06.969 ************************************ 00:20:06.969 START TEST nvmf_fio_target 00:20:06.969 ************************************ 00:20:06.969 16:44:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:20:06.969 * Looking for test storage... 00:20:06.969 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:06.969 16:44:31 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:06.969 16:44:31 -- nvmf/common.sh@7 -- # uname -s 00:20:06.969 16:44:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:06.969 16:44:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:06.969 16:44:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:06.969 16:44:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:06.969 16:44:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:06.969 16:44:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:06.969 16:44:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:06.969 16:44:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:06.969 16:44:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:06.969 16:44:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:06.969 16:44:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:06.969 16:44:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:06.969 16:44:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:06.969 16:44:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:06.969 16:44:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:06.969 16:44:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:06.969 16:44:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:06.969 16:44:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:06.969 16:44:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:06.969 16:44:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:06.969 16:44:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:06.969 16:44:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:06.969 16:44:31 -- paths/export.sh@5 -- # export PATH 00:20:06.969 16:44:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:06.969 16:44:31 -- nvmf/common.sh@46 -- # : 0 00:20:06.969 16:44:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:06.969 16:44:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:06.969 16:44:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:06.969 16:44:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:06.969 16:44:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:06.969 16:44:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:06.969 16:44:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:06.969 16:44:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:06.969 16:44:31 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:06.969 16:44:31 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:06.969 16:44:31 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:06.969 16:44:31 -- target/fio.sh@16 -- # nvmftestinit 00:20:06.969 16:44:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:06.969 16:44:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:06.969 16:44:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:06.969 16:44:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:06.969 16:44:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:06.969 16:44:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:06.969 16:44:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:06.969 16:44:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:06.969 16:44:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:06.969 16:44:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:06.969 16:44:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:06.969 16:44:31 -- common/autotest_common.sh@10 -- # set +x 00:20:08.872 16:44:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:08.872 16:44:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:08.872 16:44:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:08.872 16:44:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:08.872 16:44:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:08.872 16:44:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:08.872 16:44:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:08.872 16:44:33 -- nvmf/common.sh@294 -- # net_devs=() 00:20:08.872 16:44:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:08.872 16:44:33 -- nvmf/common.sh@295 -- # e810=() 00:20:08.872 16:44:33 -- nvmf/common.sh@295 -- # local -ga e810 00:20:08.872 16:44:33 -- nvmf/common.sh@296 -- # x722=() 00:20:08.872 16:44:33 -- nvmf/common.sh@296 -- # local -ga x722 00:20:08.872 16:44:33 -- nvmf/common.sh@297 -- # mlx=() 00:20:08.872 16:44:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:08.872 16:44:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:08.872 16:44:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:08.873 16:44:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:08.873 16:44:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:08.873 16:44:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:08.873 16:44:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:08.873 16:44:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:08.873 16:44:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:08.873 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:08.873 16:44:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:08.873 16:44:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:08.873 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:08.873 16:44:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:08.873 16:44:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:08.873 16:44:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:08.873 16:44:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:08.873 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:08.873 16:44:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:08.873 16:44:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:08.873 16:44:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:08.873 16:44:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:08.873 16:44:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:08.873 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:08.873 16:44:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:08.873 16:44:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:08.873 16:44:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:08.873 16:44:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:08.873 16:44:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:08.873 16:44:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:08.873 16:44:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:08.873 16:44:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:08.873 16:44:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:08.873 16:44:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:08.873 16:44:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:08.873 16:44:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:08.873 16:44:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:08.873 16:44:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:08.873 16:44:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:08.873 16:44:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:08.873 16:44:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:08.873 16:44:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:08.873 16:44:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:08.873 16:44:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:08.873 16:44:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:08.873 16:44:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:08.873 16:44:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:08.873 16:44:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:08.873 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:08.873 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:20:08.873 00:20:08.873 --- 10.0.0.2 ping statistics --- 00:20:08.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:08.873 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:20:08.873 16:44:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:08.873 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:08.873 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:20:08.873 00:20:08.873 --- 10.0.0.1 ping statistics --- 00:20:08.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:08.873 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:20:08.873 16:44:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:08.873 16:44:34 -- nvmf/common.sh@410 -- # return 0 00:20:08.873 16:44:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:08.873 16:44:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:08.873 16:44:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:08.873 16:44:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:08.873 16:44:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:08.873 16:44:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:08.873 16:44:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:08.873 16:44:34 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:20:08.873 16:44:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:08.873 16:44:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:08.873 16:44:34 -- common/autotest_common.sh@10 -- # set +x 00:20:08.873 16:44:34 -- nvmf/common.sh@469 -- # nvmfpid=1215362 00:20:08.873 16:44:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:08.873 16:44:34 -- nvmf/common.sh@470 -- # waitforlisten 1215362 00:20:08.873 16:44:34 -- common/autotest_common.sh@819 -- # '[' -z 1215362 ']' 00:20:08.873 16:44:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:08.873 16:44:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:08.873 16:44:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:08.873 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:08.873 16:44:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:08.873 16:44:34 -- common/autotest_common.sh@10 -- # set +x 00:20:08.873 [2024-10-13 16:44:34.194978] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:08.873 [2024-10-13 16:44:34.195047] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:08.873 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.873 [2024-10-13 16:44:34.262951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:08.873 [2024-10-13 16:44:34.362415] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:08.873 [2024-10-13 16:44:34.362584] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:08.873 [2024-10-13 16:44:34.362604] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:08.873 [2024-10-13 16:44:34.362619] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:08.873 [2024-10-13 16:44:34.362691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:08.873 [2024-10-13 16:44:34.362730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:08.873 [2024-10-13 16:44:34.362788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:08.873 [2024-10-13 16:44:34.362791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:09.807 16:44:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:09.807 16:44:35 -- common/autotest_common.sh@852 -- # return 0 00:20:09.807 16:44:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:09.807 16:44:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:09.807 16:44:35 -- common/autotest_common.sh@10 -- # set +x 00:20:09.807 16:44:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:09.807 16:44:35 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:20:10.064 [2024-10-13 16:44:35.500070] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:10.064 16:44:35 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.323 16:44:35 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:20:10.323 16:44:35 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.581 16:44:36 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:20:10.581 16:44:36 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.147 16:44:36 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:20:11.147 16:44:36 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.147 16:44:36 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:20:11.147 16:44:36 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:20:11.404 16:44:36 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.662 16:44:37 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:20:11.662 16:44:37 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.920 16:44:37 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:20:11.920 16:44:37 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:12.178 16:44:37 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:20:12.178 16:44:37 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:20:12.435 16:44:37 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:12.692 16:44:38 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:20:12.692 16:44:38 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:12.950 16:44:38 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:20:12.950 16:44:38 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:13.207 16:44:38 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:13.465 [2024-10-13 16:44:38.887952] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:13.465 16:44:38 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:20:13.723 16:44:39 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:20:13.981 16:44:39 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:14.547 16:44:40 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:20:14.547 16:44:40 -- common/autotest_common.sh@1177 -- # local i=0 00:20:14.547 16:44:40 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:14.547 16:44:40 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:20:14.547 16:44:40 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:20:14.547 16:44:40 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:17.073 16:44:42 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:17.073 16:44:42 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:17.073 16:44:42 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:20:17.073 16:44:42 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:20:17.073 16:44:42 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:17.073 16:44:42 -- common/autotest_common.sh@1187 -- # return 0 00:20:17.073 16:44:42 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:20:17.073 [global] 00:20:17.073 thread=1 00:20:17.073 invalidate=1 00:20:17.073 rw=write 00:20:17.073 time_based=1 00:20:17.073 runtime=1 00:20:17.073 ioengine=libaio 00:20:17.073 direct=1 00:20:17.073 bs=4096 00:20:17.073 iodepth=1 00:20:17.073 norandommap=0 00:20:17.073 numjobs=1 00:20:17.073 00:20:17.073 verify_dump=1 00:20:17.073 verify_backlog=512 00:20:17.073 verify_state_save=0 00:20:17.073 do_verify=1 00:20:17.073 verify=crc32c-intel 00:20:17.073 [job0] 00:20:17.073 filename=/dev/nvme0n1 00:20:17.073 [job1] 00:20:17.073 filename=/dev/nvme0n2 00:20:17.073 [job2] 00:20:17.073 filename=/dev/nvme0n3 00:20:17.073 [job3] 00:20:17.073 filename=/dev/nvme0n4 00:20:17.073 Could not set queue depth (nvme0n1) 00:20:17.073 Could not set queue depth (nvme0n2) 00:20:17.073 Could not set queue depth (nvme0n3) 00:20:17.073 Could not set queue depth (nvme0n4) 00:20:17.073 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.073 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.073 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.073 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.073 fio-3.35 00:20:17.073 Starting 4 threads 00:20:18.447 00:20:18.447 job0: (groupid=0, jobs=1): err= 0: pid=1216475: Sun Oct 13 16:44:43 2024 00:20:18.447 read: IOPS=316, BW=1268KiB/s (1298kB/s)(1312KiB/1035msec) 00:20:18.447 slat (nsec): min=5204, max=42832, avg=13994.84, stdev=8546.86 00:20:18.447 clat (usec): min=182, max=41278, avg=2778.96, stdev=9740.59 00:20:18.447 lat (usec): min=187, max=41294, avg=2792.96, stdev=9741.76 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 194], 5.00th=[ 215], 10.00th=[ 223], 20.00th=[ 231], 00:20:18.447 | 30.00th=[ 241], 40.00th=[ 247], 50.00th=[ 255], 60.00th=[ 269], 00:20:18.447 | 70.00th=[ 297], 80.00th=[ 441], 90.00th=[ 562], 95.00th=[41157], 00:20:18.447 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:18.447 | 99.99th=[41157] 00:20:18.447 write: IOPS=494, BW=1979KiB/s (2026kB/s)(2048KiB/1035msec); 0 zone resets 00:20:18.447 slat (nsec): min=6927, max=35709, avg=9381.02, stdev=4377.16 00:20:18.447 clat (usec): min=130, max=310, avg=216.14, stdev=28.07 00:20:18.447 lat (usec): min=139, max=333, avg=225.52, stdev=28.93 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 141], 5.00th=[ 167], 10.00th=[ 184], 20.00th=[ 200], 00:20:18.447 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 221], 00:20:18.447 | 70.00th=[ 227], 80.00th=[ 237], 90.00th=[ 253], 95.00th=[ 265], 00:20:18.447 | 99.00th=[ 285], 99.50th=[ 302], 99.90th=[ 310], 99.95th=[ 310], 00:20:18.447 | 99.99th=[ 310] 00:20:18.447 bw ( KiB/s): min= 4096, max= 4096, per=51.80%, avg=4096.00, stdev= 0.00, samples=1 00:20:18.447 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:18.447 lat (usec) : 250=71.79%, 500=22.62%, 750=3.10% 00:20:18.447 lat (msec) : 2=0.12%, 50=2.38% 00:20:18.447 cpu : usr=0.77%, sys=1.16%, ctx=840, majf=0, minf=1 00:20:18.447 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 issued rwts: total=328,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.447 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:18.447 job1: (groupid=0, jobs=1): err= 0: pid=1216476: Sun Oct 13 16:44:43 2024 00:20:18.447 read: IOPS=28, BW=112KiB/s (115kB/s)(116KiB/1032msec) 00:20:18.447 slat (nsec): min=5838, max=37138, avg=21327.97, stdev=12540.36 00:20:18.447 clat (usec): min=248, max=42289, avg=31773.66, stdev=18088.59 00:20:18.447 lat (usec): min=254, max=42294, avg=31794.99, stdev=18097.01 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 302], 00:20:18.447 | 30.00th=[41157], 40.00th=[41681], 50.00th=[41681], 60.00th=[41681], 00:20:18.447 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:20:18.447 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:18.447 | 99.99th=[42206] 00:20:18.447 write: IOPS=496, BW=1984KiB/s (2032kB/s)(2048KiB/1032msec); 0 zone resets 00:20:18.447 slat (nsec): min=7758, max=45671, avg=10808.62, stdev=6471.95 00:20:18.447 clat (usec): min=147, max=448, avg=199.74, stdev=34.50 00:20:18.447 lat (usec): min=155, max=494, avg=210.55, stdev=37.89 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 163], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 178], 00:20:18.447 | 30.00th=[ 180], 40.00th=[ 182], 50.00th=[ 184], 60.00th=[ 188], 00:20:18.447 | 70.00th=[ 208], 80.00th=[ 235], 90.00th=[ 243], 95.00th=[ 247], 00:20:18.447 | 99.00th=[ 334], 99.50th=[ 392], 99.90th=[ 449], 99.95th=[ 449], 00:20:18.447 | 99.99th=[ 449] 00:20:18.447 bw ( KiB/s): min= 4096, max= 4096, per=51.80%, avg=4096.00, stdev= 0.00, samples=1 00:20:18.447 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:18.447 lat (usec) : 250=90.76%, 500=5.18% 00:20:18.447 lat (msec) : 50=4.07% 00:20:18.447 cpu : usr=0.39%, sys=0.68%, ctx=542, majf=0, minf=1 00:20:18.447 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 issued rwts: total=29,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.447 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:18.447 job2: (groupid=0, jobs=1): err= 0: pid=1216479: Sun Oct 13 16:44:43 2024 00:20:18.447 read: IOPS=24, BW=99.9KiB/s (102kB/s)(100KiB/1001msec) 00:20:18.447 slat (nsec): min=7322, max=36366, avg=25661.12, stdev=10691.98 00:20:18.447 clat (usec): min=275, max=42054, avg=35076.69, stdev=15479.06 00:20:18.447 lat (usec): min=288, max=42090, avg=35102.35, stdev=15477.20 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 277], 5.00th=[ 351], 10.00th=[ 359], 20.00th=[40633], 00:20:18.447 | 30.00th=[41157], 40.00th=[41681], 50.00th=[41681], 60.00th=[41681], 00:20:18.447 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:20:18.447 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:18.447 | 99.99th=[42206] 00:20:18.447 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:20:18.447 slat (nsec): min=7948, max=54053, avg=11431.53, stdev=6382.80 00:20:18.447 clat (usec): min=135, max=461, avg=225.57, stdev=53.65 00:20:18.447 lat (usec): min=143, max=500, avg=237.00, stdev=56.15 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 143], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 180], 00:20:18.447 | 30.00th=[ 186], 40.00th=[ 208], 50.00th=[ 233], 60.00th=[ 239], 00:20:18.447 | 70.00th=[ 241], 80.00th=[ 247], 90.00th=[ 265], 95.00th=[ 334], 00:20:18.447 | 99.00th=[ 441], 99.50th=[ 453], 99.90th=[ 461], 99.95th=[ 461], 00:20:18.447 | 99.99th=[ 461] 00:20:18.447 bw ( KiB/s): min= 4096, max= 4096, per=51.80%, avg=4096.00, stdev= 0.00, samples=1 00:20:18.447 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:18.447 lat (usec) : 250=78.96%, 500=17.13% 00:20:18.447 lat (msec) : 50=3.91% 00:20:18.447 cpu : usr=0.50%, sys=0.70%, ctx=538, majf=0, minf=1 00:20:18.447 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 issued rwts: total=25,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.447 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:18.447 job3: (groupid=0, jobs=1): err= 0: pid=1216480: Sun Oct 13 16:44:43 2024 00:20:18.447 read: IOPS=22, BW=88.8KiB/s (90.9kB/s)(92.0KiB/1036msec) 00:20:18.447 slat (nsec): min=7713, max=35106, avg=24552.74, stdev=10079.15 00:20:18.447 clat (usec): min=40888, max=41044, avg=40965.12, stdev=46.83 00:20:18.447 lat (usec): min=40921, max=41060, avg=40989.67, stdev=41.79 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:20:18.447 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:18.447 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:18.447 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:18.447 | 99.99th=[41157] 00:20:18.447 write: IOPS=494, BW=1977KiB/s (2024kB/s)(2048KiB/1036msec); 0 zone resets 00:20:18.447 slat (nsec): min=7428, max=36953, avg=10076.39, stdev=4674.92 00:20:18.447 clat (usec): min=140, max=299, avg=168.24, stdev=17.00 00:20:18.447 lat (usec): min=148, max=336, avg=178.32, stdev=19.85 00:20:18.447 clat percentiles (usec): 00:20:18.447 | 1.00th=[ 145], 5.00th=[ 149], 10.00th=[ 151], 20.00th=[ 155], 00:20:18.447 | 30.00th=[ 159], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 167], 00:20:18.447 | 70.00th=[ 174], 80.00th=[ 182], 90.00th=[ 190], 95.00th=[ 200], 00:20:18.447 | 99.00th=[ 219], 99.50th=[ 227], 99.90th=[ 302], 99.95th=[ 302], 00:20:18.447 | 99.99th=[ 302] 00:20:18.447 bw ( KiB/s): min= 4096, max= 4096, per=51.80%, avg=4096.00, stdev= 0.00, samples=1 00:20:18.447 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:18.447 lat (usec) : 250=95.51%, 500=0.19% 00:20:18.447 lat (msec) : 50=4.30% 00:20:18.447 cpu : usr=0.29%, sys=0.77%, ctx=535, majf=0, minf=1 00:20:18.447 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.447 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.447 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:18.447 00:20:18.447 Run status group 0 (all jobs): 00:20:18.447 READ: bw=1564KiB/s (1601kB/s), 88.8KiB/s-1268KiB/s (90.9kB/s-1298kB/s), io=1620KiB (1659kB), run=1001-1036msec 00:20:18.447 WRITE: bw=7907KiB/s (8097kB/s), 1977KiB/s-2046KiB/s (2024kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1036msec 00:20:18.447 00:20:18.447 Disk stats (read/write): 00:20:18.447 nvme0n1: ios=336/512, merge=0/0, ticks=692/109, in_queue=801, util=83.27% 00:20:18.447 nvme0n2: ios=74/512, merge=0/0, ticks=1016/99, in_queue=1115, util=99.49% 00:20:18.448 nvme0n3: ios=41/512, merge=0/0, ticks=1613/109, in_queue=1722, util=98.49% 00:20:18.448 nvme0n4: ios=17/512, merge=0/0, ticks=697/84, in_queue=781, util=89.25% 00:20:18.448 16:44:43 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:20:18.448 [global] 00:20:18.448 thread=1 00:20:18.448 invalidate=1 00:20:18.448 rw=randwrite 00:20:18.448 time_based=1 00:20:18.448 runtime=1 00:20:18.448 ioengine=libaio 00:20:18.448 direct=1 00:20:18.448 bs=4096 00:20:18.448 iodepth=1 00:20:18.448 norandommap=0 00:20:18.448 numjobs=1 00:20:18.448 00:20:18.448 verify_dump=1 00:20:18.448 verify_backlog=512 00:20:18.448 verify_state_save=0 00:20:18.448 do_verify=1 00:20:18.448 verify=crc32c-intel 00:20:18.448 [job0] 00:20:18.448 filename=/dev/nvme0n1 00:20:18.448 [job1] 00:20:18.448 filename=/dev/nvme0n2 00:20:18.448 [job2] 00:20:18.448 filename=/dev/nvme0n3 00:20:18.448 [job3] 00:20:18.448 filename=/dev/nvme0n4 00:20:18.448 Could not set queue depth (nvme0n1) 00:20:18.448 Could not set queue depth (nvme0n2) 00:20:18.448 Could not set queue depth (nvme0n3) 00:20:18.448 Could not set queue depth (nvme0n4) 00:20:18.448 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:18.448 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:18.448 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:18.448 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:18.448 fio-3.35 00:20:18.448 Starting 4 threads 00:20:19.823 00:20:19.823 job0: (groupid=0, jobs=1): err= 0: pid=1216717: Sun Oct 13 16:44:45 2024 00:20:19.823 read: IOPS=23, BW=92.3KiB/s (94.5kB/s)(96.0KiB/1040msec) 00:20:19.823 slat (nsec): min=6983, max=37071, avg=23490.21, stdev=10275.21 00:20:19.823 clat (usec): min=287, max=41029, avg=39243.49, stdev=8298.35 00:20:19.823 lat (usec): min=323, max=41048, avg=39266.98, stdev=8295.75 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[ 289], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:20:19.823 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:19.823 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:19.823 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:19.823 | 99.99th=[41157] 00:20:19.823 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:20:19.823 slat (nsec): min=7263, max=31206, avg=8645.78, stdev=2342.73 00:20:19.823 clat (usec): min=143, max=517, avg=173.90, stdev=21.57 00:20:19.823 lat (usec): min=152, max=525, avg=182.54, stdev=21.88 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 155], 20.00th=[ 159], 00:20:19.823 | 30.00th=[ 165], 40.00th=[ 167], 50.00th=[ 172], 60.00th=[ 176], 00:20:19.823 | 70.00th=[ 180], 80.00th=[ 186], 90.00th=[ 194], 95.00th=[ 200], 00:20:19.823 | 99.00th=[ 221], 99.50th=[ 241], 99.90th=[ 519], 99.95th=[ 519], 00:20:19.823 | 99.99th=[ 519] 00:20:19.823 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=1 00:20:19.823 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:19.823 lat (usec) : 250=95.34%, 500=0.19%, 750=0.19% 00:20:19.823 lat (msec) : 50=4.29% 00:20:19.823 cpu : usr=0.48%, sys=0.48%, ctx=538, majf=0, minf=1 00:20:19.823 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.823 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.823 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.823 job1: (groupid=0, jobs=1): err= 0: pid=1216718: Sun Oct 13 16:44:45 2024 00:20:19.823 read: IOPS=2066, BW=8268KiB/s (8466kB/s)(8276KiB/1001msec) 00:20:19.823 slat (nsec): min=5279, max=49404, avg=12235.13, stdev=5374.14 00:20:19.823 clat (usec): min=163, max=1034, avg=238.99, stdev=55.49 00:20:19.823 lat (usec): min=170, max=1041, avg=251.23, stdev=56.46 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[ 176], 5.00th=[ 184], 10.00th=[ 192], 20.00th=[ 206], 00:20:19.823 | 30.00th=[ 217], 40.00th=[ 223], 50.00th=[ 229], 60.00th=[ 239], 00:20:19.823 | 70.00th=[ 251], 80.00th=[ 265], 90.00th=[ 281], 95.00th=[ 293], 00:20:19.823 | 99.00th=[ 490], 99.50th=[ 510], 99.90th=[ 734], 99.95th=[ 742], 00:20:19.823 | 99.99th=[ 1037] 00:20:19.823 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:20:19.823 slat (nsec): min=6434, max=54915, avg=13419.18, stdev=6531.84 00:20:19.823 clat (usec): min=121, max=293, avg=166.92, stdev=29.91 00:20:19.823 lat (usec): min=128, max=315, avg=180.34, stdev=31.05 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[ 126], 5.00th=[ 130], 10.00th=[ 133], 20.00th=[ 137], 00:20:19.823 | 30.00th=[ 145], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 169], 00:20:19.823 | 70.00th=[ 178], 80.00th=[ 190], 90.00th=[ 215], 95.00th=[ 225], 00:20:19.823 | 99.00th=[ 245], 99.50th=[ 251], 99.90th=[ 265], 99.95th=[ 273], 00:20:19.823 | 99.99th=[ 293] 00:20:19.823 bw ( KiB/s): min= 9904, max= 9904, per=62.87%, avg=9904.00, stdev= 0.00, samples=1 00:20:19.823 iops : min= 2476, max= 2476, avg=2476.00, stdev= 0.00, samples=1 00:20:19.823 lat (usec) : 250=86.07%, 500=13.61%, 750=0.30% 00:20:19.823 lat (msec) : 2=0.02% 00:20:19.823 cpu : usr=4.90%, sys=8.00%, ctx=4629, majf=0, minf=1 00:20:19.823 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.823 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 issued rwts: total=2069,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.823 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.823 job2: (groupid=0, jobs=1): err= 0: pid=1216719: Sun Oct 13 16:44:45 2024 00:20:19.823 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(88.0KiB/1002msec) 00:20:19.823 slat (nsec): min=9122, max=16078, avg=13868.55, stdev=2026.75 00:20:19.823 clat (usec): min=40884, max=41047, avg=40979.27, stdev=40.04 00:20:19.823 lat (usec): min=40899, max=41062, avg=40993.14, stdev=39.82 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:20:19.823 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:19.823 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:19.823 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:19.823 | 99.99th=[41157] 00:20:19.823 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:20:19.823 slat (nsec): min=9243, max=46687, avg=10260.66, stdev=2092.56 00:20:19.823 clat (usec): min=153, max=249, avg=176.76, stdev=12.23 00:20:19.823 lat (usec): min=163, max=259, avg=187.02, stdev=12.49 00:20:19.823 clat percentiles (usec): 00:20:19.823 | 1.00th=[ 157], 5.00th=[ 161], 10.00th=[ 163], 20.00th=[ 167], 00:20:19.823 | 30.00th=[ 172], 40.00th=[ 174], 50.00th=[ 176], 60.00th=[ 178], 00:20:19.823 | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 192], 95.00th=[ 198], 00:20:19.823 | 99.00th=[ 223], 99.50th=[ 237], 99.90th=[ 249], 99.95th=[ 249], 00:20:19.823 | 99.99th=[ 249] 00:20:19.823 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=1 00:20:19.823 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:19.823 lat (usec) : 250=95.88% 00:20:19.823 lat (msec) : 50=4.12% 00:20:19.823 cpu : usr=0.40%, sys=0.70%, ctx=536, majf=0, minf=1 00:20:19.823 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.823 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.823 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.823 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.824 job3: (groupid=0, jobs=1): err= 0: pid=1216720: Sun Oct 13 16:44:45 2024 00:20:19.824 read: IOPS=305, BW=1223KiB/s (1252kB/s)(1236KiB/1011msec) 00:20:19.824 slat (nsec): min=5778, max=34634, avg=8319.36, stdev=5618.95 00:20:19.824 clat (usec): min=185, max=41416, avg=2898.47, stdev=10038.23 00:20:19.824 lat (usec): min=192, max=41423, avg=2906.79, stdev=10042.37 00:20:19.824 clat percentiles (usec): 00:20:19.824 | 1.00th=[ 194], 5.00th=[ 221], 10.00th=[ 235], 20.00th=[ 245], 00:20:19.824 | 30.00th=[ 251], 40.00th=[ 258], 50.00th=[ 262], 60.00th=[ 269], 00:20:19.824 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 326], 95.00th=[41157], 00:20:19.824 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:19.824 | 99.99th=[41157] 00:20:19.824 write: IOPS=506, BW=2026KiB/s (2074kB/s)(2048KiB/1011msec); 0 zone resets 00:20:19.824 slat (nsec): min=6868, max=46803, avg=8244.36, stdev=3012.50 00:20:19.824 clat (usec): min=141, max=259, avg=206.86, stdev=22.43 00:20:19.824 lat (usec): min=150, max=287, avg=215.11, stdev=22.32 00:20:19.824 clat percentiles (usec): 00:20:19.824 | 1.00th=[ 153], 5.00th=[ 167], 10.00th=[ 176], 20.00th=[ 186], 00:20:19.824 | 30.00th=[ 198], 40.00th=[ 204], 50.00th=[ 210], 60.00th=[ 217], 00:20:19.824 | 70.00th=[ 221], 80.00th=[ 225], 90.00th=[ 235], 95.00th=[ 239], 00:20:19.824 | 99.00th=[ 251], 99.50th=[ 253], 99.90th=[ 260], 99.95th=[ 260], 00:20:19.824 | 99.99th=[ 260] 00:20:19.824 bw ( KiB/s): min= 4096, max= 4096, per=26.00%, avg=4096.00, stdev= 0.00, samples=1 00:20:19.824 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:19.824 lat (usec) : 250=72.23%, 500=25.33% 00:20:19.824 lat (msec) : 50=2.44% 00:20:19.824 cpu : usr=0.89%, sys=0.50%, ctx=822, majf=0, minf=1 00:20:19.824 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.824 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.824 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.824 issued rwts: total=309,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.824 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.824 00:20:19.824 Run status group 0 (all jobs): 00:20:19.824 READ: bw=9323KiB/s (9547kB/s), 87.8KiB/s-8268KiB/s (89.9kB/s-8466kB/s), io=9696KiB (9929kB), run=1001-1040msec 00:20:19.824 WRITE: bw=15.4MiB/s (16.1MB/s), 1969KiB/s-9.99MiB/s (2016kB/s-10.5MB/s), io=16.0MiB (16.8MB), run=1001-1040msec 00:20:19.824 00:20:19.824 Disk stats (read/write): 00:20:19.824 nvme0n1: ios=45/512, merge=0/0, ticks=1159/86, in_queue=1245, util=100.00% 00:20:19.824 nvme0n2: ios=1884/2048, merge=0/0, ticks=451/321, in_queue=772, util=87.21% 00:20:19.824 nvme0n3: ios=76/512, merge=0/0, ticks=1137/87, in_queue=1224, util=97.81% 00:20:19.824 nvme0n4: ios=305/512, merge=0/0, ticks=731/101, in_queue=832, util=89.70% 00:20:19.824 16:44:45 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:20:19.824 [global] 00:20:19.824 thread=1 00:20:19.824 invalidate=1 00:20:19.824 rw=write 00:20:19.824 time_based=1 00:20:19.824 runtime=1 00:20:19.824 ioengine=libaio 00:20:19.824 direct=1 00:20:19.824 bs=4096 00:20:19.824 iodepth=128 00:20:19.824 norandommap=0 00:20:19.824 numjobs=1 00:20:19.824 00:20:19.824 verify_dump=1 00:20:19.824 verify_backlog=512 00:20:19.824 verify_state_save=0 00:20:19.824 do_verify=1 00:20:19.824 verify=crc32c-intel 00:20:19.824 [job0] 00:20:19.824 filename=/dev/nvme0n1 00:20:19.824 [job1] 00:20:19.824 filename=/dev/nvme0n2 00:20:19.824 [job2] 00:20:19.824 filename=/dev/nvme0n3 00:20:19.824 [job3] 00:20:19.824 filename=/dev/nvme0n4 00:20:19.824 Could not set queue depth (nvme0n1) 00:20:19.824 Could not set queue depth (nvme0n2) 00:20:19.824 Could not set queue depth (nvme0n3) 00:20:19.824 Could not set queue depth (nvme0n4) 00:20:19.824 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.824 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.824 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.824 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.824 fio-3.35 00:20:19.824 Starting 4 threads 00:20:21.197 00:20:21.197 job0: (groupid=0, jobs=1): err= 0: pid=1217047: Sun Oct 13 16:44:46 2024 00:20:21.197 read: IOPS=4553, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1012msec) 00:20:21.197 slat (usec): min=2, max=10829, avg=99.66, stdev=657.14 00:20:21.197 clat (usec): min=4145, max=30547, avg=12526.10, stdev=4109.43 00:20:21.197 lat (usec): min=4527, max=30563, avg=12625.76, stdev=4145.23 00:20:21.197 clat percentiles (usec): 00:20:21.197 | 1.00th=[ 5342], 5.00th=[ 8848], 10.00th=[ 9110], 20.00th=[ 9634], 00:20:21.197 | 30.00th=[10159], 40.00th=[10552], 50.00th=[11338], 60.00th=[12518], 00:20:21.197 | 70.00th=[13435], 80.00th=[14353], 90.00th=[17171], 95.00th=[21103], 00:20:21.197 | 99.00th=[28705], 99.50th=[29230], 99.90th=[30540], 99.95th=[30540], 00:20:21.197 | 99.99th=[30540] 00:20:21.197 write: IOPS=4796, BW=18.7MiB/s (19.6MB/s)(19.0MiB/1012msec); 0 zone resets 00:20:21.197 slat (usec): min=4, max=9331, avg=101.95, stdev=477.18 00:20:21.197 clat (usec): min=2187, max=40209, avg=14527.23, stdev=7020.75 00:20:21.197 lat (usec): min=2196, max=40217, avg=14629.18, stdev=7062.42 00:20:21.197 clat percentiles (usec): 00:20:21.197 | 1.00th=[ 3752], 5.00th=[ 5735], 10.00th=[ 8160], 20.00th=[ 9896], 00:20:21.197 | 30.00th=[10683], 40.00th=[11469], 50.00th=[11863], 60.00th=[12387], 00:20:21.197 | 70.00th=[17695], 80.00th=[19530], 90.00th=[24511], 95.00th=[30540], 00:20:21.197 | 99.00th=[39584], 99.50th=[40109], 99.90th=[40109], 99.95th=[40109], 00:20:21.197 | 99.99th=[40109] 00:20:21.197 bw ( KiB/s): min=17160, max=20648, per=31.03%, avg=18904.00, stdev=2466.39, samples=2 00:20:21.197 iops : min= 4290, max= 5162, avg=4726.00, stdev=616.60, samples=2 00:20:21.197 lat (msec) : 4=0.79%, 10=22.55%, 20=65.32%, 50=11.33% 00:20:21.197 cpu : usr=6.73%, sys=8.80%, ctx=550, majf=0, minf=1 00:20:21.197 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:21.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:21.197 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:21.197 issued rwts: total=4608,4854,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:21.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:21.197 job1: (groupid=0, jobs=1): err= 0: pid=1217068: Sun Oct 13 16:44:46 2024 00:20:21.197 read: IOPS=3859, BW=15.1MiB/s (15.8MB/s)(15.8MiB/1045msec) 00:20:21.197 slat (usec): min=2, max=11168, avg=115.60, stdev=681.07 00:20:21.197 clat (usec): min=1824, max=65250, avg=17371.66, stdev=12439.35 00:20:21.197 lat (usec): min=1829, max=65256, avg=17487.25, stdev=12487.28 00:20:21.197 clat percentiles (usec): 00:20:21.197 | 1.00th=[ 2933], 5.00th=[ 5735], 10.00th=[ 8029], 20.00th=[ 9110], 00:20:21.197 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[13042], 60.00th=[17695], 00:20:21.197 | 70.00th=[19006], 80.00th=[20841], 90.00th=[34341], 95.00th=[47449], 00:20:21.197 | 99.00th=[56361], 99.50th=[61604], 99.90th=[65274], 99.95th=[65274], 00:20:21.197 | 99.99th=[65274] 00:20:21.197 write: IOPS=3919, BW=15.3MiB/s (16.1MB/s)(16.0MiB/1045msec); 0 zone resets 00:20:21.197 slat (usec): min=3, max=18747, avg=111.34, stdev=785.29 00:20:21.197 clat (usec): min=1946, max=61669, avg=15244.37, stdev=11351.85 00:20:21.197 lat (usec): min=1950, max=61689, avg=15355.71, stdev=11424.30 00:20:21.197 clat percentiles (usec): 00:20:21.197 | 1.00th=[ 2900], 5.00th=[ 4359], 10.00th=[ 6194], 20.00th=[ 9765], 00:20:21.197 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11207], 60.00th=[11338], 00:20:21.197 | 70.00th=[15401], 80.00th=[17695], 90.00th=[31851], 95.00th=[39584], 00:20:21.197 | 99.00th=[59507], 99.50th=[61604], 99.90th=[61604], 99.95th=[61604], 00:20:21.197 | 99.99th=[61604] 00:20:21.197 bw ( KiB/s): min= 8952, max=23816, per=26.89%, avg=16384.00, stdev=10510.44, samples=2 00:20:21.197 iops : min= 2238, max= 5954, avg=4096.00, stdev=2627.61, samples=2 00:20:21.197 lat (msec) : 2=0.22%, 4=3.11%, 10=27.17%, 20=50.67%, 50=15.23% 00:20:21.197 lat (msec) : 100=3.59% 00:20:21.197 cpu : usr=4.12%, sys=5.84%, ctx=506, majf=0, minf=1 00:20:21.197 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:21.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:21.197 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:21.197 issued rwts: total=4033,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:21.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:21.197 job2: (groupid=0, jobs=1): err= 0: pid=1217074: Sun Oct 13 16:44:46 2024 00:20:21.197 read: IOPS=3180, BW=12.4MiB/s (13.0MB/s)(13.0MiB/1045msec) 00:20:21.198 slat (usec): min=3, max=21856, avg=137.73, stdev=969.99 00:20:21.198 clat (usec): min=5156, max=53927, avg=18323.57, stdev=9627.89 00:20:21.198 lat (usec): min=5172, max=64436, avg=18461.30, stdev=9672.50 00:20:21.198 clat percentiles (usec): 00:20:21.198 | 1.00th=[ 8160], 5.00th=[ 9634], 10.00th=[10290], 20.00th=[11338], 00:20:21.198 | 30.00th=[11731], 40.00th=[13960], 50.00th=[15139], 60.00th=[18744], 00:20:21.198 | 70.00th=[21103], 80.00th=[22938], 90.00th=[28705], 95.00th=[38011], 00:20:21.198 | 99.00th=[53740], 99.50th=[53740], 99.90th=[53740], 99.95th=[53740], 00:20:21.198 | 99.99th=[53740] 00:20:21.198 write: IOPS=3429, BW=13.4MiB/s (14.0MB/s)(14.0MiB/1045msec); 0 zone resets 00:20:21.198 slat (usec): min=4, max=19334, avg=140.62, stdev=728.17 00:20:21.198 clat (usec): min=4174, max=45632, avg=20004.45, stdev=7707.56 00:20:21.198 lat (usec): min=4180, max=45641, avg=20145.07, stdev=7782.70 00:20:21.198 clat percentiles (usec): 00:20:21.198 | 1.00th=[ 5342], 5.00th=[ 8455], 10.00th=[10814], 20.00th=[12780], 00:20:21.198 | 30.00th=[13173], 40.00th=[19792], 50.00th=[20841], 60.00th=[21890], 00:20:21.198 | 70.00th=[23725], 80.00th=[25297], 90.00th=[28443], 95.00th=[35914], 00:20:21.198 | 99.00th=[40633], 99.50th=[40633], 99.90th=[42206], 99.95th=[45876], 00:20:21.198 | 99.99th=[45876] 00:20:21.198 bw ( KiB/s): min=12272, max=16400, per=23.53%, avg=14336.00, stdev=2918.94, samples=2 00:20:21.198 iops : min= 3068, max= 4100, avg=3584.00, stdev=729.73, samples=2 00:20:21.198 lat (msec) : 10=7.50%, 20=45.64%, 50=45.15%, 100=1.71% 00:20:21.198 cpu : usr=4.21%, sys=8.52%, ctx=436, majf=0, minf=1 00:20:21.198 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:21.198 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:21.198 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:21.198 issued rwts: total=3324,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:21.198 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:21.198 job3: (groupid=0, jobs=1): err= 0: pid=1217075: Sun Oct 13 16:44:46 2024 00:20:21.198 read: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec) 00:20:21.198 slat (usec): min=2, max=20145, avg=155.32, stdev=1196.40 00:20:21.198 clat (usec): min=3200, max=55769, avg=20191.61, stdev=10615.12 00:20:21.198 lat (usec): min=3205, max=55806, avg=20346.93, stdev=10695.67 00:20:21.198 clat percentiles (usec): 00:20:21.198 | 1.00th=[ 6063], 5.00th=[ 8717], 10.00th=[11076], 20.00th=[11731], 00:20:21.198 | 30.00th=[13566], 40.00th=[15270], 50.00th=[16057], 60.00th=[17957], 00:20:21.198 | 70.00th=[22938], 80.00th=[30016], 90.00th=[37487], 95.00th=[42730], 00:20:21.198 | 99.00th=[50070], 99.50th=[51119], 99.90th=[53216], 99.95th=[53216], 00:20:21.198 | 99.99th=[55837] 00:20:21.198 write: IOPS=3361, BW=13.1MiB/s (13.8MB/s)(13.2MiB/1006msec); 0 zone resets 00:20:21.198 slat (usec): min=3, max=21878, avg=143.08, stdev=909.05 00:20:21.198 clat (usec): min=958, max=55695, avg=19363.36, stdev=8984.35 00:20:21.198 lat (usec): min=1012, max=55724, avg=19506.43, stdev=9061.56 00:20:21.198 clat percentiles (usec): 00:20:21.198 | 1.00th=[ 4228], 5.00th=[ 9503], 10.00th=[10683], 20.00th=[11863], 00:20:21.198 | 30.00th=[13698], 40.00th=[15664], 50.00th=[19792], 60.00th=[20841], 00:20:21.198 | 70.00th=[22676], 80.00th=[23987], 90.00th=[25560], 95.00th=[36439], 00:20:21.198 | 99.00th=[55313], 99.50th=[55837], 99.90th=[55837], 99.95th=[55837], 00:20:21.198 | 99.99th=[55837] 00:20:21.198 bw ( KiB/s): min=12288, max=13744, per=21.36%, avg=13016.00, stdev=1029.55, samples=2 00:20:21.198 iops : min= 3072, max= 3436, avg=3254.00, stdev=257.39, samples=2 00:20:21.198 lat (usec) : 1000=0.02% 00:20:21.198 lat (msec) : 2=0.02%, 4=0.88%, 10=6.26%, 20=49.97%, 50=41.23% 00:20:21.198 lat (msec) : 100=1.63% 00:20:21.198 cpu : usr=2.09%, sys=5.77%, ctx=302, majf=0, minf=1 00:20:21.198 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:21.198 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:21.198 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:21.198 issued rwts: total=3072,3382,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:21.198 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:21.198 00:20:21.198 Run status group 0 (all jobs): 00:20:21.198 READ: bw=56.2MiB/s (58.9MB/s), 11.9MiB/s-17.8MiB/s (12.5MB/s-18.7MB/s), io=58.7MiB (61.6MB), run=1006-1045msec 00:20:21.198 WRITE: bw=59.5MiB/s (62.4MB/s), 13.1MiB/s-18.7MiB/s (13.8MB/s-19.6MB/s), io=62.2MiB (65.2MB), run=1006-1045msec 00:20:21.198 00:20:21.198 Disk stats (read/write): 00:20:21.198 nvme0n1: ios=4148/4183, merge=0/0, ticks=48595/53947, in_queue=102542, util=98.00% 00:20:21.198 nvme0n2: ios=3604/3722, merge=0/0, ticks=33587/34139, in_queue=67726, util=97.66% 00:20:21.198 nvme0n3: ios=2560/2782, merge=0/0, ticks=43506/60501, in_queue=104007, util=89.03% 00:20:21.198 nvme0n4: ios=2110/2560, merge=0/0, ticks=32615/32541, in_queue=65156, util=97.47% 00:20:21.198 16:44:46 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:20:21.198 [global] 00:20:21.198 thread=1 00:20:21.198 invalidate=1 00:20:21.198 rw=randwrite 00:20:21.198 time_based=1 00:20:21.198 runtime=1 00:20:21.198 ioengine=libaio 00:20:21.198 direct=1 00:20:21.198 bs=4096 00:20:21.198 iodepth=128 00:20:21.198 norandommap=0 00:20:21.198 numjobs=1 00:20:21.198 00:20:21.198 verify_dump=1 00:20:21.198 verify_backlog=512 00:20:21.198 verify_state_save=0 00:20:21.198 do_verify=1 00:20:21.198 verify=crc32c-intel 00:20:21.198 [job0] 00:20:21.198 filename=/dev/nvme0n1 00:20:21.198 [job1] 00:20:21.198 filename=/dev/nvme0n2 00:20:21.198 [job2] 00:20:21.198 filename=/dev/nvme0n3 00:20:21.198 [job3] 00:20:21.198 filename=/dev/nvme0n4 00:20:21.198 Could not set queue depth (nvme0n1) 00:20:21.198 Could not set queue depth (nvme0n2) 00:20:21.198 Could not set queue depth (nvme0n3) 00:20:21.198 Could not set queue depth (nvme0n4) 00:20:21.455 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:21.455 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:21.455 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:21.456 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:21.456 fio-3.35 00:20:21.456 Starting 4 threads 00:20:22.829 00:20:22.829 job0: (groupid=0, jobs=1): err= 0: pid=1217305: Sun Oct 13 16:44:48 2024 00:20:22.829 read: IOPS=4219, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1001msec) 00:20:22.829 slat (usec): min=2, max=5524, avg=100.46, stdev=533.91 00:20:22.829 clat (usec): min=749, max=30453, avg=12444.16, stdev=4328.70 00:20:22.829 lat (usec): min=775, max=30495, avg=12544.62, stdev=4373.51 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 5211], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 9896], 00:20:22.829 | 30.00th=[10290], 40.00th=[10552], 50.00th=[10945], 60.00th=[11600], 00:20:22.829 | 70.00th=[12911], 80.00th=[15926], 90.00th=[19268], 95.00th=[21365], 00:20:22.829 | 99.00th=[26084], 99.50th=[28181], 99.90th=[29230], 99.95th=[29230], 00:20:22.829 | 99.99th=[30540] 00:20:22.829 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:20:22.829 slat (usec): min=3, max=11892, avg=118.65, stdev=640.74 00:20:22.829 clat (usec): min=2258, max=63858, avg=16053.36, stdev=10031.02 00:20:22.829 lat (usec): min=2279, max=63882, avg=16172.01, stdev=10107.88 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 5538], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[10945], 00:20:22.829 | 30.00th=[11338], 40.00th=[11469], 50.00th=[11994], 60.00th=[12387], 00:20:22.829 | 70.00th=[15795], 80.00th=[18482], 90.00th=[28967], 95.00th=[39060], 00:20:22.829 | 99.00th=[56361], 99.50th=[57410], 99.90th=[58459], 99.95th=[63701], 00:20:22.829 | 99.99th=[63701] 00:20:22.829 bw ( KiB/s): min=20439, max=20439, per=31.76%, avg=20439.00, stdev= 0.00, samples=1 00:20:22.829 iops : min= 5109, max= 5109, avg=5109.00, stdev= 0.00, samples=1 00:20:22.829 lat (usec) : 750=0.01%, 1000=0.01% 00:20:22.829 lat (msec) : 4=0.44%, 10=14.76%, 20=73.40%, 50=9.67%, 100=1.70% 00:20:22.829 cpu : usr=3.40%, sys=4.60%, ctx=460, majf=0, minf=1 00:20:22.829 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:22.829 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.829 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.829 issued rwts: total=4224,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.829 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.829 job1: (groupid=0, jobs=1): err= 0: pid=1217306: Sun Oct 13 16:44:48 2024 00:20:22.829 read: IOPS=4273, BW=16.7MiB/s (17.5MB/s)(16.7MiB/1003msec) 00:20:22.829 slat (usec): min=2, max=7298, avg=102.56, stdev=560.79 00:20:22.829 clat (usec): min=1222, max=27040, avg=13262.13, stdev=3346.43 00:20:22.829 lat (usec): min=3934, max=28001, avg=13364.69, stdev=3391.25 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 7635], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[10159], 00:20:22.829 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12649], 60.00th=[13566], 00:20:22.829 | 70.00th=[14615], 80.00th=[15926], 90.00th=[17695], 95.00th=[20055], 00:20:22.829 | 99.00th=[23200], 99.50th=[24773], 99.90th=[26084], 99.95th=[26084], 00:20:22.829 | 99.99th=[27132] 00:20:22.829 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:20:22.829 slat (usec): min=4, max=8808, avg=112.33, stdev=648.36 00:20:22.829 clat (usec): min=5356, max=36780, avg=15221.16, stdev=5352.60 00:20:22.829 lat (usec): min=5383, max=36788, avg=15333.49, stdev=5407.95 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 8455], 5.00th=[10159], 10.00th=[10421], 20.00th=[11076], 00:20:22.829 | 30.00th=[12125], 40.00th=[12911], 50.00th=[13304], 60.00th=[14484], 00:20:22.829 | 70.00th=[15664], 80.00th=[18482], 90.00th=[22152], 95.00th=[27919], 00:20:22.829 | 99.00th=[32375], 99.50th=[34341], 99.90th=[36963], 99.95th=[36963], 00:20:22.829 | 99.99th=[36963] 00:20:22.829 bw ( KiB/s): min=17936, max=18928, per=28.65%, avg=18432.00, stdev=701.45, samples=2 00:20:22.829 iops : min= 4484, max= 4732, avg=4608.00, stdev=175.36, samples=2 00:20:22.829 lat (msec) : 2=0.01%, 4=0.02%, 10=8.70%, 20=80.94%, 50=10.32% 00:20:22.829 cpu : usr=5.89%, sys=8.48%, ctx=384, majf=0, minf=2 00:20:22.829 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:22.829 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.829 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.829 issued rwts: total=4286,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.829 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.829 job2: (groupid=0, jobs=1): err= 0: pid=1217307: Sun Oct 13 16:44:48 2024 00:20:22.829 read: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec) 00:20:22.829 slat (usec): min=2, max=10283, avg=134.82, stdev=724.14 00:20:22.829 clat (usec): min=7806, max=39472, avg=16596.98, stdev=4996.78 00:20:22.829 lat (usec): min=7813, max=39510, avg=16731.80, stdev=5063.74 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 8586], 5.00th=[10290], 10.00th=[12125], 20.00th=[12649], 00:20:22.829 | 30.00th=[13042], 40.00th=[13698], 50.00th=[15270], 60.00th=[16712], 00:20:22.829 | 70.00th=[18744], 80.00th=[20579], 90.00th=[24773], 95.00th=[26084], 00:20:22.829 | 99.00th=[31851], 99.50th=[31851], 99.90th=[34866], 99.95th=[35914], 00:20:22.829 | 99.99th=[39584] 00:20:22.829 write: IOPS=3859, BW=15.1MiB/s (15.8MB/s)(15.2MiB/1005msec); 0 zone resets 00:20:22.829 slat (usec): min=3, max=15781, avg=124.72, stdev=693.46 00:20:22.829 clat (usec): min=4188, max=40864, avg=17295.67, stdev=5302.16 00:20:22.829 lat (usec): min=4734, max=40870, avg=17420.40, stdev=5340.35 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 8455], 5.00th=[11338], 10.00th=[11994], 20.00th=[12911], 00:20:22.829 | 30.00th=[13698], 40.00th=[15139], 50.00th=[16188], 60.00th=[17433], 00:20:22.829 | 70.00th=[19530], 80.00th=[21103], 90.00th=[23725], 95.00th=[27657], 00:20:22.829 | 99.00th=[35390], 99.50th=[36963], 99.90th=[39060], 99.95th=[40633], 00:20:22.829 | 99.99th=[40633] 00:20:22.829 bw ( KiB/s): min=13405, max=16584, per=23.30%, avg=14994.50, stdev=2247.89, samples=2 00:20:22.829 iops : min= 3351, max= 4146, avg=3748.50, stdev=562.15, samples=2 00:20:22.829 lat (msec) : 10=4.02%, 20=71.58%, 50=24.40% 00:20:22.829 cpu : usr=3.59%, sys=6.97%, ctx=334, majf=0, minf=1 00:20:22.829 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:22.829 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.829 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.829 issued rwts: total=3584,3879,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.829 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.829 job3: (groupid=0, jobs=1): err= 0: pid=1217309: Sun Oct 13 16:44:48 2024 00:20:22.829 read: IOPS=2678, BW=10.5MiB/s (11.0MB/s)(10.5MiB/1003msec) 00:20:22.829 slat (usec): min=2, max=8704, avg=165.09, stdev=865.56 00:20:22.829 clat (usec): min=818, max=43128, avg=19975.79, stdev=6121.96 00:20:22.829 lat (usec): min=8572, max=43162, avg=20140.88, stdev=6181.33 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[ 9372], 5.00th=[12256], 10.00th=[12780], 20.00th=[13829], 00:20:22.829 | 30.00th=[16712], 40.00th=[17171], 50.00th=[18220], 60.00th=[21365], 00:20:22.829 | 70.00th=[23462], 80.00th=[25035], 90.00th=[27395], 95.00th=[31589], 00:20:22.829 | 99.00th=[38011], 99.50th=[38536], 99.90th=[38536], 99.95th=[41157], 00:20:22.829 | 99.99th=[43254] 00:20:22.829 write: IOPS=3062, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1003msec); 0 zone resets 00:20:22.829 slat (usec): min=3, max=9112, avg=174.12, stdev=866.48 00:20:22.829 clat (usec): min=9860, max=53895, avg=23553.60, stdev=9951.76 00:20:22.829 lat (usec): min=9866, max=53902, avg=23727.71, stdev=10028.04 00:20:22.829 clat percentiles (usec): 00:20:22.829 | 1.00th=[10683], 5.00th=[11207], 10.00th=[13042], 20.00th=[13960], 00:20:22.829 | 30.00th=[15795], 40.00th=[19530], 50.00th=[22676], 60.00th=[23462], 00:20:22.829 | 70.00th=[27395], 80.00th=[32637], 90.00th=[39584], 95.00th=[42206], 00:20:22.829 | 99.00th=[49021], 99.50th=[52691], 99.90th=[53740], 99.95th=[53740], 00:20:22.829 | 99.99th=[53740] 00:20:22.830 bw ( KiB/s): min=12263, max=12280, per=19.07%, avg=12271.50, stdev=12.02, samples=2 00:20:22.830 iops : min= 3065, max= 3070, avg=3067.50, stdev= 3.54, samples=2 00:20:22.830 lat (usec) : 1000=0.02% 00:20:22.830 lat (msec) : 10=0.89%, 20=50.16%, 50=48.41%, 100=0.52% 00:20:22.830 cpu : usr=1.80%, sys=4.49%, ctx=298, majf=0, minf=1 00:20:22.830 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:22.830 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.830 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.830 issued rwts: total=2687,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.830 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.830 00:20:22.830 Run status group 0 (all jobs): 00:20:22.830 READ: bw=57.5MiB/s (60.2MB/s), 10.5MiB/s-16.7MiB/s (11.0MB/s-17.5MB/s), io=57.7MiB (60.5MB), run=1001-1005msec 00:20:22.830 WRITE: bw=62.8MiB/s (65.9MB/s), 12.0MiB/s-18.0MiB/s (12.5MB/s-18.9MB/s), io=63.2MiB (66.2MB), run=1001-1005msec 00:20:22.830 00:20:22.830 Disk stats (read/write): 00:20:22.830 nvme0n1: ios=3780/4096, merge=0/0, ticks=21297/25885, in_queue=47182, util=97.29% 00:20:22.830 nvme0n2: ios=3584/4082, merge=0/0, ticks=22524/28852, in_queue=51376, util=86.70% 00:20:22.830 nvme0n3: ios=3128/3231, merge=0/0, ticks=19971/18350, in_queue=38321, util=97.50% 00:20:22.830 nvme0n4: ios=2397/2560, merge=0/0, ticks=15852/19343, in_queue=35195, util=96.75% 00:20:22.830 16:44:48 -- target/fio.sh@55 -- # sync 00:20:22.830 16:44:48 -- target/fio.sh@59 -- # fio_pid=1217450 00:20:22.830 16:44:48 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:20:22.830 16:44:48 -- target/fio.sh@61 -- # sleep 3 00:20:22.830 [global] 00:20:22.830 thread=1 00:20:22.830 invalidate=1 00:20:22.830 rw=read 00:20:22.830 time_based=1 00:20:22.830 runtime=10 00:20:22.830 ioengine=libaio 00:20:22.830 direct=1 00:20:22.830 bs=4096 00:20:22.830 iodepth=1 00:20:22.830 norandommap=1 00:20:22.830 numjobs=1 00:20:22.830 00:20:22.830 [job0] 00:20:22.830 filename=/dev/nvme0n1 00:20:22.830 [job1] 00:20:22.830 filename=/dev/nvme0n2 00:20:22.830 [job2] 00:20:22.830 filename=/dev/nvme0n3 00:20:22.830 [job3] 00:20:22.830 filename=/dev/nvme0n4 00:20:22.830 Could not set queue depth (nvme0n1) 00:20:22.830 Could not set queue depth (nvme0n2) 00:20:22.830 Could not set queue depth (nvme0n3) 00:20:22.830 Could not set queue depth (nvme0n4) 00:20:22.830 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.830 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.830 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.830 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.830 fio-3.35 00:20:22.830 Starting 4 threads 00:20:26.105 16:44:51 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:20:26.106 16:44:51 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:20:26.106 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=4288512, buflen=4096 00:20:26.106 fio: pid=1217548, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:26.106 16:44:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.106 16:44:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:20:26.363 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=6877184, buflen=4096 00:20:26.363 fio: pid=1217547, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:26.620 16:44:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.620 16:44:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:20:26.620 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=23506944, buflen=4096 00:20:26.620 fio: pid=1217545, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:26.878 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=44244992, buflen=4096 00:20:26.878 fio: pid=1217546, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:26.878 16:44:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.878 16:44:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:20:26.878 00:20:26.878 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1217545: Sun Oct 13 16:44:52 2024 00:20:26.878 read: IOPS=1640, BW=6559KiB/s (6716kB/s)(22.4MiB/3500msec) 00:20:26.878 slat (usec): min=4, max=10906, avg=16.23, stdev=203.41 00:20:26.878 clat (usec): min=170, max=41992, avg=585.36, stdev=3764.69 00:20:26.878 lat (usec): min=176, max=52004, avg=601.59, stdev=3811.39 00:20:26.878 clat percentiles (usec): 00:20:26.878 | 1.00th=[ 184], 5.00th=[ 190], 10.00th=[ 196], 20.00th=[ 202], 00:20:26.878 | 30.00th=[ 212], 40.00th=[ 221], 50.00th=[ 229], 60.00th=[ 235], 00:20:26.878 | 70.00th=[ 239], 80.00th=[ 247], 90.00th=[ 262], 95.00th=[ 388], 00:20:26.878 | 99.00th=[ 510], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:20:26.878 | 99.99th=[42206] 00:20:26.878 bw ( KiB/s): min= 96, max=16424, per=37.00%, avg=7637.33, stdev=7360.03, samples=6 00:20:26.878 iops : min= 24, max= 4106, avg=1909.33, stdev=1840.01, samples=6 00:20:26.878 lat (usec) : 250=84.58%, 500=14.29%, 750=0.21%, 1000=0.02% 00:20:26.878 lat (msec) : 2=0.03%, 50=0.85% 00:20:26.878 cpu : usr=1.54%, sys=2.92%, ctx=5744, majf=0, minf=2 00:20:26.878 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.878 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 issued rwts: total=5740,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.878 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.878 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1217546: Sun Oct 13 16:44:52 2024 00:20:26.878 read: IOPS=2893, BW=11.3MiB/s (11.8MB/s)(42.2MiB/3734msec) 00:20:26.878 slat (usec): min=5, max=29230, avg=16.08, stdev=348.23 00:20:26.878 clat (usec): min=159, max=42265, avg=324.93, stdev=2055.64 00:20:26.878 lat (usec): min=166, max=42273, avg=341.01, stdev=2085.09 00:20:26.878 clat percentiles (usec): 00:20:26.878 | 1.00th=[ 172], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 188], 00:20:26.878 | 30.00th=[ 196], 40.00th=[ 208], 50.00th=[ 231], 60.00th=[ 239], 00:20:26.878 | 70.00th=[ 245], 80.00th=[ 249], 90.00th=[ 255], 95.00th=[ 262], 00:20:26.878 | 99.00th=[ 314], 99.50th=[ 445], 99.90th=[41681], 99.95th=[42206], 00:20:26.878 | 99.99th=[42206] 00:20:26.878 bw ( KiB/s): min= 136, max=18139, per=54.82%, avg=11315.86, stdev=6234.62, samples=7 00:20:26.878 iops : min= 34, max= 4534, avg=2828.86, stdev=1558.52, samples=7 00:20:26.878 lat (usec) : 250=81.27%, 500=18.37%, 750=0.07%, 1000=0.01% 00:20:26.878 lat (msec) : 2=0.02%, 50=0.25% 00:20:26.878 cpu : usr=1.58%, sys=4.42%, ctx=10810, majf=0, minf=1 00:20:26.878 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.878 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 issued rwts: total=10803,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.878 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.878 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1217547: Sun Oct 13 16:44:52 2024 00:20:26.878 read: IOPS=524, BW=2097KiB/s (2148kB/s)(6716KiB/3202msec) 00:20:26.878 slat (nsec): min=5907, max=51747, avg=12237.32, stdev=5749.26 00:20:26.878 clat (usec): min=175, max=41186, avg=1877.75, stdev=8031.49 00:20:26.878 lat (usec): min=183, max=41197, avg=1889.99, stdev=8033.06 00:20:26.878 clat percentiles (usec): 00:20:26.878 | 1.00th=[ 186], 5.00th=[ 192], 10.00th=[ 196], 20.00th=[ 200], 00:20:26.878 | 30.00th=[ 204], 40.00th=[ 212], 50.00th=[ 227], 60.00th=[ 235], 00:20:26.878 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 273], 95.00th=[ 412], 00:20:26.878 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:26.878 | 99.99th=[41157] 00:20:26.878 bw ( KiB/s): min= 104, max= 6776, per=10.81%, avg=2232.00, stdev=2840.92, samples=6 00:20:26.878 iops : min= 26, max= 1694, avg=558.00, stdev=710.23, samples=6 00:20:26.878 lat (usec) : 250=79.40%, 500=16.25%, 750=0.18%, 1000=0.06% 00:20:26.878 lat (msec) : 50=4.05% 00:20:26.878 cpu : usr=0.50%, sys=0.87%, ctx=1681, majf=0, minf=2 00:20:26.878 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.878 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.878 issued rwts: total=1680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.878 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.878 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1217548: Sun Oct 13 16:44:52 2024 00:20:26.878 read: IOPS=358, BW=1433KiB/s (1467kB/s)(4188KiB/2923msec) 00:20:26.878 slat (nsec): min=4477, max=34882, avg=7323.13, stdev=5040.65 00:20:26.878 clat (usec): min=177, max=42022, avg=2760.10, stdev=9841.52 00:20:26.878 lat (usec): min=182, max=42049, avg=2767.40, stdev=9845.18 00:20:26.878 clat percentiles (usec): 00:20:26.878 | 1.00th=[ 186], 5.00th=[ 194], 10.00th=[ 202], 20.00th=[ 212], 00:20:26.878 | 30.00th=[ 223], 40.00th=[ 233], 50.00th=[ 247], 60.00th=[ 255], 00:20:26.878 | 70.00th=[ 269], 80.00th=[ 285], 90.00th=[ 371], 95.00th=[41157], 00:20:26.878 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:26.878 | 99.99th=[42206] 00:20:26.878 bw ( KiB/s): min= 96, max= 7880, per=8.04%, avg=1659.20, stdev=3477.55, samples=5 00:20:26.878 iops : min= 24, max= 1970, avg=414.80, stdev=869.39, samples=5 00:20:26.878 lat (usec) : 250=53.91%, 500=38.93%, 750=0.86%, 1000=0.10% 00:20:26.878 lat (msec) : 50=6.11% 00:20:26.878 cpu : usr=0.00%, sys=0.48%, ctx=1048, majf=0, minf=2 00:20:26.879 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.879 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.879 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.879 issued rwts: total=1048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.879 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.879 00:20:26.879 Run status group 0 (all jobs): 00:20:26.879 READ: bw=20.2MiB/s (21.1MB/s), 1433KiB/s-11.3MiB/s (1467kB/s-11.8MB/s), io=75.3MiB (78.9MB), run=2923-3734msec 00:20:26.879 00:20:26.879 Disk stats (read/write): 00:20:26.879 nvme0n1: ios=5777/0, merge=0/0, ticks=4100/0, in_queue=4100, util=99.54% 00:20:26.879 nvme0n2: ios=10364/0, merge=0/0, ticks=3336/0, in_queue=3336, util=95.12% 00:20:26.879 nvme0n3: ios=1726/0, merge=0/0, ticks=3456/0, in_queue=3456, util=98.94% 00:20:26.879 nvme0n4: ios=1045/0, merge=0/0, ticks=2801/0, in_queue=2801, util=96.75% 00:20:27.137 16:44:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:27.137 16:44:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:20:27.395 16:44:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:27.395 16:44:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:20:27.652 16:44:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:27.652 16:44:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:20:27.910 16:44:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:27.910 16:44:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:20:28.168 16:44:53 -- target/fio.sh@69 -- # fio_status=0 00:20:28.168 16:44:53 -- target/fio.sh@70 -- # wait 1217450 00:20:28.168 16:44:53 -- target/fio.sh@70 -- # fio_status=4 00:20:28.168 16:44:53 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:28.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:28.168 16:44:53 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:28.168 16:44:53 -- common/autotest_common.sh@1198 -- # local i=0 00:20:28.168 16:44:53 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:28.168 16:44:53 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:28.168 16:44:53 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:28.168 16:44:53 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:28.168 16:44:53 -- common/autotest_common.sh@1210 -- # return 0 00:20:28.168 16:44:53 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:20:28.168 16:44:53 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:20:28.168 nvmf hotplug test: fio failed as expected 00:20:28.168 16:44:53 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:28.426 16:44:53 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:20:28.426 16:44:53 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:20:28.426 16:44:53 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:20:28.426 16:44:53 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:20:28.426 16:44:53 -- target/fio.sh@91 -- # nvmftestfini 00:20:28.426 16:44:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:28.426 16:44:53 -- nvmf/common.sh@116 -- # sync 00:20:28.426 16:44:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:28.426 16:44:53 -- nvmf/common.sh@119 -- # set +e 00:20:28.426 16:44:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:28.426 16:44:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:28.426 rmmod nvme_tcp 00:20:28.426 rmmod nvme_fabrics 00:20:28.426 rmmod nvme_keyring 00:20:28.426 16:44:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:28.426 16:44:53 -- nvmf/common.sh@123 -- # set -e 00:20:28.426 16:44:53 -- nvmf/common.sh@124 -- # return 0 00:20:28.426 16:44:53 -- nvmf/common.sh@477 -- # '[' -n 1215362 ']' 00:20:28.426 16:44:53 -- nvmf/common.sh@478 -- # killprocess 1215362 00:20:28.426 16:44:53 -- common/autotest_common.sh@926 -- # '[' -z 1215362 ']' 00:20:28.426 16:44:53 -- common/autotest_common.sh@930 -- # kill -0 1215362 00:20:28.426 16:44:53 -- common/autotest_common.sh@931 -- # uname 00:20:28.426 16:44:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:28.426 16:44:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1215362 00:20:28.685 16:44:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:28.685 16:44:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:28.685 16:44:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1215362' 00:20:28.685 killing process with pid 1215362 00:20:28.685 16:44:53 -- common/autotest_common.sh@945 -- # kill 1215362 00:20:28.685 16:44:53 -- common/autotest_common.sh@950 -- # wait 1215362 00:20:28.943 16:44:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:28.943 16:44:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:28.943 16:44:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:28.943 16:44:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:28.943 16:44:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:28.943 16:44:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:28.943 16:44:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:28.943 16:44:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.847 16:44:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:30.847 00:20:30.847 real 0m24.360s 00:20:30.847 user 1m26.465s 00:20:30.847 sys 0m6.308s 00:20:30.847 16:44:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:30.847 16:44:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.847 ************************************ 00:20:30.847 END TEST nvmf_fio_target 00:20:30.847 ************************************ 00:20:30.847 16:44:56 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:30.847 16:44:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:30.847 16:44:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:30.847 16:44:56 -- common/autotest_common.sh@10 -- # set +x 00:20:30.847 ************************************ 00:20:30.847 START TEST nvmf_bdevio 00:20:30.847 ************************************ 00:20:30.847 16:44:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:30.847 * Looking for test storage... 00:20:30.847 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:30.847 16:44:56 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:30.847 16:44:56 -- nvmf/common.sh@7 -- # uname -s 00:20:30.847 16:44:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:30.847 16:44:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:30.847 16:44:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:30.847 16:44:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:30.847 16:44:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:30.847 16:44:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:30.847 16:44:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:30.847 16:44:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:30.847 16:44:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:30.847 16:44:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:30.847 16:44:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:30.847 16:44:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:30.847 16:44:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:30.847 16:44:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:30.847 16:44:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:30.847 16:44:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:30.847 16:44:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:30.847 16:44:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:30.847 16:44:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:30.848 16:44:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.848 16:44:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.848 16:44:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.848 16:44:56 -- paths/export.sh@5 -- # export PATH 00:20:30.848 16:44:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.848 16:44:56 -- nvmf/common.sh@46 -- # : 0 00:20:30.848 16:44:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:30.848 16:44:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:30.848 16:44:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:30.848 16:44:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:30.848 16:44:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:30.848 16:44:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:30.848 16:44:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:30.848 16:44:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:30.848 16:44:56 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:30.848 16:44:56 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:30.848 16:44:56 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:30.848 16:44:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:30.848 16:44:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:30.848 16:44:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:30.848 16:44:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:30.848 16:44:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:30.848 16:44:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:30.848 16:44:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:30.848 16:44:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.848 16:44:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:30.848 16:44:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:30.848 16:44:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:30.848 16:44:56 -- common/autotest_common.sh@10 -- # set +x 00:20:33.379 16:44:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:33.379 16:44:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:33.379 16:44:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:33.379 16:44:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:33.379 16:44:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:33.379 16:44:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:33.379 16:44:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:33.379 16:44:58 -- nvmf/common.sh@294 -- # net_devs=() 00:20:33.379 16:44:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:33.379 16:44:58 -- nvmf/common.sh@295 -- # e810=() 00:20:33.379 16:44:58 -- nvmf/common.sh@295 -- # local -ga e810 00:20:33.379 16:44:58 -- nvmf/common.sh@296 -- # x722=() 00:20:33.379 16:44:58 -- nvmf/common.sh@296 -- # local -ga x722 00:20:33.379 16:44:58 -- nvmf/common.sh@297 -- # mlx=() 00:20:33.379 16:44:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:33.379 16:44:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:33.379 16:44:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:33.379 16:44:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:33.379 16:44:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:33.379 16:44:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:33.379 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:33.379 16:44:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:33.379 16:44:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:33.379 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:33.379 16:44:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:33.379 16:44:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:33.379 16:44:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:33.379 16:44:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:33.379 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:33.379 16:44:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:33.379 16:44:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:33.379 16:44:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:33.379 16:44:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:33.379 16:44:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:33.379 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:33.379 16:44:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:33.379 16:44:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:33.379 16:44:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:33.379 16:44:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:33.379 16:44:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:33.379 16:44:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:33.379 16:44:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:33.379 16:44:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:33.379 16:44:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:33.379 16:44:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:33.379 16:44:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:33.379 16:44:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:33.379 16:44:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:33.379 16:44:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:33.379 16:44:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:33.379 16:44:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:33.379 16:44:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:33.379 16:44:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:33.379 16:44:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:33.380 16:44:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:33.380 16:44:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:33.380 16:44:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:33.380 16:44:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:33.380 16:44:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:33.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:33.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:20:33.380 00:20:33.380 --- 10.0.0.2 ping statistics --- 00:20:33.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:33.380 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:20:33.380 16:44:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:33.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:33.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:20:33.380 00:20:33.380 --- 10.0.0.1 ping statistics --- 00:20:33.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:33.380 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:20:33.380 16:44:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:33.380 16:44:58 -- nvmf/common.sh@410 -- # return 0 00:20:33.380 16:44:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:33.380 16:44:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:33.380 16:44:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:33.380 16:44:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:33.380 16:44:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:33.380 16:44:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:33.380 16:44:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:33.380 16:44:58 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:33.380 16:44:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:33.380 16:44:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:33.380 16:44:58 -- common/autotest_common.sh@10 -- # set +x 00:20:33.380 16:44:58 -- nvmf/common.sh@469 -- # nvmfpid=1220197 00:20:33.380 16:44:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:20:33.380 16:44:58 -- nvmf/common.sh@470 -- # waitforlisten 1220197 00:20:33.380 16:44:58 -- common/autotest_common.sh@819 -- # '[' -z 1220197 ']' 00:20:33.380 16:44:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:33.380 16:44:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:33.380 16:44:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:33.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:33.380 16:44:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:33.380 16:44:58 -- common/autotest_common.sh@10 -- # set +x 00:20:33.380 [2024-10-13 16:44:58.511710] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:33.380 [2024-10-13 16:44:58.511810] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:33.380 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.380 [2024-10-13 16:44:58.584065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:33.380 [2024-10-13 16:44:58.677500] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:33.380 [2024-10-13 16:44:58.677678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:33.380 [2024-10-13 16:44:58.677699] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:33.380 [2024-10-13 16:44:58.677714] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:33.380 [2024-10-13 16:44:58.677783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:33.380 [2024-10-13 16:44:58.677847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:33.380 [2024-10-13 16:44:58.677907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:33.380 [2024-10-13 16:44:58.677910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:34.021 16:44:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:34.021 16:44:59 -- common/autotest_common.sh@852 -- # return 0 00:20:34.021 16:44:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:34.021 16:44:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:34.021 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 16:44:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:34.280 16:44:59 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:34.280 16:44:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:34.280 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 [2024-10-13 16:44:59.525115] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:34.280 16:44:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:34.280 16:44:59 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:34.280 16:44:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:34.280 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 Malloc0 00:20:34.280 16:44:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:34.280 16:44:59 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:34.280 16:44:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:34.280 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 16:44:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:34.280 16:44:59 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:34.280 16:44:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:34.280 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 16:44:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:34.280 16:44:59 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:34.280 16:44:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:34.280 16:44:59 -- common/autotest_common.sh@10 -- # set +x 00:20:34.280 [2024-10-13 16:44:59.576499] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:34.280 16:44:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:34.280 16:44:59 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:34.280 16:44:59 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:34.280 16:44:59 -- nvmf/common.sh@520 -- # config=() 00:20:34.280 16:44:59 -- nvmf/common.sh@520 -- # local subsystem config 00:20:34.280 16:44:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:34.280 16:44:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:34.280 { 00:20:34.280 "params": { 00:20:34.280 "name": "Nvme$subsystem", 00:20:34.280 "trtype": "$TEST_TRANSPORT", 00:20:34.280 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:34.280 "adrfam": "ipv4", 00:20:34.280 "trsvcid": "$NVMF_PORT", 00:20:34.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:34.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:34.280 "hdgst": ${hdgst:-false}, 00:20:34.280 "ddgst": ${ddgst:-false} 00:20:34.280 }, 00:20:34.280 "method": "bdev_nvme_attach_controller" 00:20:34.280 } 00:20:34.280 EOF 00:20:34.280 )") 00:20:34.280 16:44:59 -- nvmf/common.sh@542 -- # cat 00:20:34.280 16:44:59 -- nvmf/common.sh@544 -- # jq . 00:20:34.280 16:44:59 -- nvmf/common.sh@545 -- # IFS=, 00:20:34.280 16:44:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:34.280 "params": { 00:20:34.280 "name": "Nvme1", 00:20:34.280 "trtype": "tcp", 00:20:34.280 "traddr": "10.0.0.2", 00:20:34.280 "adrfam": "ipv4", 00:20:34.280 "trsvcid": "4420", 00:20:34.280 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:34.280 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:34.280 "hdgst": false, 00:20:34.280 "ddgst": false 00:20:34.280 }, 00:20:34.280 "method": "bdev_nvme_attach_controller" 00:20:34.280 }' 00:20:34.280 [2024-10-13 16:44:59.617515] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:34.280 [2024-10-13 16:44:59.617594] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1220361 ] 00:20:34.280 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.280 [2024-10-13 16:44:59.678082] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:34.280 [2024-10-13 16:44:59.764576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:34.280 [2024-10-13 16:44:59.764629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.280 [2024-10-13 16:44:59.764632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:34.846 [2024-10-13 16:45:00.049833] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:34.846 [2024-10-13 16:45:00.049884] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:34.846 I/O targets: 00:20:34.846 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:34.846 00:20:34.846 00:20:34.846 CUnit - A unit testing framework for C - Version 2.1-3 00:20:34.846 http://cunit.sourceforge.net/ 00:20:34.846 00:20:34.846 00:20:34.846 Suite: bdevio tests on: Nvme1n1 00:20:34.846 Test: blockdev write read block ...passed 00:20:34.846 Test: blockdev write zeroes read block ...passed 00:20:34.846 Test: blockdev write zeroes read no split ...passed 00:20:34.846 Test: blockdev write zeroes read split ...passed 00:20:34.846 Test: blockdev write zeroes read split partial ...passed 00:20:34.846 Test: blockdev reset ...[2024-10-13 16:45:00.206215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:34.846 [2024-10-13 16:45:00.206320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e7ae40 (9): Bad file descriptor 00:20:34.846 [2024-10-13 16:45:00.218390] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:34.846 passed 00:20:34.846 Test: blockdev write read 8 blocks ...passed 00:20:34.846 Test: blockdev write read size > 128k ...passed 00:20:34.846 Test: blockdev write read invalid size ...passed 00:20:34.846 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:34.846 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:34.846 Test: blockdev write read max offset ...passed 00:20:35.104 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:35.104 Test: blockdev writev readv 8 blocks ...passed 00:20:35.104 Test: blockdev writev readv 30 x 1block ...passed 00:20:35.104 Test: blockdev writev readv block ...passed 00:20:35.104 Test: blockdev writev readv size > 128k ...passed 00:20:35.104 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:35.104 Test: blockdev comparev and writev ...[2024-10-13 16:45:00.469444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.469481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.469531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.469561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.469897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.469925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.469958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.469987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.470330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.470356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.470390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.470427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.470755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.470782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.470817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:35.104 [2024-10-13 16:45:00.470844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:35.104 passed 00:20:35.104 Test: blockdev nvme passthru rw ...passed 00:20:35.104 Test: blockdev nvme passthru vendor specific ...[2024-10-13 16:45:00.553633] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:35.104 [2024-10-13 16:45:00.553662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.553835] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:35.104 [2024-10-13 16:45:00.553861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:35.104 [2024-10-13 16:45:00.554030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:35.105 [2024-10-13 16:45:00.554055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:35.105 [2024-10-13 16:45:00.554229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:35.105 [2024-10-13 16:45:00.554255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:35.105 passed 00:20:35.105 Test: blockdev nvme admin passthru ...passed 00:20:35.362 Test: blockdev copy ...passed 00:20:35.362 00:20:35.362 Run Summary: Type Total Ran Passed Failed Inactive 00:20:35.362 suites 1 1 n/a 0 0 00:20:35.362 tests 23 23 23 0 0 00:20:35.362 asserts 152 152 152 0 n/a 00:20:35.362 00:20:35.362 Elapsed time = 1.116 seconds 00:20:35.362 16:45:00 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:35.362 16:45:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:35.363 16:45:00 -- common/autotest_common.sh@10 -- # set +x 00:20:35.363 16:45:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:35.363 16:45:00 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:35.363 16:45:00 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:35.363 16:45:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:35.363 16:45:00 -- nvmf/common.sh@116 -- # sync 00:20:35.363 16:45:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:35.363 16:45:00 -- nvmf/common.sh@119 -- # set +e 00:20:35.363 16:45:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:35.363 16:45:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:35.363 rmmod nvme_tcp 00:20:35.363 rmmod nvme_fabrics 00:20:35.363 rmmod nvme_keyring 00:20:35.363 16:45:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:35.363 16:45:00 -- nvmf/common.sh@123 -- # set -e 00:20:35.363 16:45:00 -- nvmf/common.sh@124 -- # return 0 00:20:35.363 16:45:00 -- nvmf/common.sh@477 -- # '[' -n 1220197 ']' 00:20:35.363 16:45:00 -- nvmf/common.sh@478 -- # killprocess 1220197 00:20:35.363 16:45:00 -- common/autotest_common.sh@926 -- # '[' -z 1220197 ']' 00:20:35.363 16:45:00 -- common/autotest_common.sh@930 -- # kill -0 1220197 00:20:35.363 16:45:00 -- common/autotest_common.sh@931 -- # uname 00:20:35.363 16:45:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.363 16:45:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1220197 00:20:35.620 16:45:00 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:20:35.620 16:45:00 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:20:35.620 16:45:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1220197' 00:20:35.620 killing process with pid 1220197 00:20:35.620 16:45:00 -- common/autotest_common.sh@945 -- # kill 1220197 00:20:35.620 16:45:00 -- common/autotest_common.sh@950 -- # wait 1220197 00:20:35.877 16:45:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:35.877 16:45:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:35.877 16:45:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:35.877 16:45:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:35.877 16:45:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:35.877 16:45:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:35.877 16:45:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:35.877 16:45:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:37.781 16:45:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:37.781 00:20:37.781 real 0m6.910s 00:20:37.781 user 0m12.974s 00:20:37.781 sys 0m2.081s 00:20:37.781 16:45:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:37.781 16:45:03 -- common/autotest_common.sh@10 -- # set +x 00:20:37.781 ************************************ 00:20:37.781 END TEST nvmf_bdevio 00:20:37.781 ************************************ 00:20:37.781 16:45:03 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:37.781 16:45:03 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:37.781 16:45:03 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:20:37.781 16:45:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:37.781 16:45:03 -- common/autotest_common.sh@10 -- # set +x 00:20:37.781 ************************************ 00:20:37.781 START TEST nvmf_bdevio_no_huge 00:20:37.781 ************************************ 00:20:37.781 16:45:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:37.781 * Looking for test storage... 00:20:37.781 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:37.781 16:45:03 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:37.781 16:45:03 -- nvmf/common.sh@7 -- # uname -s 00:20:37.781 16:45:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:37.781 16:45:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:37.781 16:45:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:37.781 16:45:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:37.781 16:45:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:37.781 16:45:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:37.781 16:45:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:37.781 16:45:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:37.781 16:45:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:37.781 16:45:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:37.781 16:45:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:37.781 16:45:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:37.781 16:45:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:37.781 16:45:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:37.781 16:45:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:37.781 16:45:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:37.781 16:45:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:37.781 16:45:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:37.781 16:45:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:37.781 16:45:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:37.781 16:45:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:37.781 16:45:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:37.781 16:45:03 -- paths/export.sh@5 -- # export PATH 00:20:37.781 16:45:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:37.781 16:45:03 -- nvmf/common.sh@46 -- # : 0 00:20:37.781 16:45:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:37.781 16:45:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:37.781 16:45:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:37.781 16:45:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:37.781 16:45:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:37.781 16:45:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:37.781 16:45:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:37.781 16:45:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:37.781 16:45:03 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:37.781 16:45:03 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:37.781 16:45:03 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:37.781 16:45:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:37.781 16:45:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:37.781 16:45:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:37.781 16:45:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:37.781 16:45:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:37.781 16:45:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:37.781 16:45:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:37.781 16:45:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:37.781 16:45:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:37.781 16:45:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:37.781 16:45:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:37.781 16:45:03 -- common/autotest_common.sh@10 -- # set +x 00:20:39.682 16:45:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:39.682 16:45:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:39.682 16:45:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:39.682 16:45:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:39.682 16:45:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:39.682 16:45:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:39.682 16:45:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:39.682 16:45:05 -- nvmf/common.sh@294 -- # net_devs=() 00:20:39.682 16:45:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:39.682 16:45:05 -- nvmf/common.sh@295 -- # e810=() 00:20:39.682 16:45:05 -- nvmf/common.sh@295 -- # local -ga e810 00:20:39.682 16:45:05 -- nvmf/common.sh@296 -- # x722=() 00:20:39.682 16:45:05 -- nvmf/common.sh@296 -- # local -ga x722 00:20:39.682 16:45:05 -- nvmf/common.sh@297 -- # mlx=() 00:20:39.682 16:45:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:39.682 16:45:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:39.682 16:45:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:39.682 16:45:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:39.682 16:45:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:39.682 16:45:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:39.682 16:45:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:39.682 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:39.682 16:45:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:39.682 16:45:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:39.682 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:39.682 16:45:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:39.682 16:45:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:39.682 16:45:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:39.683 16:45:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:39.683 16:45:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:39.683 16:45:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:39.683 16:45:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:39.683 16:45:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:39.683 16:45:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:39.683 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:39.683 16:45:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:39.683 16:45:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:39.683 16:45:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:39.683 16:45:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:39.683 16:45:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:39.683 16:45:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:39.683 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:39.683 16:45:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:39.683 16:45:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:39.683 16:45:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:39.683 16:45:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:39.683 16:45:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:39.683 16:45:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:39.683 16:45:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:39.683 16:45:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:39.683 16:45:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:39.683 16:45:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:39.683 16:45:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:39.683 16:45:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:39.683 16:45:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:39.683 16:45:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:39.683 16:45:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:39.683 16:45:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:39.683 16:45:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:39.683 16:45:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:39.683 16:45:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:39.944 16:45:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:39.944 16:45:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:39.944 16:45:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:39.944 16:45:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:39.944 16:45:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:39.944 16:45:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:39.944 16:45:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:39.944 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:39.944 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:20:39.944 00:20:39.944 --- 10.0.0.2 ping statistics --- 00:20:39.944 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:39.944 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:20:39.944 16:45:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:39.944 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:39.944 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:20:39.944 00:20:39.944 --- 10.0.0.1 ping statistics --- 00:20:39.944 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:39.944 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:20:39.944 16:45:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:39.944 16:45:05 -- nvmf/common.sh@410 -- # return 0 00:20:39.944 16:45:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:39.944 16:45:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:39.944 16:45:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:39.944 16:45:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:39.944 16:45:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:39.944 16:45:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:39.944 16:45:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:39.944 16:45:05 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:39.944 16:45:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:39.944 16:45:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:39.944 16:45:05 -- common/autotest_common.sh@10 -- # set +x 00:20:39.944 16:45:05 -- nvmf/common.sh@469 -- # nvmfpid=1222547 00:20:39.944 16:45:05 -- nvmf/common.sh@470 -- # waitforlisten 1222547 00:20:39.944 16:45:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:39.944 16:45:05 -- common/autotest_common.sh@819 -- # '[' -z 1222547 ']' 00:20:39.944 16:45:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:39.944 16:45:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:39.944 16:45:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:39.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:39.944 16:45:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:39.944 16:45:05 -- common/autotest_common.sh@10 -- # set +x 00:20:39.944 [2024-10-13 16:45:05.366696] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:39.944 [2024-10-13 16:45:05.366793] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:39.944 [2024-10-13 16:45:05.436665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:40.203 [2024-10-13 16:45:05.525089] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:40.203 [2024-10-13 16:45:05.525251] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:40.203 [2024-10-13 16:45:05.525268] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:40.203 [2024-10-13 16:45:05.525280] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:40.203 [2024-10-13 16:45:05.525340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:40.203 [2024-10-13 16:45:05.525434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:40.203 [2024-10-13 16:45:05.525494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:40.203 [2024-10-13 16:45:05.525496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:41.136 16:45:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:41.136 16:45:06 -- common/autotest_common.sh@852 -- # return 0 00:20:41.136 16:45:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:41.136 16:45:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 16:45:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:41.136 16:45:06 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:41.136 16:45:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 [2024-10-13 16:45:06.358732] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:41.136 16:45:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.136 16:45:06 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:41.136 16:45:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 Malloc0 00:20:41.136 16:45:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.136 16:45:06 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:41.136 16:45:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 16:45:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.136 16:45:06 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:41.136 16:45:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 16:45:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.136 16:45:06 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:41.136 16:45:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.136 16:45:06 -- common/autotest_common.sh@10 -- # set +x 00:20:41.136 [2024-10-13 16:45:06.396846] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:41.136 16:45:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.136 16:45:06 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:41.136 16:45:06 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:41.136 16:45:06 -- nvmf/common.sh@520 -- # config=() 00:20:41.136 16:45:06 -- nvmf/common.sh@520 -- # local subsystem config 00:20:41.136 16:45:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:41.136 16:45:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:41.136 { 00:20:41.136 "params": { 00:20:41.136 "name": "Nvme$subsystem", 00:20:41.136 "trtype": "$TEST_TRANSPORT", 00:20:41.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:41.136 "adrfam": "ipv4", 00:20:41.136 "trsvcid": "$NVMF_PORT", 00:20:41.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:41.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:41.136 "hdgst": ${hdgst:-false}, 00:20:41.136 "ddgst": ${ddgst:-false} 00:20:41.136 }, 00:20:41.136 "method": "bdev_nvme_attach_controller" 00:20:41.136 } 00:20:41.136 EOF 00:20:41.136 )") 00:20:41.136 16:45:06 -- nvmf/common.sh@542 -- # cat 00:20:41.136 16:45:06 -- nvmf/common.sh@544 -- # jq . 00:20:41.136 16:45:06 -- nvmf/common.sh@545 -- # IFS=, 00:20:41.136 16:45:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:41.136 "params": { 00:20:41.136 "name": "Nvme1", 00:20:41.136 "trtype": "tcp", 00:20:41.136 "traddr": "10.0.0.2", 00:20:41.136 "adrfam": "ipv4", 00:20:41.136 "trsvcid": "4420", 00:20:41.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.136 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:41.136 "hdgst": false, 00:20:41.136 "ddgst": false 00:20:41.136 }, 00:20:41.136 "method": "bdev_nvme_attach_controller" 00:20:41.136 }' 00:20:41.136 [2024-10-13 16:45:06.440320] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:41.136 [2024-10-13 16:45:06.440409] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1222709 ] 00:20:41.136 [2024-10-13 16:45:06.500294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:41.136 [2024-10-13 16:45:06.586612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:41.136 [2024-10-13 16:45:06.586639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.136 [2024-10-13 16:45:06.586642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:41.701 [2024-10-13 16:45:06.901402] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:41.701 [2024-10-13 16:45:06.901451] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:41.701 I/O targets: 00:20:41.701 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:41.701 00:20:41.701 00:20:41.701 CUnit - A unit testing framework for C - Version 2.1-3 00:20:41.701 http://cunit.sourceforge.net/ 00:20:41.701 00:20:41.701 00:20:41.701 Suite: bdevio tests on: Nvme1n1 00:20:41.701 Test: blockdev write read block ...passed 00:20:41.701 Test: blockdev write zeroes read block ...passed 00:20:41.701 Test: blockdev write zeroes read no split ...passed 00:20:41.701 Test: blockdev write zeroes read split ...passed 00:20:41.701 Test: blockdev write zeroes read split partial ...passed 00:20:41.701 Test: blockdev reset ...[2024-10-13 16:45:07.063773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:41.701 [2024-10-13 16:45:07.063883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8767c0 (9): Bad file descriptor 00:20:41.701 [2024-10-13 16:45:07.081309] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:41.701 passed 00:20:41.701 Test: blockdev write read 8 blocks ...passed 00:20:41.701 Test: blockdev write read size > 128k ...passed 00:20:41.701 Test: blockdev write read invalid size ...passed 00:20:41.701 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:41.701 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:41.701 Test: blockdev write read max offset ...passed 00:20:41.959 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:41.959 Test: blockdev writev readv 8 blocks ...passed 00:20:41.959 Test: blockdev writev readv 30 x 1block ...passed 00:20:41.959 Test: blockdev writev readv block ...passed 00:20:41.959 Test: blockdev writev readv size > 128k ...passed 00:20:41.959 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:41.959 Test: blockdev comparev and writev ...[2024-10-13 16:45:07.254505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.254542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.254581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.254609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.255019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.255052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.255089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.255117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.255513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.255541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.255575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.255602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.255982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.256009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.256043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:41.959 [2024-10-13 16:45:07.256071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:41.959 passed 00:20:41.959 Test: blockdev nvme passthru rw ...passed 00:20:41.959 Test: blockdev nvme passthru vendor specific ...[2024-10-13 16:45:07.339673] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:41.959 [2024-10-13 16:45:07.339703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:41.959 [2024-10-13 16:45:07.339861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:41.959 [2024-10-13 16:45:07.339887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:41.960 [2024-10-13 16:45:07.340045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:41.960 [2024-10-13 16:45:07.340071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:41.960 [2024-10-13 16:45:07.340226] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:41.960 [2024-10-13 16:45:07.340252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:41.960 passed 00:20:41.960 Test: blockdev nvme admin passthru ...passed 00:20:41.960 Test: blockdev copy ...passed 00:20:41.960 00:20:41.960 Run Summary: Type Total Ran Passed Failed Inactive 00:20:41.960 suites 1 1 n/a 0 0 00:20:41.960 tests 23 23 23 0 0 00:20:41.960 asserts 152 152 152 0 n/a 00:20:41.960 00:20:41.960 Elapsed time = 0.987 seconds 00:20:42.217 16:45:07 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:42.217 16:45:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:42.217 16:45:07 -- common/autotest_common.sh@10 -- # set +x 00:20:42.217 16:45:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:42.217 16:45:07 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:42.217 16:45:07 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:42.217 16:45:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:42.217 16:45:07 -- nvmf/common.sh@116 -- # sync 00:20:42.217 16:45:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:42.217 16:45:07 -- nvmf/common.sh@119 -- # set +e 00:20:42.217 16:45:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:42.217 16:45:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:42.475 rmmod nvme_tcp 00:20:42.475 rmmod nvme_fabrics 00:20:42.475 rmmod nvme_keyring 00:20:42.475 16:45:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:42.475 16:45:07 -- nvmf/common.sh@123 -- # set -e 00:20:42.475 16:45:07 -- nvmf/common.sh@124 -- # return 0 00:20:42.475 16:45:07 -- nvmf/common.sh@477 -- # '[' -n 1222547 ']' 00:20:42.475 16:45:07 -- nvmf/common.sh@478 -- # killprocess 1222547 00:20:42.475 16:45:07 -- common/autotest_common.sh@926 -- # '[' -z 1222547 ']' 00:20:42.475 16:45:07 -- common/autotest_common.sh@930 -- # kill -0 1222547 00:20:42.476 16:45:07 -- common/autotest_common.sh@931 -- # uname 00:20:42.476 16:45:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:42.476 16:45:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1222547 00:20:42.476 16:45:07 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:20:42.476 16:45:07 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:20:42.476 16:45:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1222547' 00:20:42.476 killing process with pid 1222547 00:20:42.476 16:45:07 -- common/autotest_common.sh@945 -- # kill 1222547 00:20:42.476 16:45:07 -- common/autotest_common.sh@950 -- # wait 1222547 00:20:42.734 16:45:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:42.734 16:45:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:42.734 16:45:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:42.734 16:45:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:42.734 16:45:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:42.734 16:45:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:42.734 16:45:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:42.734 16:45:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:45.266 16:45:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:45.266 00:20:45.266 real 0m7.028s 00:20:45.266 user 0m13.437s 00:20:45.266 sys 0m2.476s 00:20:45.266 16:45:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:45.266 16:45:10 -- common/autotest_common.sh@10 -- # set +x 00:20:45.266 ************************************ 00:20:45.266 END TEST nvmf_bdevio_no_huge 00:20:45.266 ************************************ 00:20:45.266 16:45:10 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:45.266 16:45:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:45.266 16:45:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:45.266 16:45:10 -- common/autotest_common.sh@10 -- # set +x 00:20:45.266 ************************************ 00:20:45.266 START TEST nvmf_tls 00:20:45.266 ************************************ 00:20:45.266 16:45:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:45.266 * Looking for test storage... 00:20:45.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:45.266 16:45:10 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:45.266 16:45:10 -- nvmf/common.sh@7 -- # uname -s 00:20:45.266 16:45:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:45.266 16:45:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:45.266 16:45:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:45.266 16:45:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:45.266 16:45:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:45.266 16:45:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:45.266 16:45:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:45.266 16:45:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:45.266 16:45:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:45.266 16:45:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:45.266 16:45:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:45.266 16:45:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:45.266 16:45:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:45.266 16:45:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:45.266 16:45:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:45.266 16:45:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:45.266 16:45:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:45.266 16:45:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:45.266 16:45:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:45.266 16:45:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:45.266 16:45:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:45.266 16:45:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:45.266 16:45:10 -- paths/export.sh@5 -- # export PATH 00:20:45.266 16:45:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:45.266 16:45:10 -- nvmf/common.sh@46 -- # : 0 00:20:45.266 16:45:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:45.266 16:45:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:45.266 16:45:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:45.266 16:45:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:45.266 16:45:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:45.266 16:45:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:45.266 16:45:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:45.266 16:45:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:45.266 16:45:10 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:45.266 16:45:10 -- target/tls.sh@71 -- # nvmftestinit 00:20:45.266 16:45:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:45.266 16:45:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:45.266 16:45:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:45.266 16:45:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:45.266 16:45:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:45.266 16:45:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:45.266 16:45:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:45.266 16:45:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:45.266 16:45:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:45.266 16:45:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:45.266 16:45:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:45.266 16:45:10 -- common/autotest_common.sh@10 -- # set +x 00:20:47.166 16:45:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:47.166 16:45:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:47.166 16:45:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:47.166 16:45:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:47.166 16:45:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:47.166 16:45:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:47.166 16:45:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:47.166 16:45:12 -- nvmf/common.sh@294 -- # net_devs=() 00:20:47.166 16:45:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:47.166 16:45:12 -- nvmf/common.sh@295 -- # e810=() 00:20:47.166 16:45:12 -- nvmf/common.sh@295 -- # local -ga e810 00:20:47.166 16:45:12 -- nvmf/common.sh@296 -- # x722=() 00:20:47.166 16:45:12 -- nvmf/common.sh@296 -- # local -ga x722 00:20:47.166 16:45:12 -- nvmf/common.sh@297 -- # mlx=() 00:20:47.166 16:45:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:47.166 16:45:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:47.166 16:45:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:47.166 16:45:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:47.166 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:47.166 16:45:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:47.166 16:45:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:47.166 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:47.166 16:45:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:47.166 16:45:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:47.166 16:45:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:47.166 16:45:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:47.166 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:47.166 16:45:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:47.166 16:45:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:47.166 16:45:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:47.166 16:45:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:47.166 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:47.166 16:45:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:47.166 16:45:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:47.166 16:45:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:47.166 16:45:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:47.166 16:45:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:47.166 16:45:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:47.166 16:45:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:47.166 16:45:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:47.166 16:45:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:47.166 16:45:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:47.166 16:45:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:47.166 16:45:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:47.166 16:45:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:47.166 16:45:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:47.166 16:45:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:47.166 16:45:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:47.166 16:45:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:47.166 16:45:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:47.166 16:45:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:47.166 16:45:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:47.166 16:45:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:47.166 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:47.166 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.415 ms 00:20:47.166 00:20:47.166 --- 10.0.0.2 ping statistics --- 00:20:47.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:47.166 rtt min/avg/max/mdev = 0.415/0.415/0.415/0.000 ms 00:20:47.166 16:45:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:47.166 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:47.166 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:20:47.166 00:20:47.166 --- 10.0.0.1 ping statistics --- 00:20:47.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:47.166 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:20:47.166 16:45:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:47.166 16:45:12 -- nvmf/common.sh@410 -- # return 0 00:20:47.166 16:45:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:47.166 16:45:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:47.166 16:45:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:47.166 16:45:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:47.166 16:45:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:47.166 16:45:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:47.166 16:45:12 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:47.166 16:45:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:47.166 16:45:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:47.166 16:45:12 -- common/autotest_common.sh@10 -- # set +x 00:20:47.166 16:45:12 -- nvmf/common.sh@469 -- # nvmfpid=1225303 00:20:47.166 16:45:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:47.166 16:45:12 -- nvmf/common.sh@470 -- # waitforlisten 1225303 00:20:47.166 16:45:12 -- common/autotest_common.sh@819 -- # '[' -z 1225303 ']' 00:20:47.166 16:45:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:47.166 16:45:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:47.166 16:45:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:47.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:47.166 16:45:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:47.166 16:45:12 -- common/autotest_common.sh@10 -- # set +x 00:20:47.166 [2024-10-13 16:45:12.518370] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:20:47.166 [2024-10-13 16:45:12.518455] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:47.166 EAL: No free 2048 kB hugepages reported on node 1 00:20:47.166 [2024-10-13 16:45:12.585498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:47.425 [2024-10-13 16:45:12.675703] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:47.425 [2024-10-13 16:45:12.675840] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:47.425 [2024-10-13 16:45:12.675857] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:47.425 [2024-10-13 16:45:12.675870] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:47.425 [2024-10-13 16:45:12.675898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:47.425 16:45:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:47.425 16:45:12 -- common/autotest_common.sh@852 -- # return 0 00:20:47.425 16:45:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:47.425 16:45:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:47.425 16:45:12 -- common/autotest_common.sh@10 -- # set +x 00:20:47.425 16:45:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:47.425 16:45:12 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:47.425 16:45:12 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:47.682 true 00:20:47.682 16:45:13 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:47.682 16:45:13 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:47.940 16:45:13 -- target/tls.sh@82 -- # version=0 00:20:47.940 16:45:13 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:47.940 16:45:13 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:48.197 16:45:13 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:48.197 16:45:13 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:48.455 16:45:13 -- target/tls.sh@90 -- # version=13 00:20:48.455 16:45:13 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:48.455 16:45:13 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:48.713 16:45:14 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:48.713 16:45:14 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:48.971 16:45:14 -- target/tls.sh@98 -- # version=7 00:20:48.971 16:45:14 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:48.971 16:45:14 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:48.971 16:45:14 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:49.229 16:45:14 -- target/tls.sh@105 -- # ktls=false 00:20:49.229 16:45:14 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:49.229 16:45:14 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:49.487 16:45:14 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:49.487 16:45:14 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:49.744 16:45:15 -- target/tls.sh@113 -- # ktls=true 00:20:49.744 16:45:15 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:49.744 16:45:15 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:50.002 16:45:15 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:50.002 16:45:15 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:50.260 16:45:15 -- target/tls.sh@121 -- # ktls=false 00:20:50.260 16:45:15 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:50.260 16:45:15 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:50.260 16:45:15 -- target/tls.sh@49 -- # local key hash crc 00:20:50.260 16:45:15 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:50.260 16:45:15 -- target/tls.sh@51 -- # hash=01 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # gzip -1 -c 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # tail -c8 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # head -c 4 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # crc='p$H�' 00:20:50.260 16:45:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:50.260 16:45:15 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:50.260 16:45:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:50.260 16:45:15 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:50.260 16:45:15 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:50.260 16:45:15 -- target/tls.sh@49 -- # local key hash crc 00:20:50.260 16:45:15 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:50.260 16:45:15 -- target/tls.sh@51 -- # hash=01 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # gzip -1 -c 00:20:50.260 16:45:15 -- target/tls.sh@52 -- # tail -c8 00:20:50.261 16:45:15 -- target/tls.sh@52 -- # head -c 4 00:20:50.261 16:45:15 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:50.261 16:45:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:50.261 16:45:15 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:50.261 16:45:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:50.261 16:45:15 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:50.261 16:45:15 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:50.261 16:45:15 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:50.261 16:45:15 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:50.261 16:45:15 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:50.261 16:45:15 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:50.261 16:45:15 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:50.261 16:45:15 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:50.519 16:45:15 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:51.085 16:45:16 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:51.085 16:45:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:51.085 16:45:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:51.085 [2024-10-13 16:45:16.584934] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:51.343 16:45:16 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:51.601 16:45:16 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:51.859 [2024-10-13 16:45:17.182594] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:51.859 [2024-10-13 16:45:17.182845] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:51.859 16:45:17 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:52.117 malloc0 00:20:52.117 16:45:17 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:52.374 16:45:17 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.637 16:45:18 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:52.637 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.835 Initializing NVMe Controllers 00:21:04.835 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:04.835 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:04.835 Initialization complete. Launching workers. 00:21:04.835 ======================================================== 00:21:04.835 Latency(us) 00:21:04.835 Device Information : IOPS MiB/s Average min max 00:21:04.835 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7709.69 30.12 8303.86 1247.66 9422.60 00:21:04.835 ======================================================== 00:21:04.835 Total : 7709.69 30.12 8303.86 1247.66 9422.60 00:21:04.835 00:21:04.835 16:45:28 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:04.835 16:45:28 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:04.835 16:45:28 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:04.835 16:45:28 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:04.835 16:45:28 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:04.835 16:45:28 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:04.835 16:45:28 -- target/tls.sh@28 -- # bdevperf_pid=1227261 00:21:04.835 16:45:28 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:04.835 16:45:28 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:04.835 16:45:28 -- target/tls.sh@31 -- # waitforlisten 1227261 /var/tmp/bdevperf.sock 00:21:04.835 16:45:28 -- common/autotest_common.sh@819 -- # '[' -z 1227261 ']' 00:21:04.835 16:45:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:04.835 16:45:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:04.835 16:45:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:04.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:04.835 16:45:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:04.835 16:45:28 -- common/autotest_common.sh@10 -- # set +x 00:21:04.835 [2024-10-13 16:45:28.231245] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:04.835 [2024-10-13 16:45:28.231327] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1227261 ] 00:21:04.835 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.835 [2024-10-13 16:45:28.289461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.835 [2024-10-13 16:45:28.370850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:04.835 16:45:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:04.835 16:45:29 -- common/autotest_common.sh@852 -- # return 0 00:21:04.835 16:45:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:04.835 [2024-10-13 16:45:29.401994] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:04.835 TLSTESTn1 00:21:04.835 16:45:29 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:04.835 Running I/O for 10 seconds... 00:21:14.797 00:21:14.797 Latency(us) 00:21:14.797 [2024-10-13T14:45:40.298Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:14.797 [2024-10-13T14:45:40.298Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:14.797 Verification LBA range: start 0x0 length 0x2000 00:21:14.797 TLSTESTn1 : 10.02 4631.47 18.09 0.00 0.00 27598.55 4684.61 41748.86 00:21:14.797 [2024-10-13T14:45:40.298Z] =================================================================================================================== 00:21:14.797 [2024-10-13T14:45:40.298Z] Total : 4631.47 18.09 0.00 0.00 27598.55 4684.61 41748.86 00:21:14.797 0 00:21:14.797 16:45:39 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:14.797 16:45:39 -- target/tls.sh@45 -- # killprocess 1227261 00:21:14.797 16:45:39 -- common/autotest_common.sh@926 -- # '[' -z 1227261 ']' 00:21:14.797 16:45:39 -- common/autotest_common.sh@930 -- # kill -0 1227261 00:21:14.797 16:45:39 -- common/autotest_common.sh@931 -- # uname 00:21:14.797 16:45:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:14.797 16:45:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1227261 00:21:14.797 16:45:39 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:14.797 16:45:39 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:14.797 16:45:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1227261' 00:21:14.797 killing process with pid 1227261 00:21:14.797 16:45:39 -- common/autotest_common.sh@945 -- # kill 1227261 00:21:14.797 Received shutdown signal, test time was about 10.000000 seconds 00:21:14.797 00:21:14.797 Latency(us) 00:21:14.797 [2024-10-13T14:45:40.298Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:14.797 [2024-10-13T14:45:40.298Z] =================================================================================================================== 00:21:14.797 [2024-10-13T14:45:40.298Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:14.797 16:45:39 -- common/autotest_common.sh@950 -- # wait 1227261 00:21:14.797 16:45:39 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:14.797 16:45:39 -- common/autotest_common.sh@640 -- # local es=0 00:21:14.797 16:45:39 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:14.797 16:45:39 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:21:14.797 16:45:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:14.797 16:45:39 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:21:14.797 16:45:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:14.797 16:45:39 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:14.797 16:45:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:14.797 16:45:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:14.797 16:45:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:14.797 16:45:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:21:14.797 16:45:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:14.797 16:45:39 -- target/tls.sh@28 -- # bdevperf_pid=1228744 00:21:14.797 16:45:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:14.797 16:45:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:14.798 16:45:39 -- target/tls.sh@31 -- # waitforlisten 1228744 /var/tmp/bdevperf.sock 00:21:14.798 16:45:39 -- common/autotest_common.sh@819 -- # '[' -z 1228744 ']' 00:21:14.798 16:45:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:14.798 16:45:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:14.798 16:45:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:14.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:14.798 16:45:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:14.798 16:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:14.798 [2024-10-13 16:45:39.947023] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:14.798 [2024-10-13 16:45:39.947107] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1228744 ] 00:21:14.798 EAL: No free 2048 kB hugepages reported on node 1 00:21:14.798 [2024-10-13 16:45:40.004650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:14.798 [2024-10-13 16:45:40.093556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:15.730 16:45:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:15.730 16:45:40 -- common/autotest_common.sh@852 -- # return 0 00:21:15.730 16:45:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:15.730 [2024-10-13 16:45:41.216300] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:15.730 [2024-10-13 16:45:41.228486] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:15.730 [2024-10-13 16:45:41.229315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf12840 (107): Transport endpoint is not connected 00:21:15.730 [2024-10-13 16:45:41.230301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf12840 (9): Bad file descriptor 00:21:15.730 [2024-10-13 16:45:41.231300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.730 [2024-10-13 16:45:41.231326] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:15.730 [2024-10-13 16:45:41.231348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.988 request: 00:21:15.988 { 00:21:15.988 "name": "TLSTEST", 00:21:15.988 "trtype": "tcp", 00:21:15.988 "traddr": "10.0.0.2", 00:21:15.988 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:15.988 "adrfam": "ipv4", 00:21:15.988 "trsvcid": "4420", 00:21:15.988 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:15.988 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:21:15.988 "method": "bdev_nvme_attach_controller", 00:21:15.988 "req_id": 1 00:21:15.988 } 00:21:15.988 Got JSON-RPC error response 00:21:15.988 response: 00:21:15.988 { 00:21:15.988 "code": -32602, 00:21:15.988 "message": "Invalid parameters" 00:21:15.988 } 00:21:15.988 16:45:41 -- target/tls.sh@36 -- # killprocess 1228744 00:21:15.988 16:45:41 -- common/autotest_common.sh@926 -- # '[' -z 1228744 ']' 00:21:15.988 16:45:41 -- common/autotest_common.sh@930 -- # kill -0 1228744 00:21:15.988 16:45:41 -- common/autotest_common.sh@931 -- # uname 00:21:15.988 16:45:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:15.988 16:45:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1228744 00:21:15.988 16:45:41 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:15.988 16:45:41 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:15.988 16:45:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1228744' 00:21:15.988 killing process with pid 1228744 00:21:15.988 16:45:41 -- common/autotest_common.sh@945 -- # kill 1228744 00:21:15.988 Received shutdown signal, test time was about 10.000000 seconds 00:21:15.988 00:21:15.988 Latency(us) 00:21:15.988 [2024-10-13T14:45:41.489Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:15.988 [2024-10-13T14:45:41.489Z] =================================================================================================================== 00:21:15.988 [2024-10-13T14:45:41.489Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:15.988 16:45:41 -- common/autotest_common.sh@950 -- # wait 1228744 00:21:16.246 16:45:41 -- target/tls.sh@37 -- # return 1 00:21:16.246 16:45:41 -- common/autotest_common.sh@643 -- # es=1 00:21:16.246 16:45:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:16.246 16:45:41 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:16.246 16:45:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:16.246 16:45:41 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:16.246 16:45:41 -- common/autotest_common.sh@640 -- # local es=0 00:21:16.246 16:45:41 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:16.246 16:45:41 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:21:16.246 16:45:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:16.246 16:45:41 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:21:16.246 16:45:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:16.246 16:45:41 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:16.246 16:45:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:16.246 16:45:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:16.246 16:45:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:21:16.246 16:45:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:16.246 16:45:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:16.246 16:45:41 -- target/tls.sh@28 -- # bdevperf_pid=1228905 00:21:16.246 16:45:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:16.246 16:45:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:16.246 16:45:41 -- target/tls.sh@31 -- # waitforlisten 1228905 /var/tmp/bdevperf.sock 00:21:16.246 16:45:41 -- common/autotest_common.sh@819 -- # '[' -z 1228905 ']' 00:21:16.246 16:45:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:16.246 16:45:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:16.246 16:45:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:16.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:16.246 16:45:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:16.246 16:45:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.246 [2024-10-13 16:45:41.558138] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:16.246 [2024-10-13 16:45:41.558223] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1228905 ] 00:21:16.246 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.246 [2024-10-13 16:45:41.623625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:16.246 [2024-10-13 16:45:41.717150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:17.179 16:45:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:17.179 16:45:42 -- common/autotest_common.sh@852 -- # return 0 00:21:17.179 16:45:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:17.437 [2024-10-13 16:45:42.763837] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:17.437 [2024-10-13 16:45:42.772296] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:21:17.437 [2024-10-13 16:45:42.772327] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:21:17.437 [2024-10-13 16:45:42.772364] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:17.437 [2024-10-13 16:45:42.772724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16c1840 (107): Transport endpoint is not connected 00:21:17.437 [2024-10-13 16:45:42.773710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16c1840 (9): Bad file descriptor 00:21:17.437 [2024-10-13 16:45:42.774709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:17.437 [2024-10-13 16:45:42.774732] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:17.437 [2024-10-13 16:45:42.774766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:17.437 request: 00:21:17.437 { 00:21:17.437 "name": "TLSTEST", 00:21:17.437 "trtype": "tcp", 00:21:17.437 "traddr": "10.0.0.2", 00:21:17.437 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:17.437 "adrfam": "ipv4", 00:21:17.437 "trsvcid": "4420", 00:21:17.437 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:17.437 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:21:17.437 "method": "bdev_nvme_attach_controller", 00:21:17.437 "req_id": 1 00:21:17.437 } 00:21:17.437 Got JSON-RPC error response 00:21:17.437 response: 00:21:17.437 { 00:21:17.437 "code": -32602, 00:21:17.438 "message": "Invalid parameters" 00:21:17.438 } 00:21:17.438 16:45:42 -- target/tls.sh@36 -- # killprocess 1228905 00:21:17.438 16:45:42 -- common/autotest_common.sh@926 -- # '[' -z 1228905 ']' 00:21:17.438 16:45:42 -- common/autotest_common.sh@930 -- # kill -0 1228905 00:21:17.438 16:45:42 -- common/autotest_common.sh@931 -- # uname 00:21:17.438 16:45:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:17.438 16:45:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1228905 00:21:17.438 16:45:42 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:17.438 16:45:42 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:17.438 16:45:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1228905' 00:21:17.438 killing process with pid 1228905 00:21:17.438 16:45:42 -- common/autotest_common.sh@945 -- # kill 1228905 00:21:17.438 Received shutdown signal, test time was about 10.000000 seconds 00:21:17.438 00:21:17.438 Latency(us) 00:21:17.438 [2024-10-13T14:45:42.939Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.438 [2024-10-13T14:45:42.939Z] =================================================================================================================== 00:21:17.438 [2024-10-13T14:45:42.939Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:17.438 16:45:42 -- common/autotest_common.sh@950 -- # wait 1228905 00:21:17.696 16:45:43 -- target/tls.sh@37 -- # return 1 00:21:17.696 16:45:43 -- common/autotest_common.sh@643 -- # es=1 00:21:17.696 16:45:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:17.696 16:45:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:17.696 16:45:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:17.696 16:45:43 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:17.696 16:45:43 -- common/autotest_common.sh@640 -- # local es=0 00:21:17.696 16:45:43 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:17.696 16:45:43 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:21:17.696 16:45:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:17.696 16:45:43 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:21:17.696 16:45:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:17.696 16:45:43 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:17.696 16:45:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:17.696 16:45:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:21:17.696 16:45:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:17.696 16:45:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:17.696 16:45:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:17.696 16:45:43 -- target/tls.sh@28 -- # bdevperf_pid=1229053 00:21:17.696 16:45:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:17.696 16:45:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:17.696 16:45:43 -- target/tls.sh@31 -- # waitforlisten 1229053 /var/tmp/bdevperf.sock 00:21:17.696 16:45:43 -- common/autotest_common.sh@819 -- # '[' -z 1229053 ']' 00:21:17.696 16:45:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:17.696 16:45:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:17.696 16:45:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:17.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:17.696 16:45:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:17.696 16:45:43 -- common/autotest_common.sh@10 -- # set +x 00:21:17.696 [2024-10-13 16:45:43.053714] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:17.696 [2024-10-13 16:45:43.053801] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1229053 ] 00:21:17.696 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.696 [2024-10-13 16:45:43.113049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.954 [2024-10-13 16:45:43.197149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:18.886 16:45:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:18.886 16:45:44 -- common/autotest_common.sh@852 -- # return 0 00:21:18.887 16:45:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:18.887 [2024-10-13 16:45:44.362369] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:18.887 [2024-10-13 16:45:44.367752] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:21:18.887 [2024-10-13 16:45:44.367785] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:21:18.887 [2024-10-13 16:45:44.367823] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:18.887 [2024-10-13 16:45:44.368368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2301840 (107): Transport endpoint is not connected 00:21:18.887 [2024-10-13 16:45:44.369354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2301840 (9): Bad file descriptor 00:21:18.887 [2024-10-13 16:45:44.370352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:21:18.887 [2024-10-13 16:45:44.370375] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:18.887 [2024-10-13 16:45:44.370429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:21:18.887 request: 00:21:18.887 { 00:21:18.887 "name": "TLSTEST", 00:21:18.887 "trtype": "tcp", 00:21:18.887 "traddr": "10.0.0.2", 00:21:18.887 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:18.887 "adrfam": "ipv4", 00:21:18.887 "trsvcid": "4420", 00:21:18.887 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:18.887 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:21:18.887 "method": "bdev_nvme_attach_controller", 00:21:18.887 "req_id": 1 00:21:18.887 } 00:21:18.887 Got JSON-RPC error response 00:21:18.887 response: 00:21:18.887 { 00:21:18.887 "code": -32602, 00:21:18.887 "message": "Invalid parameters" 00:21:18.887 } 00:21:19.145 16:45:44 -- target/tls.sh@36 -- # killprocess 1229053 00:21:19.145 16:45:44 -- common/autotest_common.sh@926 -- # '[' -z 1229053 ']' 00:21:19.145 16:45:44 -- common/autotest_common.sh@930 -- # kill -0 1229053 00:21:19.145 16:45:44 -- common/autotest_common.sh@931 -- # uname 00:21:19.145 16:45:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:19.145 16:45:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1229053 00:21:19.145 16:45:44 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:19.145 16:45:44 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:19.145 16:45:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1229053' 00:21:19.145 killing process with pid 1229053 00:21:19.145 16:45:44 -- common/autotest_common.sh@945 -- # kill 1229053 00:21:19.145 Received shutdown signal, test time was about 10.000000 seconds 00:21:19.145 00:21:19.145 Latency(us) 00:21:19.145 [2024-10-13T14:45:44.646Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:19.145 [2024-10-13T14:45:44.646Z] =================================================================================================================== 00:21:19.145 [2024-10-13T14:45:44.646Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:19.145 16:45:44 -- common/autotest_common.sh@950 -- # wait 1229053 00:21:19.145 16:45:44 -- target/tls.sh@37 -- # return 1 00:21:19.145 16:45:44 -- common/autotest_common.sh@643 -- # es=1 00:21:19.145 16:45:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:19.145 16:45:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:19.145 16:45:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:19.145 16:45:44 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:19.145 16:45:44 -- common/autotest_common.sh@640 -- # local es=0 00:21:19.145 16:45:44 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:19.145 16:45:44 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:21:19.145 16:45:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:19.145 16:45:44 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:21:19.145 16:45:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:19.145 16:45:44 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:19.145 16:45:44 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:19.145 16:45:44 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:19.145 16:45:44 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:19.145 16:45:44 -- target/tls.sh@23 -- # psk= 00:21:19.145 16:45:44 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:19.145 16:45:44 -- target/tls.sh@28 -- # bdevperf_pid=1229328 00:21:19.145 16:45:44 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:19.145 16:45:44 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:19.145 16:45:44 -- target/tls.sh@31 -- # waitforlisten 1229328 /var/tmp/bdevperf.sock 00:21:19.145 16:45:44 -- common/autotest_common.sh@819 -- # '[' -z 1229328 ']' 00:21:19.145 16:45:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:19.145 16:45:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:19.145 16:45:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:19.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:19.145 16:45:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:19.145 16:45:44 -- common/autotest_common.sh@10 -- # set +x 00:21:19.403 [2024-10-13 16:45:44.664057] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:19.403 [2024-10-13 16:45:44.664142] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1229328 ] 00:21:19.403 EAL: No free 2048 kB hugepages reported on node 1 00:21:19.403 [2024-10-13 16:45:44.721110] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:19.403 [2024-10-13 16:45:44.802526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:20.336 16:45:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:20.336 16:45:45 -- common/autotest_common.sh@852 -- # return 0 00:21:20.336 16:45:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:21:20.624 [2024-10-13 16:45:45.900508] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:20.624 [2024-10-13 16:45:45.902581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5fdd0 (9): Bad file descriptor 00:21:20.624 [2024-10-13 16:45:45.903578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:20.624 [2024-10-13 16:45:45.903605] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:20.624 [2024-10-13 16:45:45.903628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:20.624 request: 00:21:20.624 { 00:21:20.624 "name": "TLSTEST", 00:21:20.624 "trtype": "tcp", 00:21:20.624 "traddr": "10.0.0.2", 00:21:20.624 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:20.624 "adrfam": "ipv4", 00:21:20.624 "trsvcid": "4420", 00:21:20.624 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:20.624 "method": "bdev_nvme_attach_controller", 00:21:20.624 "req_id": 1 00:21:20.624 } 00:21:20.624 Got JSON-RPC error response 00:21:20.624 response: 00:21:20.624 { 00:21:20.624 "code": -32602, 00:21:20.624 "message": "Invalid parameters" 00:21:20.624 } 00:21:20.624 16:45:45 -- target/tls.sh@36 -- # killprocess 1229328 00:21:20.624 16:45:45 -- common/autotest_common.sh@926 -- # '[' -z 1229328 ']' 00:21:20.624 16:45:45 -- common/autotest_common.sh@930 -- # kill -0 1229328 00:21:20.624 16:45:45 -- common/autotest_common.sh@931 -- # uname 00:21:20.624 16:45:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:20.624 16:45:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1229328 00:21:20.624 16:45:45 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:20.624 16:45:45 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:20.624 16:45:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1229328' 00:21:20.624 killing process with pid 1229328 00:21:20.624 16:45:45 -- common/autotest_common.sh@945 -- # kill 1229328 00:21:20.624 Received shutdown signal, test time was about 10.000000 seconds 00:21:20.624 00:21:20.624 Latency(us) 00:21:20.624 [2024-10-13T14:45:46.125Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:20.624 [2024-10-13T14:45:46.125Z] =================================================================================================================== 00:21:20.624 [2024-10-13T14:45:46.125Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:20.624 16:45:45 -- common/autotest_common.sh@950 -- # wait 1229328 00:21:20.899 16:45:46 -- target/tls.sh@37 -- # return 1 00:21:20.899 16:45:46 -- common/autotest_common.sh@643 -- # es=1 00:21:20.899 16:45:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:20.899 16:45:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:20.899 16:45:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:20.899 16:45:46 -- target/tls.sh@167 -- # killprocess 1225303 00:21:20.899 16:45:46 -- common/autotest_common.sh@926 -- # '[' -z 1225303 ']' 00:21:20.899 16:45:46 -- common/autotest_common.sh@930 -- # kill -0 1225303 00:21:20.899 16:45:46 -- common/autotest_common.sh@931 -- # uname 00:21:20.899 16:45:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:20.899 16:45:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1225303 00:21:20.899 16:45:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:20.899 16:45:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:20.899 16:45:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1225303' 00:21:20.900 killing process with pid 1225303 00:21:20.900 16:45:46 -- common/autotest_common.sh@945 -- # kill 1225303 00:21:20.900 16:45:46 -- common/autotest_common.sh@950 -- # wait 1225303 00:21:21.157 16:45:46 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:21:21.157 16:45:46 -- target/tls.sh@49 -- # local key hash crc 00:21:21.157 16:45:46 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:21:21.157 16:45:46 -- target/tls.sh@51 -- # hash=02 00:21:21.157 16:45:46 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:21:21.157 16:45:46 -- target/tls.sh@52 -- # gzip -1 -c 00:21:21.157 16:45:46 -- target/tls.sh@52 -- # tail -c8 00:21:21.157 16:45:46 -- target/tls.sh@52 -- # head -c 4 00:21:21.157 16:45:46 -- target/tls.sh@52 -- # crc='�e�'\''' 00:21:21.157 16:45:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:21:21.157 16:45:46 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:21:21.157 16:45:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:21.157 16:45:46 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:21.157 16:45:46 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:21.157 16:45:46 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:21.157 16:45:46 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:21.157 16:45:46 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:21:21.157 16:45:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:21.157 16:45:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:21.157 16:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:21.157 16:45:46 -- nvmf/common.sh@469 -- # nvmfpid=1229503 00:21:21.157 16:45:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:21.157 16:45:46 -- nvmf/common.sh@470 -- # waitforlisten 1229503 00:21:21.157 16:45:46 -- common/autotest_common.sh@819 -- # '[' -z 1229503 ']' 00:21:21.157 16:45:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:21.157 16:45:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:21.157 16:45:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:21.157 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:21.157 16:45:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:21.157 16:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:21.157 [2024-10-13 16:45:46.528298] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:21.157 [2024-10-13 16:45:46.528374] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:21.157 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.157 [2024-10-13 16:45:46.596026] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:21.415 [2024-10-13 16:45:46.688085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:21.415 [2024-10-13 16:45:46.688249] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:21.415 [2024-10-13 16:45:46.688269] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:21.415 [2024-10-13 16:45:46.688283] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:21.415 [2024-10-13 16:45:46.688322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:22.348 16:45:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:22.348 16:45:47 -- common/autotest_common.sh@852 -- # return 0 00:21:22.348 16:45:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:22.348 16:45:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:22.348 16:45:47 -- common/autotest_common.sh@10 -- # set +x 00:21:22.348 16:45:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:22.348 16:45:47 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:22.348 16:45:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:22.348 16:45:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:22.348 [2024-10-13 16:45:47.784521] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:22.348 16:45:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:22.609 16:45:48 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:22.865 [2024-10-13 16:45:48.281844] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:22.865 [2024-10-13 16:45:48.282115] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:22.865 16:45:48 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:23.122 malloc0 00:21:23.122 16:45:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:23.380 16:45:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:23.962 16:45:49 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:23.962 16:45:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:23.962 16:45:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:23.962 16:45:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:23.962 16:45:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:23.962 16:45:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:23.962 16:45:49 -- target/tls.sh@28 -- # bdevperf_pid=1229919 00:21:23.962 16:45:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:23.962 16:45:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:23.962 16:45:49 -- target/tls.sh@31 -- # waitforlisten 1229919 /var/tmp/bdevperf.sock 00:21:23.962 16:45:49 -- common/autotest_common.sh@819 -- # '[' -z 1229919 ']' 00:21:23.962 16:45:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:23.962 16:45:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:23.962 16:45:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:23.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:23.962 16:45:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:23.962 16:45:49 -- common/autotest_common.sh@10 -- # set +x 00:21:23.962 [2024-10-13 16:45:49.197631] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:23.962 [2024-10-13 16:45:49.197734] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1229919 ] 00:21:23.962 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.962 [2024-10-13 16:45:49.256492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:23.962 [2024-10-13 16:45:49.347730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.895 16:45:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:24.895 16:45:50 -- common/autotest_common.sh@852 -- # return 0 00:21:24.895 16:45:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:25.153 [2024-10-13 16:45:50.441505] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:25.153 TLSTESTn1 00:21:25.153 16:45:50 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:25.153 Running I/O for 10 seconds... 00:21:37.344 00:21:37.344 Latency(us) 00:21:37.344 [2024-10-13T14:46:02.845Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:37.344 [2024-10-13T14:46:02.845Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:37.344 Verification LBA range: start 0x0 length 0x2000 00:21:37.344 TLSTESTn1 : 10.02 4595.45 17.95 0.00 0.00 27813.28 4563.25 44855.75 00:21:37.344 [2024-10-13T14:46:02.845Z] =================================================================================================================== 00:21:37.344 [2024-10-13T14:46:02.845Z] Total : 4595.45 17.95 0.00 0.00 27813.28 4563.25 44855.75 00:21:37.344 0 00:21:37.344 16:46:00 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:37.344 16:46:00 -- target/tls.sh@45 -- # killprocess 1229919 00:21:37.344 16:46:00 -- common/autotest_common.sh@926 -- # '[' -z 1229919 ']' 00:21:37.344 16:46:00 -- common/autotest_common.sh@930 -- # kill -0 1229919 00:21:37.344 16:46:00 -- common/autotest_common.sh@931 -- # uname 00:21:37.344 16:46:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:37.344 16:46:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1229919 00:21:37.344 16:46:00 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:37.344 16:46:00 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:37.344 16:46:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1229919' 00:21:37.344 killing process with pid 1229919 00:21:37.344 16:46:00 -- common/autotest_common.sh@945 -- # kill 1229919 00:21:37.344 Received shutdown signal, test time was about 10.000000 seconds 00:21:37.344 00:21:37.344 Latency(us) 00:21:37.344 [2024-10-13T14:46:02.845Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:37.344 [2024-10-13T14:46:02.845Z] =================================================================================================================== 00:21:37.344 [2024-10-13T14:46:02.845Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:37.344 16:46:00 -- common/autotest_common.sh@950 -- # wait 1229919 00:21:37.344 16:46:00 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:37.344 16:46:00 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:37.344 16:46:00 -- common/autotest_common.sh@640 -- # local es=0 00:21:37.344 16:46:00 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:37.344 16:46:00 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:21:37.344 16:46:00 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:37.344 16:46:00 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:21:37.344 16:46:00 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:37.344 16:46:00 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:37.344 16:46:00 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:37.344 16:46:00 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:37.344 16:46:00 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:37.344 16:46:00 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:37.344 16:46:00 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:37.344 16:46:00 -- target/tls.sh@28 -- # bdevperf_pid=1231294 00:21:37.344 16:46:00 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:37.344 16:46:00 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:37.344 16:46:00 -- target/tls.sh@31 -- # waitforlisten 1231294 /var/tmp/bdevperf.sock 00:21:37.344 16:46:00 -- common/autotest_common.sh@819 -- # '[' -z 1231294 ']' 00:21:37.344 16:46:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:37.344 16:46:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:37.344 16:46:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:37.344 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:37.344 16:46:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:37.344 16:46:00 -- common/autotest_common.sh@10 -- # set +x 00:21:37.344 [2024-10-13 16:46:00.978879] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:37.344 [2024-10-13 16:46:00.978954] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1231294 ] 00:21:37.344 EAL: No free 2048 kB hugepages reported on node 1 00:21:37.344 [2024-10-13 16:46:01.036208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:37.344 [2024-10-13 16:46:01.125838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:37.344 16:46:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:37.344 16:46:01 -- common/autotest_common.sh@852 -- # return 0 00:21:37.344 16:46:01 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:37.344 [2024-10-13 16:46:02.199621] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:37.344 [2024-10-13 16:46:02.199696] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:37.344 request: 00:21:37.344 { 00:21:37.344 "name": "TLSTEST", 00:21:37.344 "trtype": "tcp", 00:21:37.344 "traddr": "10.0.0.2", 00:21:37.344 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:37.344 "adrfam": "ipv4", 00:21:37.344 "trsvcid": "4420", 00:21:37.344 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:37.344 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:37.344 "method": "bdev_nvme_attach_controller", 00:21:37.344 "req_id": 1 00:21:37.344 } 00:21:37.344 Got JSON-RPC error response 00:21:37.344 response: 00:21:37.344 { 00:21:37.344 "code": -22, 00:21:37.344 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:37.344 } 00:21:37.344 16:46:02 -- target/tls.sh@36 -- # killprocess 1231294 00:21:37.344 16:46:02 -- common/autotest_common.sh@926 -- # '[' -z 1231294 ']' 00:21:37.344 16:46:02 -- common/autotest_common.sh@930 -- # kill -0 1231294 00:21:37.345 16:46:02 -- common/autotest_common.sh@931 -- # uname 00:21:37.345 16:46:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1231294 00:21:37.345 16:46:02 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:37.345 16:46:02 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1231294' 00:21:37.345 killing process with pid 1231294 00:21:37.345 16:46:02 -- common/autotest_common.sh@945 -- # kill 1231294 00:21:37.345 Received shutdown signal, test time was about 10.000000 seconds 00:21:37.345 00:21:37.345 Latency(us) 00:21:37.345 [2024-10-13T14:46:02.846Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:37.345 [2024-10-13T14:46:02.846Z] =================================================================================================================== 00:21:37.345 [2024-10-13T14:46:02.846Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:37.345 16:46:02 -- common/autotest_common.sh@950 -- # wait 1231294 00:21:37.345 16:46:02 -- target/tls.sh@37 -- # return 1 00:21:37.345 16:46:02 -- common/autotest_common.sh@643 -- # es=1 00:21:37.345 16:46:02 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:37.345 16:46:02 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:37.345 16:46:02 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:37.345 16:46:02 -- target/tls.sh@183 -- # killprocess 1229503 00:21:37.345 16:46:02 -- common/autotest_common.sh@926 -- # '[' -z 1229503 ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@930 -- # kill -0 1229503 00:21:37.345 16:46:02 -- common/autotest_common.sh@931 -- # uname 00:21:37.345 16:46:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1229503 00:21:37.345 16:46:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:37.345 16:46:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1229503' 00:21:37.345 killing process with pid 1229503 00:21:37.345 16:46:02 -- common/autotest_common.sh@945 -- # kill 1229503 00:21:37.345 16:46:02 -- common/autotest_common.sh@950 -- # wait 1229503 00:21:37.345 16:46:02 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:37.345 16:46:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:37.345 16:46:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:37.345 16:46:02 -- common/autotest_common.sh@10 -- # set +x 00:21:37.345 16:46:02 -- nvmf/common.sh@469 -- # nvmfpid=1231572 00:21:37.345 16:46:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:37.345 16:46:02 -- nvmf/common.sh@470 -- # waitforlisten 1231572 00:21:37.345 16:46:02 -- common/autotest_common.sh@819 -- # '[' -z 1231572 ']' 00:21:37.345 16:46:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:37.345 16:46:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:37.345 16:46:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:37.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:37.345 16:46:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:37.345 16:46:02 -- common/autotest_common.sh@10 -- # set +x 00:21:37.345 [2024-10-13 16:46:02.821158] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:37.345 [2024-10-13 16:46:02.821245] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:37.603 EAL: No free 2048 kB hugepages reported on node 1 00:21:37.603 [2024-10-13 16:46:02.887998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:37.603 [2024-10-13 16:46:02.980521] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:37.603 [2024-10-13 16:46:02.980669] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:37.603 [2024-10-13 16:46:02.980704] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:37.603 [2024-10-13 16:46:02.980719] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:37.603 [2024-10-13 16:46:02.980749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:38.536 16:46:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:38.536 16:46:03 -- common/autotest_common.sh@852 -- # return 0 00:21:38.536 16:46:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:38.537 16:46:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:38.537 16:46:03 -- common/autotest_common.sh@10 -- # set +x 00:21:38.537 16:46:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:38.537 16:46:03 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:38.537 16:46:03 -- common/autotest_common.sh@640 -- # local es=0 00:21:38.537 16:46:03 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:38.537 16:46:03 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:21:38.537 16:46:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:38.537 16:46:03 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:21:38.537 16:46:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:38.537 16:46:03 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:38.537 16:46:03 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:38.537 16:46:03 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:38.537 [2024-10-13 16:46:04.037077] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:38.795 16:46:04 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:39.053 16:46:04 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:39.311 [2024-10-13 16:46:04.574543] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:39.311 [2024-10-13 16:46:04.574808] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:39.311 16:46:04 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:39.570 malloc0 00:21:39.570 16:46:04 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:39.880 16:46:05 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:39.880 [2024-10-13 16:46:05.344181] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:39.880 [2024-10-13 16:46:05.344221] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:39.881 [2024-10-13 16:46:05.344247] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:39.881 request: 00:21:39.881 { 00:21:39.881 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:39.881 "host": "nqn.2016-06.io.spdk:host1", 00:21:39.881 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:39.881 "method": "nvmf_subsystem_add_host", 00:21:39.881 "req_id": 1 00:21:39.881 } 00:21:39.881 Got JSON-RPC error response 00:21:39.881 response: 00:21:39.881 { 00:21:39.881 "code": -32603, 00:21:39.881 "message": "Internal error" 00:21:39.881 } 00:21:39.881 16:46:05 -- common/autotest_common.sh@643 -- # es=1 00:21:39.881 16:46:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:39.881 16:46:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:39.881 16:46:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:39.881 16:46:05 -- target/tls.sh@189 -- # killprocess 1231572 00:21:39.881 16:46:05 -- common/autotest_common.sh@926 -- # '[' -z 1231572 ']' 00:21:39.881 16:46:05 -- common/autotest_common.sh@930 -- # kill -0 1231572 00:21:39.881 16:46:05 -- common/autotest_common.sh@931 -- # uname 00:21:39.881 16:46:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:39.881 16:46:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1231572 00:21:40.138 16:46:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:40.138 16:46:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:40.138 16:46:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1231572' 00:21:40.138 killing process with pid 1231572 00:21:40.138 16:46:05 -- common/autotest_common.sh@945 -- # kill 1231572 00:21:40.138 16:46:05 -- common/autotest_common.sh@950 -- # wait 1231572 00:21:40.138 16:46:05 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.138 16:46:05 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:40.138 16:46:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:40.138 16:46:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:40.138 16:46:05 -- common/autotest_common.sh@10 -- # set +x 00:21:40.138 16:46:05 -- nvmf/common.sh@469 -- # nvmfpid=1231888 00:21:40.138 16:46:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:40.138 16:46:05 -- nvmf/common.sh@470 -- # waitforlisten 1231888 00:21:40.138 16:46:05 -- common/autotest_common.sh@819 -- # '[' -z 1231888 ']' 00:21:40.138 16:46:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:40.138 16:46:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:40.138 16:46:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:40.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:40.138 16:46:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:40.138 16:46:05 -- common/autotest_common.sh@10 -- # set +x 00:21:40.396 [2024-10-13 16:46:05.671336] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:40.396 [2024-10-13 16:46:05.671455] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:40.396 EAL: No free 2048 kB hugepages reported on node 1 00:21:40.396 [2024-10-13 16:46:05.731453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:40.396 [2024-10-13 16:46:05.813973] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:40.396 [2024-10-13 16:46:05.814117] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:40.396 [2024-10-13 16:46:05.814144] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:40.396 [2024-10-13 16:46:05.814156] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:40.396 [2024-10-13 16:46:05.814194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:41.329 16:46:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:41.329 16:46:06 -- common/autotest_common.sh@852 -- # return 0 00:21:41.329 16:46:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:41.329 16:46:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:41.329 16:46:06 -- common/autotest_common.sh@10 -- # set +x 00:21:41.329 16:46:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:41.330 16:46:06 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:41.330 16:46:06 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:41.330 16:46:06 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:41.587 [2024-10-13 16:46:06.914923] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:41.587 16:46:06 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:41.845 16:46:07 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:42.102 [2024-10-13 16:46:07.416255] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:42.102 [2024-10-13 16:46:07.416537] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:42.102 16:46:07 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:42.360 malloc0 00:21:42.360 16:46:07 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:42.618 16:46:07 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:42.876 16:46:08 -- target/tls.sh@197 -- # bdevperf_pid=1232303 00:21:42.876 16:46:08 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:42.876 16:46:08 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:42.876 16:46:08 -- target/tls.sh@200 -- # waitforlisten 1232303 /var/tmp/bdevperf.sock 00:21:42.876 16:46:08 -- common/autotest_common.sh@819 -- # '[' -z 1232303 ']' 00:21:42.876 16:46:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:42.876 16:46:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:42.876 16:46:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:42.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:42.876 16:46:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:42.876 16:46:08 -- common/autotest_common.sh@10 -- # set +x 00:21:42.876 [2024-10-13 16:46:08.246359] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:42.876 [2024-10-13 16:46:08.246449] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1232303 ] 00:21:42.876 EAL: No free 2048 kB hugepages reported on node 1 00:21:42.876 [2024-10-13 16:46:08.302300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:43.133 [2024-10-13 16:46:08.384466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:44.066 16:46:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:44.066 16:46:09 -- common/autotest_common.sh@852 -- # return 0 00:21:44.066 16:46:09 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:44.066 [2024-10-13 16:46:09.532362] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:44.324 TLSTESTn1 00:21:44.324 16:46:09 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:44.582 16:46:09 -- target/tls.sh@205 -- # tgtconf='{ 00:21:44.582 "subsystems": [ 00:21:44.582 { 00:21:44.582 "subsystem": "iobuf", 00:21:44.582 "config": [ 00:21:44.582 { 00:21:44.582 "method": "iobuf_set_options", 00:21:44.582 "params": { 00:21:44.582 "small_pool_count": 8192, 00:21:44.582 "large_pool_count": 1024, 00:21:44.582 "small_bufsize": 8192, 00:21:44.582 "large_bufsize": 135168 00:21:44.582 } 00:21:44.582 } 00:21:44.582 ] 00:21:44.582 }, 00:21:44.582 { 00:21:44.582 "subsystem": "sock", 00:21:44.582 "config": [ 00:21:44.582 { 00:21:44.582 "method": "sock_impl_set_options", 00:21:44.582 "params": { 00:21:44.582 "impl_name": "posix", 00:21:44.582 "recv_buf_size": 2097152, 00:21:44.582 "send_buf_size": 2097152, 00:21:44.582 "enable_recv_pipe": true, 00:21:44.582 "enable_quickack": false, 00:21:44.582 "enable_placement_id": 0, 00:21:44.582 "enable_zerocopy_send_server": true, 00:21:44.582 "enable_zerocopy_send_client": false, 00:21:44.582 "zerocopy_threshold": 0, 00:21:44.582 "tls_version": 0, 00:21:44.582 "enable_ktls": false 00:21:44.582 } 00:21:44.582 }, 00:21:44.582 { 00:21:44.582 "method": "sock_impl_set_options", 00:21:44.582 "params": { 00:21:44.582 "impl_name": "ssl", 00:21:44.582 "recv_buf_size": 4096, 00:21:44.582 "send_buf_size": 4096, 00:21:44.582 "enable_recv_pipe": true, 00:21:44.582 "enable_quickack": false, 00:21:44.583 "enable_placement_id": 0, 00:21:44.583 "enable_zerocopy_send_server": true, 00:21:44.583 "enable_zerocopy_send_client": false, 00:21:44.583 "zerocopy_threshold": 0, 00:21:44.583 "tls_version": 0, 00:21:44.583 "enable_ktls": false 00:21:44.583 } 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "vmd", 00:21:44.583 "config": [] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "accel", 00:21:44.583 "config": [ 00:21:44.583 { 00:21:44.583 "method": "accel_set_options", 00:21:44.583 "params": { 00:21:44.583 "small_cache_size": 128, 00:21:44.583 "large_cache_size": 16, 00:21:44.583 "task_count": 2048, 00:21:44.583 "sequence_count": 2048, 00:21:44.583 "buf_count": 2048 00:21:44.583 } 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "bdev", 00:21:44.583 "config": [ 00:21:44.583 { 00:21:44.583 "method": "bdev_set_options", 00:21:44.583 "params": { 00:21:44.583 "bdev_io_pool_size": 65535, 00:21:44.583 "bdev_io_cache_size": 256, 00:21:44.583 "bdev_auto_examine": true, 00:21:44.583 "iobuf_small_cache_size": 128, 00:21:44.583 "iobuf_large_cache_size": 16 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_raid_set_options", 00:21:44.583 "params": { 00:21:44.583 "process_window_size_kb": 1024 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_iscsi_set_options", 00:21:44.583 "params": { 00:21:44.583 "timeout_sec": 30 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_nvme_set_options", 00:21:44.583 "params": { 00:21:44.583 "action_on_timeout": "none", 00:21:44.583 "timeout_us": 0, 00:21:44.583 "timeout_admin_us": 0, 00:21:44.583 "keep_alive_timeout_ms": 10000, 00:21:44.583 "transport_retry_count": 4, 00:21:44.583 "arbitration_burst": 0, 00:21:44.583 "low_priority_weight": 0, 00:21:44.583 "medium_priority_weight": 0, 00:21:44.583 "high_priority_weight": 0, 00:21:44.583 "nvme_adminq_poll_period_us": 10000, 00:21:44.583 "nvme_ioq_poll_period_us": 0, 00:21:44.583 "io_queue_requests": 0, 00:21:44.583 "delay_cmd_submit": true, 00:21:44.583 "bdev_retry_count": 3, 00:21:44.583 "transport_ack_timeout": 0, 00:21:44.583 "ctrlr_loss_timeout_sec": 0, 00:21:44.583 "reconnect_delay_sec": 0, 00:21:44.583 "fast_io_fail_timeout_sec": 0, 00:21:44.583 "generate_uuids": false, 00:21:44.583 "transport_tos": 0, 00:21:44.583 "io_path_stat": false, 00:21:44.583 "allow_accel_sequence": false 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_nvme_set_hotplug", 00:21:44.583 "params": { 00:21:44.583 "period_us": 100000, 00:21:44.583 "enable": false 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_malloc_create", 00:21:44.583 "params": { 00:21:44.583 "name": "malloc0", 00:21:44.583 "num_blocks": 8192, 00:21:44.583 "block_size": 4096, 00:21:44.583 "physical_block_size": 4096, 00:21:44.583 "uuid": "3adeae17-0058-44b4-8b79-032637fdeb1a", 00:21:44.583 "optimal_io_boundary": 0 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "bdev_wait_for_examine" 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "nbd", 00:21:44.583 "config": [] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "scheduler", 00:21:44.583 "config": [ 00:21:44.583 { 00:21:44.583 "method": "framework_set_scheduler", 00:21:44.583 "params": { 00:21:44.583 "name": "static" 00:21:44.583 } 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "subsystem": "nvmf", 00:21:44.583 "config": [ 00:21:44.583 { 00:21:44.583 "method": "nvmf_set_config", 00:21:44.583 "params": { 00:21:44.583 "discovery_filter": "match_any", 00:21:44.583 "admin_cmd_passthru": { 00:21:44.583 "identify_ctrlr": false 00:21:44.583 } 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_set_max_subsystems", 00:21:44.583 "params": { 00:21:44.583 "max_subsystems": 1024 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_set_crdt", 00:21:44.583 "params": { 00:21:44.583 "crdt1": 0, 00:21:44.583 "crdt2": 0, 00:21:44.583 "crdt3": 0 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_create_transport", 00:21:44.583 "params": { 00:21:44.583 "trtype": "TCP", 00:21:44.583 "max_queue_depth": 128, 00:21:44.583 "max_io_qpairs_per_ctrlr": 127, 00:21:44.583 "in_capsule_data_size": 4096, 00:21:44.583 "max_io_size": 131072, 00:21:44.583 "io_unit_size": 131072, 00:21:44.583 "max_aq_depth": 128, 00:21:44.583 "num_shared_buffers": 511, 00:21:44.583 "buf_cache_size": 4294967295, 00:21:44.583 "dif_insert_or_strip": false, 00:21:44.583 "zcopy": false, 00:21:44.583 "c2h_success": false, 00:21:44.583 "sock_priority": 0, 00:21:44.583 "abort_timeout_sec": 1 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_create_subsystem", 00:21:44.583 "params": { 00:21:44.583 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.583 "allow_any_host": false, 00:21:44.583 "serial_number": "SPDK00000000000001", 00:21:44.583 "model_number": "SPDK bdev Controller", 00:21:44.583 "max_namespaces": 10, 00:21:44.583 "min_cntlid": 1, 00:21:44.583 "max_cntlid": 65519, 00:21:44.583 "ana_reporting": false 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_subsystem_add_host", 00:21:44.583 "params": { 00:21:44.583 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.583 "host": "nqn.2016-06.io.spdk:host1", 00:21:44.583 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_subsystem_add_ns", 00:21:44.583 "params": { 00:21:44.583 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.583 "namespace": { 00:21:44.583 "nsid": 1, 00:21:44.583 "bdev_name": "malloc0", 00:21:44.583 "nguid": "3ADEAE17005844B48B79032637FDEB1A", 00:21:44.583 "uuid": "3adeae17-0058-44b4-8b79-032637fdeb1a" 00:21:44.583 } 00:21:44.583 } 00:21:44.583 }, 00:21:44.583 { 00:21:44.583 "method": "nvmf_subsystem_add_listener", 00:21:44.583 "params": { 00:21:44.583 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.583 "listen_address": { 00:21:44.583 "trtype": "TCP", 00:21:44.583 "adrfam": "IPv4", 00:21:44.583 "traddr": "10.0.0.2", 00:21:44.583 "trsvcid": "4420" 00:21:44.583 }, 00:21:44.583 "secure_channel": true 00:21:44.583 } 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 } 00:21:44.583 ] 00:21:44.583 }' 00:21:44.583 16:46:09 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:44.842 16:46:10 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:44.842 "subsystems": [ 00:21:44.842 { 00:21:44.842 "subsystem": "iobuf", 00:21:44.842 "config": [ 00:21:44.842 { 00:21:44.842 "method": "iobuf_set_options", 00:21:44.842 "params": { 00:21:44.842 "small_pool_count": 8192, 00:21:44.842 "large_pool_count": 1024, 00:21:44.842 "small_bufsize": 8192, 00:21:44.842 "large_bufsize": 135168 00:21:44.842 } 00:21:44.842 } 00:21:44.842 ] 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "subsystem": "sock", 00:21:44.842 "config": [ 00:21:44.842 { 00:21:44.842 "method": "sock_impl_set_options", 00:21:44.842 "params": { 00:21:44.842 "impl_name": "posix", 00:21:44.842 "recv_buf_size": 2097152, 00:21:44.842 "send_buf_size": 2097152, 00:21:44.842 "enable_recv_pipe": true, 00:21:44.842 "enable_quickack": false, 00:21:44.842 "enable_placement_id": 0, 00:21:44.842 "enable_zerocopy_send_server": true, 00:21:44.842 "enable_zerocopy_send_client": false, 00:21:44.842 "zerocopy_threshold": 0, 00:21:44.842 "tls_version": 0, 00:21:44.842 "enable_ktls": false 00:21:44.842 } 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "method": "sock_impl_set_options", 00:21:44.842 "params": { 00:21:44.842 "impl_name": "ssl", 00:21:44.842 "recv_buf_size": 4096, 00:21:44.842 "send_buf_size": 4096, 00:21:44.842 "enable_recv_pipe": true, 00:21:44.842 "enable_quickack": false, 00:21:44.842 "enable_placement_id": 0, 00:21:44.842 "enable_zerocopy_send_server": true, 00:21:44.842 "enable_zerocopy_send_client": false, 00:21:44.842 "zerocopy_threshold": 0, 00:21:44.842 "tls_version": 0, 00:21:44.842 "enable_ktls": false 00:21:44.842 } 00:21:44.842 } 00:21:44.842 ] 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "subsystem": "vmd", 00:21:44.842 "config": [] 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "subsystem": "accel", 00:21:44.842 "config": [ 00:21:44.842 { 00:21:44.842 "method": "accel_set_options", 00:21:44.842 "params": { 00:21:44.842 "small_cache_size": 128, 00:21:44.842 "large_cache_size": 16, 00:21:44.842 "task_count": 2048, 00:21:44.842 "sequence_count": 2048, 00:21:44.842 "buf_count": 2048 00:21:44.842 } 00:21:44.842 } 00:21:44.842 ] 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "subsystem": "bdev", 00:21:44.842 "config": [ 00:21:44.842 { 00:21:44.842 "method": "bdev_set_options", 00:21:44.842 "params": { 00:21:44.842 "bdev_io_pool_size": 65535, 00:21:44.842 "bdev_io_cache_size": 256, 00:21:44.842 "bdev_auto_examine": true, 00:21:44.842 "iobuf_small_cache_size": 128, 00:21:44.842 "iobuf_large_cache_size": 16 00:21:44.842 } 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "method": "bdev_raid_set_options", 00:21:44.842 "params": { 00:21:44.842 "process_window_size_kb": 1024 00:21:44.842 } 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "method": "bdev_iscsi_set_options", 00:21:44.842 "params": { 00:21:44.842 "timeout_sec": 30 00:21:44.842 } 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "method": "bdev_nvme_set_options", 00:21:44.842 "params": { 00:21:44.842 "action_on_timeout": "none", 00:21:44.842 "timeout_us": 0, 00:21:44.842 "timeout_admin_us": 0, 00:21:44.842 "keep_alive_timeout_ms": 10000, 00:21:44.842 "transport_retry_count": 4, 00:21:44.842 "arbitration_burst": 0, 00:21:44.842 "low_priority_weight": 0, 00:21:44.842 "medium_priority_weight": 0, 00:21:44.842 "high_priority_weight": 0, 00:21:44.842 "nvme_adminq_poll_period_us": 10000, 00:21:44.842 "nvme_ioq_poll_period_us": 0, 00:21:44.842 "io_queue_requests": 512, 00:21:44.842 "delay_cmd_submit": true, 00:21:44.842 "bdev_retry_count": 3, 00:21:44.842 "transport_ack_timeout": 0, 00:21:44.842 "ctrlr_loss_timeout_sec": 0, 00:21:44.842 "reconnect_delay_sec": 0, 00:21:44.842 "fast_io_fail_timeout_sec": 0, 00:21:44.842 "generate_uuids": false, 00:21:44.842 "transport_tos": 0, 00:21:44.842 "io_path_stat": false, 00:21:44.842 "allow_accel_sequence": false 00:21:44.842 } 00:21:44.842 }, 00:21:44.842 { 00:21:44.842 "method": "bdev_nvme_attach_controller", 00:21:44.842 "params": { 00:21:44.842 "name": "TLSTEST", 00:21:44.842 "trtype": "TCP", 00:21:44.842 "adrfam": "IPv4", 00:21:44.842 "traddr": "10.0.0.2", 00:21:44.842 "trsvcid": "4420", 00:21:44.842 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.842 "prchk_reftag": false, 00:21:44.842 "prchk_guard": false, 00:21:44.842 "ctrlr_loss_timeout_sec": 0, 00:21:44.842 "reconnect_delay_sec": 0, 00:21:44.842 "fast_io_fail_timeout_sec": 0, 00:21:44.842 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:44.842 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:44.842 "hdgst": false, 00:21:44.842 "ddgst": false 00:21:44.842 } 00:21:44.843 }, 00:21:44.843 { 00:21:44.843 "method": "bdev_nvme_set_hotplug", 00:21:44.843 "params": { 00:21:44.843 "period_us": 100000, 00:21:44.843 "enable": false 00:21:44.843 } 00:21:44.843 }, 00:21:44.843 { 00:21:44.843 "method": "bdev_wait_for_examine" 00:21:44.843 } 00:21:44.843 ] 00:21:44.843 }, 00:21:44.843 { 00:21:44.843 "subsystem": "nbd", 00:21:44.843 "config": [] 00:21:44.843 } 00:21:44.843 ] 00:21:44.843 }' 00:21:44.843 16:46:10 -- target/tls.sh@208 -- # killprocess 1232303 00:21:44.843 16:46:10 -- common/autotest_common.sh@926 -- # '[' -z 1232303 ']' 00:21:44.843 16:46:10 -- common/autotest_common.sh@930 -- # kill -0 1232303 00:21:44.843 16:46:10 -- common/autotest_common.sh@931 -- # uname 00:21:44.843 16:46:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:44.843 16:46:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1232303 00:21:44.843 16:46:10 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:44.843 16:46:10 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:44.843 16:46:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1232303' 00:21:44.843 killing process with pid 1232303 00:21:44.843 16:46:10 -- common/autotest_common.sh@945 -- # kill 1232303 00:21:44.843 Received shutdown signal, test time was about 10.000000 seconds 00:21:44.843 00:21:44.843 Latency(us) 00:21:44.843 [2024-10-13T14:46:10.344Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:44.843 [2024-10-13T14:46:10.344Z] =================================================================================================================== 00:21:44.843 [2024-10-13T14:46:10.344Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:44.843 16:46:10 -- common/autotest_common.sh@950 -- # wait 1232303 00:21:45.101 16:46:10 -- target/tls.sh@209 -- # killprocess 1231888 00:21:45.101 16:46:10 -- common/autotest_common.sh@926 -- # '[' -z 1231888 ']' 00:21:45.101 16:46:10 -- common/autotest_common.sh@930 -- # kill -0 1231888 00:21:45.101 16:46:10 -- common/autotest_common.sh@931 -- # uname 00:21:45.101 16:46:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:45.101 16:46:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1231888 00:21:45.101 16:46:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:45.101 16:46:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:45.101 16:46:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1231888' 00:21:45.101 killing process with pid 1231888 00:21:45.101 16:46:10 -- common/autotest_common.sh@945 -- # kill 1231888 00:21:45.101 16:46:10 -- common/autotest_common.sh@950 -- # wait 1231888 00:21:45.359 16:46:10 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:45.359 16:46:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:45.359 16:46:10 -- target/tls.sh@212 -- # echo '{ 00:21:45.359 "subsystems": [ 00:21:45.359 { 00:21:45.359 "subsystem": "iobuf", 00:21:45.359 "config": [ 00:21:45.359 { 00:21:45.359 "method": "iobuf_set_options", 00:21:45.359 "params": { 00:21:45.359 "small_pool_count": 8192, 00:21:45.359 "large_pool_count": 1024, 00:21:45.359 "small_bufsize": 8192, 00:21:45.359 "large_bufsize": 135168 00:21:45.359 } 00:21:45.359 } 00:21:45.359 ] 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "subsystem": "sock", 00:21:45.359 "config": [ 00:21:45.359 { 00:21:45.359 "method": "sock_impl_set_options", 00:21:45.359 "params": { 00:21:45.359 "impl_name": "posix", 00:21:45.359 "recv_buf_size": 2097152, 00:21:45.359 "send_buf_size": 2097152, 00:21:45.359 "enable_recv_pipe": true, 00:21:45.359 "enable_quickack": false, 00:21:45.359 "enable_placement_id": 0, 00:21:45.359 "enable_zerocopy_send_server": true, 00:21:45.359 "enable_zerocopy_send_client": false, 00:21:45.359 "zerocopy_threshold": 0, 00:21:45.359 "tls_version": 0, 00:21:45.359 "enable_ktls": false 00:21:45.359 } 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "method": "sock_impl_set_options", 00:21:45.359 "params": { 00:21:45.359 "impl_name": "ssl", 00:21:45.359 "recv_buf_size": 4096, 00:21:45.359 "send_buf_size": 4096, 00:21:45.359 "enable_recv_pipe": true, 00:21:45.359 "enable_quickack": false, 00:21:45.359 "enable_placement_id": 0, 00:21:45.359 "enable_zerocopy_send_server": true, 00:21:45.359 "enable_zerocopy_send_client": false, 00:21:45.359 "zerocopy_threshold": 0, 00:21:45.359 "tls_version": 0, 00:21:45.359 "enable_ktls": false 00:21:45.359 } 00:21:45.359 } 00:21:45.359 ] 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "subsystem": "vmd", 00:21:45.359 "config": [] 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "subsystem": "accel", 00:21:45.359 "config": [ 00:21:45.359 { 00:21:45.359 "method": "accel_set_options", 00:21:45.359 "params": { 00:21:45.359 "small_cache_size": 128, 00:21:45.359 "large_cache_size": 16, 00:21:45.359 "task_count": 2048, 00:21:45.359 "sequence_count": 2048, 00:21:45.359 "buf_count": 2048 00:21:45.359 } 00:21:45.359 } 00:21:45.359 ] 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "subsystem": "bdev", 00:21:45.359 "config": [ 00:21:45.359 { 00:21:45.359 "method": "bdev_set_options", 00:21:45.359 "params": { 00:21:45.359 "bdev_io_pool_size": 65535, 00:21:45.359 "bdev_io_cache_size": 256, 00:21:45.359 "bdev_auto_examine": true, 00:21:45.359 "iobuf_small_cache_size": 128, 00:21:45.359 "iobuf_large_cache_size": 16 00:21:45.359 } 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "method": "bdev_raid_set_options", 00:21:45.359 "params": { 00:21:45.359 "process_window_size_kb": 1024 00:21:45.359 } 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "method": "bdev_iscsi_set_options", 00:21:45.359 "params": { 00:21:45.359 "timeout_sec": 30 00:21:45.359 } 00:21:45.359 }, 00:21:45.359 { 00:21:45.359 "method": "bdev_nvme_set_options", 00:21:45.359 "params": { 00:21:45.359 "action_on_timeout": "none", 00:21:45.359 "timeout_us": 0, 00:21:45.359 "timeout_admin_us": 0, 00:21:45.359 "keep_alive_timeout_ms": 10000, 00:21:45.359 "transport_retry_count": 4, 00:21:45.359 "arbitration_burst": 0, 00:21:45.359 "low_priority_weight": 0, 00:21:45.359 "medium_priority_weight": 0, 00:21:45.359 "high_priority_weight": 0, 00:21:45.359 "nvme_adminq_poll_period_us": 10000, 00:21:45.359 "nvme_ioq_poll_period_us": 0, 00:21:45.359 "io_queue_requests": 0, 00:21:45.359 "delay_cmd_submit": true, 00:21:45.359 "bdev_retry_count": 3, 00:21:45.359 "transport_ack_timeout": 0, 00:21:45.359 "ctrlr_loss_timeout_sec": 0, 00:21:45.359 "reconnect_delay_sec": 0, 00:21:45.359 "fast_io_fail_timeout_sec": 0, 00:21:45.359 "generate_uuids": false, 00:21:45.360 "transport_tos": 0, 00:21:45.360 "io_path_stat": false, 00:21:45.360 "allow_accel_sequence": false 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "bdev_nvme_set_hotplug", 00:21:45.360 "params": { 00:21:45.360 "period_us": 100000, 00:21:45.360 "enable": false 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "bdev_malloc_create", 00:21:45.360 "params": { 00:21:45.360 "name": "malloc0", 00:21:45.360 "num_blocks": 8192, 00:21:45.360 "block_size": 4096, 00:21:45.360 "physical_block_size": 4096, 00:21:45.360 "uuid": "3adeae17-0058-44b4-8b79-032637fdeb1a", 00:21:45.360 "optimal_io_boundary": 0 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "bdev_wait_for_examine" 00:21:45.360 } 00:21:45.360 ] 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "subsystem": "nbd", 00:21:45.360 "config": [] 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "subsystem": "scheduler", 00:21:45.360 "config": [ 00:21:45.360 { 00:21:45.360 "method": "framework_set_scheduler", 00:21:45.360 "params": { 00:21:45.360 "name": "static" 00:21:45.360 } 00:21:45.360 } 00:21:45.360 ] 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "subsystem": "nvmf", 00:21:45.360 "config": [ 00:21:45.360 { 00:21:45.360 "method": "nvmf_set_config", 00:21:45.360 "params": { 00:21:45.360 "discovery_filter": "match_any", 00:21:45.360 "admin_cmd_passthru": { 00:21:45.360 "identify_ctrlr": false 00:21:45.360 } 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_set_max_subsystems", 00:21:45.360 "params": { 00:21:45.360 "max_subsystems": 1024 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_set_crdt", 00:21:45.360 "params": { 00:21:45.360 "crdt1": 0, 00:21:45.360 "crdt2": 0, 00:21:45.360 "crdt3": 0 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_create_transport", 00:21:45.360 "params": { 00:21:45.360 "trtype": "TCP", 00:21:45.360 "max_queue_depth": 128, 00:21:45.360 "max_io_qpairs_per_ctrlr": 127, 00:21:45.360 "in_capsule_data_size": 4096, 00:21:45.360 "max_io_size": 131072, 00:21:45.360 "io_unit_size": 131072, 00:21:45.360 "max_aq_depth": 128, 00:21:45.360 "num_shared_buffers": 511, 00:21:45.360 "buf_cache_size": 4294967295, 00:21:45.360 "dif_insert_or_strip": false, 00:21:45.360 "zcopy": false, 00:21:45.360 "c2h_success": false, 00:21:45.360 "sock_priority": 0, 00:21:45.360 "abort_timeout_sec": 1 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_create_subsystem", 00:21:45.360 "params": { 00:21:45.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:45.360 "allow_any_host": false, 00:21:45.360 "serial_number": "SPDK00000000000001", 00:21:45.360 "model_number": "SPDK bdev Controller", 00:21:45.360 "max_namespaces": 10, 00:21:45.360 "min_cntlid": 1, 00:21:45.360 "max_cntlid": 65519, 00:21:45.360 "ana_reporting": false 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_subsystem_add_host", 00:21:45.360 "params": { 00:21:45.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:45.360 "host": "nqn.2016-06.io.spdk:host1", 00:21:45.360 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_subsystem_add_ns", 00:21:45.360 "params": { 00:21:45.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:45.360 "namespace": { 00:21:45.360 "nsid": 1, 00:21:45.360 "bdev_name": "malloc0", 00:21:45.360 "nguid": "3ADEAE17005844B48B79032637FDEB1A", 00:21:45.360 "uuid": "3adeae17-0058-44b4-8b79-032637fdeb1a" 00:21:45.360 } 00:21:45.360 } 00:21:45.360 }, 00:21:45.360 { 00:21:45.360 "method": "nvmf_subsystem_add_listener", 00:21:45.360 "params": { 00:21:45.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:45.360 "listen_address": { 00:21:45.360 "trtype": "TCP", 00:21:45.360 "adrfam": "IPv4", 00:21:45.360 "traddr": "10.0.0.2", 00:21:45.360 "trsvcid": "4420" 00:21:45.360 }, 00:21:45.360 "secure_channel": true 00:21:45.360 } 00:21:45.360 } 00:21:45.360 ] 00:21:45.360 } 00:21:45.360 ] 00:21:45.360 }' 00:21:45.360 16:46:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:45.360 16:46:10 -- common/autotest_common.sh@10 -- # set +x 00:21:45.360 16:46:10 -- nvmf/common.sh@469 -- # nvmfpid=1232602 00:21:45.360 16:46:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:45.360 16:46:10 -- nvmf/common.sh@470 -- # waitforlisten 1232602 00:21:45.360 16:46:10 -- common/autotest_common.sh@819 -- # '[' -z 1232602 ']' 00:21:45.360 16:46:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:45.360 16:46:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:45.360 16:46:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:45.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:45.360 16:46:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:45.360 16:46:10 -- common/autotest_common.sh@10 -- # set +x 00:21:45.618 [2024-10-13 16:46:10.868088] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:45.618 [2024-10-13 16:46:10.868184] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:45.618 EAL: No free 2048 kB hugepages reported on node 1 00:21:45.618 [2024-10-13 16:46:10.933014] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:45.618 [2024-10-13 16:46:11.019051] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:45.618 [2024-10-13 16:46:11.019214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:45.618 [2024-10-13 16:46:11.019230] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:45.618 [2024-10-13 16:46:11.019242] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:45.618 [2024-10-13 16:46:11.019270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:45.877 [2024-10-13 16:46:11.247914] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:45.877 [2024-10-13 16:46:11.279942] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:45.877 [2024-10-13 16:46:11.280238] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:46.442 16:46:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:46.442 16:46:11 -- common/autotest_common.sh@852 -- # return 0 00:21:46.442 16:46:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:46.442 16:46:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:46.442 16:46:11 -- common/autotest_common.sh@10 -- # set +x 00:21:46.442 16:46:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:46.442 16:46:11 -- target/tls.sh@216 -- # bdevperf_pid=1232757 00:21:46.442 16:46:11 -- target/tls.sh@217 -- # waitforlisten 1232757 /var/tmp/bdevperf.sock 00:21:46.442 16:46:11 -- common/autotest_common.sh@819 -- # '[' -z 1232757 ']' 00:21:46.442 16:46:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:46.442 16:46:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:46.442 16:46:11 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:46.442 16:46:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:46.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:46.442 16:46:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:46.442 16:46:11 -- common/autotest_common.sh@10 -- # set +x 00:21:46.442 16:46:11 -- target/tls.sh@213 -- # echo '{ 00:21:46.442 "subsystems": [ 00:21:46.442 { 00:21:46.442 "subsystem": "iobuf", 00:21:46.442 "config": [ 00:21:46.442 { 00:21:46.442 "method": "iobuf_set_options", 00:21:46.443 "params": { 00:21:46.443 "small_pool_count": 8192, 00:21:46.443 "large_pool_count": 1024, 00:21:46.443 "small_bufsize": 8192, 00:21:46.443 "large_bufsize": 135168 00:21:46.443 } 00:21:46.443 } 00:21:46.443 ] 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "subsystem": "sock", 00:21:46.443 "config": [ 00:21:46.443 { 00:21:46.443 "method": "sock_impl_set_options", 00:21:46.443 "params": { 00:21:46.443 "impl_name": "posix", 00:21:46.443 "recv_buf_size": 2097152, 00:21:46.443 "send_buf_size": 2097152, 00:21:46.443 "enable_recv_pipe": true, 00:21:46.443 "enable_quickack": false, 00:21:46.443 "enable_placement_id": 0, 00:21:46.443 "enable_zerocopy_send_server": true, 00:21:46.443 "enable_zerocopy_send_client": false, 00:21:46.443 "zerocopy_threshold": 0, 00:21:46.443 "tls_version": 0, 00:21:46.443 "enable_ktls": false 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "sock_impl_set_options", 00:21:46.443 "params": { 00:21:46.443 "impl_name": "ssl", 00:21:46.443 "recv_buf_size": 4096, 00:21:46.443 "send_buf_size": 4096, 00:21:46.443 "enable_recv_pipe": true, 00:21:46.443 "enable_quickack": false, 00:21:46.443 "enable_placement_id": 0, 00:21:46.443 "enable_zerocopy_send_server": true, 00:21:46.443 "enable_zerocopy_send_client": false, 00:21:46.443 "zerocopy_threshold": 0, 00:21:46.443 "tls_version": 0, 00:21:46.443 "enable_ktls": false 00:21:46.443 } 00:21:46.443 } 00:21:46.443 ] 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "subsystem": "vmd", 00:21:46.443 "config": [] 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "subsystem": "accel", 00:21:46.443 "config": [ 00:21:46.443 { 00:21:46.443 "method": "accel_set_options", 00:21:46.443 "params": { 00:21:46.443 "small_cache_size": 128, 00:21:46.443 "large_cache_size": 16, 00:21:46.443 "task_count": 2048, 00:21:46.443 "sequence_count": 2048, 00:21:46.443 "buf_count": 2048 00:21:46.443 } 00:21:46.443 } 00:21:46.443 ] 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "subsystem": "bdev", 00:21:46.443 "config": [ 00:21:46.443 { 00:21:46.443 "method": "bdev_set_options", 00:21:46.443 "params": { 00:21:46.443 "bdev_io_pool_size": 65535, 00:21:46.443 "bdev_io_cache_size": 256, 00:21:46.443 "bdev_auto_examine": true, 00:21:46.443 "iobuf_small_cache_size": 128, 00:21:46.443 "iobuf_large_cache_size": 16 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_raid_set_options", 00:21:46.443 "params": { 00:21:46.443 "process_window_size_kb": 1024 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_iscsi_set_options", 00:21:46.443 "params": { 00:21:46.443 "timeout_sec": 30 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_nvme_set_options", 00:21:46.443 "params": { 00:21:46.443 "action_on_timeout": "none", 00:21:46.443 "timeout_us": 0, 00:21:46.443 "timeout_admin_us": 0, 00:21:46.443 "keep_alive_timeout_ms": 10000, 00:21:46.443 "transport_retry_count": 4, 00:21:46.443 "arbitration_burst": 0, 00:21:46.443 "low_priority_weight": 0, 00:21:46.443 "medium_priority_weight": 0, 00:21:46.443 "high_priority_weight": 0, 00:21:46.443 "nvme_adminq_poll_period_us": 10000, 00:21:46.443 "nvme_ioq_poll_period_us": 0, 00:21:46.443 "io_queue_requests": 512, 00:21:46.443 "delay_cmd_submit": true, 00:21:46.443 "bdev_retry_count": 3, 00:21:46.443 "transport_ack_timeout": 0, 00:21:46.443 "ctrlr_loss_timeout_sec": 0, 00:21:46.443 "reconnect_delay_sec": 0, 00:21:46.443 "fast_io_fail_timeout_sec": 0, 00:21:46.443 "generate_uuids": false, 00:21:46.443 "transport_tos": 0, 00:21:46.443 "io_path_stat": false, 00:21:46.443 "allow_accel_sequence": false 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_nvme_attach_controller", 00:21:46.443 "params": { 00:21:46.443 "name": "TLSTEST", 00:21:46.443 "trtype": "TCP", 00:21:46.443 "adrfam": "IPv4", 00:21:46.443 "traddr": "10.0.0.2", 00:21:46.443 "trsvcid": "4420", 00:21:46.443 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:46.443 "prchk_reftag": false, 00:21:46.443 "prchk_guard": false, 00:21:46.443 "ctrlr_loss_timeout_sec": 0, 00:21:46.443 "reconnect_delay_sec": 0, 00:21:46.443 "fast_io_fail_timeout_sec": 0, 00:21:46.443 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:46.443 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:46.443 "hdgst": false, 00:21:46.443 "ddgst": false 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_nvme_set_hotplug", 00:21:46.443 "params": { 00:21:46.443 "period_us": 100000, 00:21:46.443 "enable": false 00:21:46.443 } 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "method": "bdev_wait_for_examine" 00:21:46.443 } 00:21:46.443 ] 00:21:46.443 }, 00:21:46.443 { 00:21:46.443 "subsystem": "nbd", 00:21:46.443 "config": [] 00:21:46.443 } 00:21:46.443 ] 00:21:46.443 }' 00:21:46.443 [2024-10-13 16:46:11.892332] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:21:46.443 [2024-10-13 16:46:11.892426] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1232757 ] 00:21:46.443 EAL: No free 2048 kB hugepages reported on node 1 00:21:46.701 [2024-10-13 16:46:11.948836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:46.701 [2024-10-13 16:46:12.030556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:46.701 [2024-10-13 16:46:12.180219] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:47.633 16:46:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:47.633 16:46:12 -- common/autotest_common.sh@852 -- # return 0 00:21:47.633 16:46:12 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:47.633 Running I/O for 10 seconds... 00:21:57.595 00:21:57.595 Latency(us) 00:21:57.595 [2024-10-13T14:46:23.096Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:57.595 [2024-10-13T14:46:23.097Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:57.596 Verification LBA range: start 0x0 length 0x2000 00:21:57.596 TLSTESTn1 : 10.02 4795.85 18.73 0.00 0.00 26650.04 5024.43 46215.02 00:21:57.596 [2024-10-13T14:46:23.097Z] =================================================================================================================== 00:21:57.596 [2024-10-13T14:46:23.097Z] Total : 4795.85 18.73 0.00 0.00 26650.04 5024.43 46215.02 00:21:57.596 0 00:21:57.596 16:46:23 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:57.596 16:46:23 -- target/tls.sh@223 -- # killprocess 1232757 00:21:57.596 16:46:23 -- common/autotest_common.sh@926 -- # '[' -z 1232757 ']' 00:21:57.596 16:46:23 -- common/autotest_common.sh@930 -- # kill -0 1232757 00:21:57.596 16:46:23 -- common/autotest_common.sh@931 -- # uname 00:21:57.596 16:46:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:57.596 16:46:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1232757 00:21:57.853 16:46:23 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:57.853 16:46:23 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:57.853 16:46:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1232757' 00:21:57.853 killing process with pid 1232757 00:21:57.853 16:46:23 -- common/autotest_common.sh@945 -- # kill 1232757 00:21:57.853 Received shutdown signal, test time was about 10.000000 seconds 00:21:57.853 00:21:57.853 Latency(us) 00:21:57.853 [2024-10-13T14:46:23.354Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:57.853 [2024-10-13T14:46:23.354Z] =================================================================================================================== 00:21:57.853 [2024-10-13T14:46:23.354Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:57.853 16:46:23 -- common/autotest_common.sh@950 -- # wait 1232757 00:21:57.853 16:46:23 -- target/tls.sh@224 -- # killprocess 1232602 00:21:57.853 16:46:23 -- common/autotest_common.sh@926 -- # '[' -z 1232602 ']' 00:21:57.853 16:46:23 -- common/autotest_common.sh@930 -- # kill -0 1232602 00:21:57.853 16:46:23 -- common/autotest_common.sh@931 -- # uname 00:21:57.853 16:46:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:57.853 16:46:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1232602 00:21:57.853 16:46:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:57.853 16:46:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:57.853 16:46:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1232602' 00:21:57.853 killing process with pid 1232602 00:21:57.853 16:46:23 -- common/autotest_common.sh@945 -- # kill 1232602 00:21:57.853 16:46:23 -- common/autotest_common.sh@950 -- # wait 1232602 00:21:58.111 16:46:23 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:58.111 16:46:23 -- target/tls.sh@227 -- # cleanup 00:21:58.111 16:46:23 -- target/tls.sh@15 -- # process_shm --id 0 00:21:58.111 16:46:23 -- common/autotest_common.sh@796 -- # type=--id 00:21:58.111 16:46:23 -- common/autotest_common.sh@797 -- # id=0 00:21:58.111 16:46:23 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:21:58.111 16:46:23 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:58.111 16:46:23 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:21:58.111 16:46:23 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:21:58.111 16:46:23 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:21:58.111 16:46:23 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:58.111 nvmf_trace.0 00:21:58.370 16:46:23 -- common/autotest_common.sh@811 -- # return 0 00:21:58.370 16:46:23 -- target/tls.sh@16 -- # killprocess 1232757 00:21:58.370 16:46:23 -- common/autotest_common.sh@926 -- # '[' -z 1232757 ']' 00:21:58.370 16:46:23 -- common/autotest_common.sh@930 -- # kill -0 1232757 00:21:58.370 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1232757) - No such process 00:21:58.370 16:46:23 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1232757 is not found' 00:21:58.370 Process with pid 1232757 is not found 00:21:58.370 16:46:23 -- target/tls.sh@17 -- # nvmftestfini 00:21:58.370 16:46:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:58.370 16:46:23 -- nvmf/common.sh@116 -- # sync 00:21:58.370 16:46:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:58.370 16:46:23 -- nvmf/common.sh@119 -- # set +e 00:21:58.370 16:46:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:58.370 16:46:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:58.370 rmmod nvme_tcp 00:21:58.370 rmmod nvme_fabrics 00:21:58.370 rmmod nvme_keyring 00:21:58.370 16:46:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:58.370 16:46:23 -- nvmf/common.sh@123 -- # set -e 00:21:58.370 16:46:23 -- nvmf/common.sh@124 -- # return 0 00:21:58.370 16:46:23 -- nvmf/common.sh@477 -- # '[' -n 1232602 ']' 00:21:58.370 16:46:23 -- nvmf/common.sh@478 -- # killprocess 1232602 00:21:58.370 16:46:23 -- common/autotest_common.sh@926 -- # '[' -z 1232602 ']' 00:21:58.370 16:46:23 -- common/autotest_common.sh@930 -- # kill -0 1232602 00:21:58.370 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1232602) - No such process 00:21:58.370 16:46:23 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1232602 is not found' 00:21:58.370 Process with pid 1232602 is not found 00:21:58.370 16:46:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:58.370 16:46:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:58.370 16:46:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:58.370 16:46:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:58.370 16:46:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:58.370 16:46:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:58.370 16:46:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:58.370 16:46:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:00.277 16:46:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:00.277 16:46:25 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:22:00.277 00:22:00.277 real 1m15.458s 00:22:00.277 user 2m3.854s 00:22:00.277 sys 0m22.420s 00:22:00.277 16:46:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:00.277 16:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:00.277 ************************************ 00:22:00.277 END TEST nvmf_tls 00:22:00.277 ************************************ 00:22:00.277 16:46:25 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:22:00.277 16:46:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:00.277 16:46:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:00.277 16:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:00.277 ************************************ 00:22:00.277 START TEST nvmf_fips 00:22:00.277 ************************************ 00:22:00.277 16:46:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:22:00.537 * Looking for test storage... 00:22:00.537 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:22:00.537 16:46:25 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:00.537 16:46:25 -- nvmf/common.sh@7 -- # uname -s 00:22:00.537 16:46:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:00.537 16:46:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:00.537 16:46:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:00.537 16:46:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:00.537 16:46:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:00.537 16:46:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:00.537 16:46:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:00.537 16:46:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:00.537 16:46:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:00.537 16:46:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:00.537 16:46:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:00.537 16:46:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:00.537 16:46:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:00.537 16:46:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:00.537 16:46:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:00.537 16:46:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:00.537 16:46:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:00.537 16:46:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:00.537 16:46:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:00.537 16:46:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.537 16:46:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.537 16:46:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.537 16:46:25 -- paths/export.sh@5 -- # export PATH 00:22:00.537 16:46:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.537 16:46:25 -- nvmf/common.sh@46 -- # : 0 00:22:00.537 16:46:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:00.537 16:46:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:00.537 16:46:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:00.537 16:46:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:00.537 16:46:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:00.537 16:46:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:00.537 16:46:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:00.537 16:46:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:00.537 16:46:25 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:00.537 16:46:25 -- fips/fips.sh@89 -- # check_openssl_version 00:22:00.537 16:46:25 -- fips/fips.sh@83 -- # local target=3.0.0 00:22:00.537 16:46:25 -- fips/fips.sh@85 -- # openssl version 00:22:00.537 16:46:25 -- fips/fips.sh@85 -- # awk '{print $2}' 00:22:00.537 16:46:25 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:22:00.537 16:46:25 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:22:00.537 16:46:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:00.537 16:46:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:00.537 16:46:25 -- scripts/common.sh@335 -- # IFS=.-: 00:22:00.537 16:46:25 -- scripts/common.sh@335 -- # read -ra ver1 00:22:00.537 16:46:25 -- scripts/common.sh@336 -- # IFS=.-: 00:22:00.537 16:46:25 -- scripts/common.sh@336 -- # read -ra ver2 00:22:00.537 16:46:25 -- scripts/common.sh@337 -- # local 'op=>=' 00:22:00.537 16:46:25 -- scripts/common.sh@339 -- # ver1_l=3 00:22:00.537 16:46:25 -- scripts/common.sh@340 -- # ver2_l=3 00:22:00.537 16:46:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:00.537 16:46:25 -- scripts/common.sh@343 -- # case "$op" in 00:22:00.537 16:46:25 -- scripts/common.sh@347 -- # : 1 00:22:00.537 16:46:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:00.537 16:46:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:00.537 16:46:25 -- scripts/common.sh@364 -- # decimal 3 00:22:00.537 16:46:25 -- scripts/common.sh@352 -- # local d=3 00:22:00.537 16:46:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:22:00.537 16:46:25 -- scripts/common.sh@354 -- # echo 3 00:22:00.537 16:46:25 -- scripts/common.sh@364 -- # ver1[v]=3 00:22:00.537 16:46:25 -- scripts/common.sh@365 -- # decimal 3 00:22:00.537 16:46:25 -- scripts/common.sh@352 -- # local d=3 00:22:00.537 16:46:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:22:00.537 16:46:25 -- scripts/common.sh@354 -- # echo 3 00:22:00.537 16:46:25 -- scripts/common.sh@365 -- # ver2[v]=3 00:22:00.537 16:46:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:00.537 16:46:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:00.537 16:46:25 -- scripts/common.sh@363 -- # (( v++ )) 00:22:00.537 16:46:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:00.537 16:46:25 -- scripts/common.sh@364 -- # decimal 1 00:22:00.537 16:46:25 -- scripts/common.sh@352 -- # local d=1 00:22:00.537 16:46:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:00.537 16:46:25 -- scripts/common.sh@354 -- # echo 1 00:22:00.537 16:46:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:00.537 16:46:25 -- scripts/common.sh@365 -- # decimal 0 00:22:00.537 16:46:25 -- scripts/common.sh@352 -- # local d=0 00:22:00.537 16:46:25 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:22:00.537 16:46:25 -- scripts/common.sh@354 -- # echo 0 00:22:00.537 16:46:25 -- scripts/common.sh@365 -- # ver2[v]=0 00:22:00.537 16:46:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:00.537 16:46:25 -- scripts/common.sh@366 -- # return 0 00:22:00.537 16:46:25 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:22:00.537 16:46:25 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:22:00.537 16:46:25 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:22:00.537 16:46:25 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:22:00.537 16:46:25 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:22:00.537 16:46:25 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:22:00.537 16:46:25 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:22:00.537 16:46:25 -- fips/fips.sh@113 -- # build_openssl_config 00:22:00.538 16:46:25 -- fips/fips.sh@37 -- # cat 00:22:00.538 16:46:25 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:22:00.538 16:46:25 -- fips/fips.sh@58 -- # cat - 00:22:00.538 16:46:25 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:22:00.538 16:46:25 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:22:00.538 16:46:25 -- fips/fips.sh@116 -- # mapfile -t providers 00:22:00.538 16:46:25 -- fips/fips.sh@116 -- # openssl list -providers 00:22:00.538 16:46:25 -- fips/fips.sh@116 -- # grep name 00:22:00.538 16:46:25 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:22:00.538 16:46:25 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:22:00.538 16:46:25 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:22:00.538 16:46:25 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:22:00.538 16:46:25 -- fips/fips.sh@127 -- # : 00:22:00.538 16:46:25 -- common/autotest_common.sh@640 -- # local es=0 00:22:00.538 16:46:25 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:22:00.538 16:46:25 -- common/autotest_common.sh@628 -- # local arg=openssl 00:22:00.538 16:46:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:00.538 16:46:25 -- common/autotest_common.sh@632 -- # type -t openssl 00:22:00.538 16:46:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:00.538 16:46:25 -- common/autotest_common.sh@634 -- # type -P openssl 00:22:00.538 16:46:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:00.538 16:46:25 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:22:00.538 16:46:25 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:22:00.538 16:46:25 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:22:00.538 Error setting digest 00:22:00.538 40E227A7C17F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:22:00.538 40E227A7C17F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:22:00.538 16:46:25 -- common/autotest_common.sh@643 -- # es=1 00:22:00.538 16:46:25 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:00.538 16:46:25 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:00.538 16:46:25 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:00.538 16:46:25 -- fips/fips.sh@130 -- # nvmftestinit 00:22:00.538 16:46:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:00.538 16:46:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:00.538 16:46:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:00.538 16:46:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:00.538 16:46:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:00.538 16:46:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:00.538 16:46:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:00.538 16:46:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:00.538 16:46:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:00.538 16:46:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:00.538 16:46:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:00.538 16:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:03.068 16:46:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:03.068 16:46:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:03.068 16:46:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:03.068 16:46:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:03.068 16:46:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:03.068 16:46:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:03.068 16:46:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:03.068 16:46:27 -- nvmf/common.sh@294 -- # net_devs=() 00:22:03.068 16:46:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:03.068 16:46:27 -- nvmf/common.sh@295 -- # e810=() 00:22:03.068 16:46:27 -- nvmf/common.sh@295 -- # local -ga e810 00:22:03.068 16:46:27 -- nvmf/common.sh@296 -- # x722=() 00:22:03.068 16:46:27 -- nvmf/common.sh@296 -- # local -ga x722 00:22:03.068 16:46:27 -- nvmf/common.sh@297 -- # mlx=() 00:22:03.068 16:46:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:03.068 16:46:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:03.068 16:46:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:03.068 16:46:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:03.068 16:46:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.068 16:46:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:03.068 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:03.068 16:46:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.068 16:46:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:03.068 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:03.068 16:46:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.068 16:46:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.068 16:46:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.068 16:46:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:03.068 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:03.068 16:46:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.068 16:46:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.068 16:46:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.068 16:46:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.068 16:46:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:03.068 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:03.068 16:46:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.068 16:46:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:03.068 16:46:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:03.068 16:46:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:03.068 16:46:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:03.068 16:46:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:03.068 16:46:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:03.068 16:46:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:03.068 16:46:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:03.068 16:46:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:03.068 16:46:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:03.068 16:46:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:03.068 16:46:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:03.068 16:46:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:03.068 16:46:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:03.068 16:46:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:03.068 16:46:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:03.068 16:46:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:03.069 16:46:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:03.069 16:46:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:03.069 16:46:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:03.069 16:46:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:03.069 16:46:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:03.069 16:46:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:03.069 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:03.069 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:22:03.069 00:22:03.069 --- 10.0.0.2 ping statistics --- 00:22:03.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.069 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:22:03.069 16:46:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:03.069 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:03.069 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:22:03.069 00:22:03.069 --- 10.0.0.1 ping statistics --- 00:22:03.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.069 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:22:03.069 16:46:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:03.069 16:46:28 -- nvmf/common.sh@410 -- # return 0 00:22:03.069 16:46:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:03.069 16:46:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:03.069 16:46:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:03.069 16:46:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:03.069 16:46:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:03.069 16:46:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:03.069 16:46:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:03.069 16:46:28 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:22:03.069 16:46:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:03.069 16:46:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:03.069 16:46:28 -- common/autotest_common.sh@10 -- # set +x 00:22:03.069 16:46:28 -- nvmf/common.sh@469 -- # nvmfpid=1236090 00:22:03.069 16:46:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:22:03.069 16:46:28 -- nvmf/common.sh@470 -- # waitforlisten 1236090 00:22:03.069 16:46:28 -- common/autotest_common.sh@819 -- # '[' -z 1236090 ']' 00:22:03.069 16:46:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:03.069 16:46:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:03.069 16:46:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:03.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:03.069 16:46:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:03.069 16:46:28 -- common/autotest_common.sh@10 -- # set +x 00:22:03.069 [2024-10-13 16:46:28.212166] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:22:03.069 [2024-10-13 16:46:28.212246] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:03.069 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.069 [2024-10-13 16:46:28.279894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:03.069 [2024-10-13 16:46:28.369638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:03.069 [2024-10-13 16:46:28.369798] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:03.069 [2024-10-13 16:46:28.369814] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:03.069 [2024-10-13 16:46:28.369827] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:03.069 [2024-10-13 16:46:28.369855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:04.002 16:46:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:04.002 16:46:29 -- common/autotest_common.sh@852 -- # return 0 00:22:04.002 16:46:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:04.002 16:46:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:04.002 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:04.002 16:46:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:04.002 16:46:29 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:22:04.002 16:46:29 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:22:04.002 16:46:29 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:04.002 16:46:29 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:22:04.002 16:46:29 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:04.002 16:46:29 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:04.002 16:46:29 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:04.002 16:46:29 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:04.260 [2024-10-13 16:46:29.527524] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:04.260 [2024-10-13 16:46:29.543503] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:04.260 [2024-10-13 16:46:29.543769] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:04.260 malloc0 00:22:04.260 16:46:29 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:04.260 16:46:29 -- fips/fips.sh@147 -- # bdevperf_pid=1236253 00:22:04.260 16:46:29 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:22:04.260 16:46:29 -- fips/fips.sh@148 -- # waitforlisten 1236253 /var/tmp/bdevperf.sock 00:22:04.260 16:46:29 -- common/autotest_common.sh@819 -- # '[' -z 1236253 ']' 00:22:04.260 16:46:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:04.260 16:46:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:04.260 16:46:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:04.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:04.260 16:46:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:04.260 16:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:04.260 [2024-10-13 16:46:29.670315] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:22:04.260 [2024-10-13 16:46:29.670427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1236253 ] 00:22:04.260 EAL: No free 2048 kB hugepages reported on node 1 00:22:04.260 [2024-10-13 16:46:29.733307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:04.518 [2024-10-13 16:46:29.819754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:05.451 16:46:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:05.451 16:46:30 -- common/autotest_common.sh@852 -- # return 0 00:22:05.451 16:46:30 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:05.451 [2024-10-13 16:46:30.862115] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:05.451 TLSTESTn1 00:22:05.451 16:46:30 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:05.709 Running I/O for 10 seconds... 00:22:15.735 00:22:15.735 Latency(us) 00:22:15.735 [2024-10-13T14:46:41.236Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:15.735 [2024-10-13T14:46:41.236Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:22:15.735 Verification LBA range: start 0x0 length 0x2000 00:22:15.735 TLSTESTn1 : 10.02 4617.54 18.04 0.00 0.00 27678.96 5849.69 41748.86 00:22:15.735 [2024-10-13T14:46:41.236Z] =================================================================================================================== 00:22:15.735 [2024-10-13T14:46:41.236Z] Total : 4617.54 18.04 0.00 0.00 27678.96 5849.69 41748.86 00:22:15.735 0 00:22:15.735 16:46:41 -- fips/fips.sh@1 -- # cleanup 00:22:15.735 16:46:41 -- fips/fips.sh@15 -- # process_shm --id 0 00:22:15.735 16:46:41 -- common/autotest_common.sh@796 -- # type=--id 00:22:15.735 16:46:41 -- common/autotest_common.sh@797 -- # id=0 00:22:15.735 16:46:41 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:22:15.735 16:46:41 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:22:15.735 16:46:41 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:22:15.735 16:46:41 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:22:15.735 16:46:41 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:22:15.735 16:46:41 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:22:15.735 nvmf_trace.0 00:22:15.735 16:46:41 -- common/autotest_common.sh@811 -- # return 0 00:22:15.735 16:46:41 -- fips/fips.sh@16 -- # killprocess 1236253 00:22:15.735 16:46:41 -- common/autotest_common.sh@926 -- # '[' -z 1236253 ']' 00:22:15.735 16:46:41 -- common/autotest_common.sh@930 -- # kill -0 1236253 00:22:15.735 16:46:41 -- common/autotest_common.sh@931 -- # uname 00:22:15.735 16:46:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:15.735 16:46:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1236253 00:22:15.735 16:46:41 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:22:15.735 16:46:41 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:22:15.735 16:46:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1236253' 00:22:15.735 killing process with pid 1236253 00:22:15.735 16:46:41 -- common/autotest_common.sh@945 -- # kill 1236253 00:22:15.735 Received shutdown signal, test time was about 10.000000 seconds 00:22:15.735 00:22:15.735 Latency(us) 00:22:15.735 [2024-10-13T14:46:41.236Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:15.735 [2024-10-13T14:46:41.236Z] =================================================================================================================== 00:22:15.735 [2024-10-13T14:46:41.236Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:15.735 16:46:41 -- common/autotest_common.sh@950 -- # wait 1236253 00:22:15.993 16:46:41 -- fips/fips.sh@17 -- # nvmftestfini 00:22:15.993 16:46:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:15.993 16:46:41 -- nvmf/common.sh@116 -- # sync 00:22:15.993 16:46:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:15.993 16:46:41 -- nvmf/common.sh@119 -- # set +e 00:22:15.993 16:46:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:15.993 16:46:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:15.993 rmmod nvme_tcp 00:22:15.993 rmmod nvme_fabrics 00:22:15.993 rmmod nvme_keyring 00:22:15.993 16:46:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:15.993 16:46:41 -- nvmf/common.sh@123 -- # set -e 00:22:15.993 16:46:41 -- nvmf/common.sh@124 -- # return 0 00:22:15.993 16:46:41 -- nvmf/common.sh@477 -- # '[' -n 1236090 ']' 00:22:15.993 16:46:41 -- nvmf/common.sh@478 -- # killprocess 1236090 00:22:15.993 16:46:41 -- common/autotest_common.sh@926 -- # '[' -z 1236090 ']' 00:22:15.993 16:46:41 -- common/autotest_common.sh@930 -- # kill -0 1236090 00:22:15.993 16:46:41 -- common/autotest_common.sh@931 -- # uname 00:22:15.993 16:46:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:15.993 16:46:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1236090 00:22:15.993 16:46:41 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:15.993 16:46:41 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:15.993 16:46:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1236090' 00:22:15.993 killing process with pid 1236090 00:22:15.993 16:46:41 -- common/autotest_common.sh@945 -- # kill 1236090 00:22:15.993 16:46:41 -- common/autotest_common.sh@950 -- # wait 1236090 00:22:16.251 16:46:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:16.251 16:46:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:16.251 16:46:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:16.251 16:46:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:16.251 16:46:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:16.251 16:46:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.251 16:46:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:16.251 16:46:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.788 16:46:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:18.788 16:46:43 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:18.788 00:22:18.788 real 0m18.034s 00:22:18.788 user 0m23.150s 00:22:18.788 sys 0m6.157s 00:22:18.788 16:46:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:18.788 16:46:43 -- common/autotest_common.sh@10 -- # set +x 00:22:18.788 ************************************ 00:22:18.788 END TEST nvmf_fips 00:22:18.788 ************************************ 00:22:18.788 16:46:43 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:22:18.788 16:46:43 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:22:18.788 16:46:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:18.788 16:46:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:18.788 16:46:43 -- common/autotest_common.sh@10 -- # set +x 00:22:18.788 ************************************ 00:22:18.788 START TEST nvmf_fuzz 00:22:18.788 ************************************ 00:22:18.788 16:46:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:22:18.788 * Looking for test storage... 00:22:18.788 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:18.788 16:46:43 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:18.788 16:46:43 -- nvmf/common.sh@7 -- # uname -s 00:22:18.788 16:46:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:18.788 16:46:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:18.788 16:46:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:18.788 16:46:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:18.788 16:46:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:18.788 16:46:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:18.788 16:46:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:18.788 16:46:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:18.788 16:46:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:18.788 16:46:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:18.788 16:46:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:18.788 16:46:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:18.788 16:46:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:18.788 16:46:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:18.788 16:46:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:18.788 16:46:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:18.788 16:46:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:18.788 16:46:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:18.788 16:46:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:18.788 16:46:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.788 16:46:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.788 16:46:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.788 16:46:43 -- paths/export.sh@5 -- # export PATH 00:22:18.788 16:46:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.788 16:46:43 -- nvmf/common.sh@46 -- # : 0 00:22:18.788 16:46:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:18.788 16:46:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:18.788 16:46:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:18.788 16:46:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:18.788 16:46:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:18.788 16:46:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:18.788 16:46:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:18.788 16:46:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:18.788 16:46:43 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:22:18.788 16:46:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:18.788 16:46:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:18.788 16:46:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:18.788 16:46:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:18.788 16:46:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:18.788 16:46:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.788 16:46:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:18.788 16:46:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.788 16:46:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:18.788 16:46:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:18.788 16:46:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:18.788 16:46:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.692 16:46:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:20.692 16:46:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:20.692 16:46:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:20.692 16:46:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:20.692 16:46:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:20.692 16:46:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:20.692 16:46:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:20.692 16:46:45 -- nvmf/common.sh@294 -- # net_devs=() 00:22:20.692 16:46:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:20.692 16:46:45 -- nvmf/common.sh@295 -- # e810=() 00:22:20.692 16:46:45 -- nvmf/common.sh@295 -- # local -ga e810 00:22:20.692 16:46:45 -- nvmf/common.sh@296 -- # x722=() 00:22:20.692 16:46:45 -- nvmf/common.sh@296 -- # local -ga x722 00:22:20.692 16:46:45 -- nvmf/common.sh@297 -- # mlx=() 00:22:20.692 16:46:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:20.692 16:46:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:20.692 16:46:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:20.692 16:46:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:20.692 16:46:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:20.692 16:46:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:20.692 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:20.692 16:46:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:20.692 16:46:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:20.692 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:20.692 16:46:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:20.692 16:46:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:20.692 16:46:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:20.692 16:46:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:20.692 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:20.692 16:46:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:20.692 16:46:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:20.692 16:46:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:20.692 16:46:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:20.692 16:46:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:20.692 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:20.692 16:46:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:20.692 16:46:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:20.692 16:46:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:20.692 16:46:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:20.692 16:46:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:20.692 16:46:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:20.692 16:46:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:20.692 16:46:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:20.692 16:46:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:20.692 16:46:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:20.692 16:46:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:20.692 16:46:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:20.692 16:46:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:20.692 16:46:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:20.692 16:46:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:20.692 16:46:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:20.692 16:46:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:20.692 16:46:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:20.692 16:46:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:20.692 16:46:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:20.692 16:46:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:20.692 16:46:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:20.692 16:46:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:20.692 16:46:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:20.692 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:20.692 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:22:20.692 00:22:20.692 --- 10.0.0.2 ping statistics --- 00:22:20.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:20.692 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:22:20.692 16:46:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:20.692 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:20.692 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:20.692 00:22:20.692 --- 10.0.0.1 ping statistics --- 00:22:20.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:20.692 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:20.692 16:46:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:20.692 16:46:46 -- nvmf/common.sh@410 -- # return 0 00:22:20.692 16:46:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:20.692 16:46:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:20.693 16:46:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:20.693 16:46:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:20.693 16:46:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:20.693 16:46:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:20.693 16:46:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:20.693 16:46:46 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1239695 00:22:20.693 16:46:46 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:20.693 16:46:46 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:20.693 16:46:46 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1239695 00:22:20.693 16:46:46 -- common/autotest_common.sh@819 -- # '[' -z 1239695 ']' 00:22:20.693 16:46:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:20.693 16:46:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:20.693 16:46:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:20.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:20.693 16:46:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:20.693 16:46:46 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 16:46:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:22.066 16:46:47 -- common/autotest_common.sh@852 -- # return 0 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:22.066 16:46:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.066 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 16:46:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:22:22.066 16:46:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.066 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 Malloc0 00:22:22.066 16:46:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:22.066 16:46:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.066 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 16:46:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:22.066 16:46:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.066 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 16:46:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:22.066 16:46:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.066 16:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:22.066 16:46:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:22:22.066 16:46:47 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:54.126 Fuzzing completed. Shutting down the fuzz application 00:22:54.126 00:22:54.126 Dumping successful admin opcodes: 00:22:54.126 8, 9, 10, 24, 00:22:54.126 Dumping successful io opcodes: 00:22:54.126 0, 9, 00:22:54.126 NS: 0x200003aeff00 I/O qp, Total commands completed: 482452, total successful commands: 2784, random_seed: 674955072 00:22:54.126 NS: 0x200003aeff00 admin qp, Total commands completed: 53664, total successful commands: 432, random_seed: 1236999744 00:22:54.126 16:47:17 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:54.126 Fuzzing completed. Shutting down the fuzz application 00:22:54.126 00:22:54.126 Dumping successful admin opcodes: 00:22:54.126 24, 00:22:54.126 Dumping successful io opcodes: 00:22:54.126 00:22:54.126 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 459419112 00:22:54.126 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 459545193 00:22:54.126 16:47:18 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:54.126 16:47:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:54.126 16:47:18 -- common/autotest_common.sh@10 -- # set +x 00:22:54.126 16:47:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:54.126 16:47:19 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:54.126 16:47:19 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:54.126 16:47:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:54.126 16:47:19 -- nvmf/common.sh@116 -- # sync 00:22:54.126 16:47:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:54.126 16:47:19 -- nvmf/common.sh@119 -- # set +e 00:22:54.126 16:47:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:54.126 16:47:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:54.126 rmmod nvme_tcp 00:22:54.126 rmmod nvme_fabrics 00:22:54.126 rmmod nvme_keyring 00:22:54.126 16:47:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:54.126 16:47:19 -- nvmf/common.sh@123 -- # set -e 00:22:54.126 16:47:19 -- nvmf/common.sh@124 -- # return 0 00:22:54.126 16:47:19 -- nvmf/common.sh@477 -- # '[' -n 1239695 ']' 00:22:54.126 16:47:19 -- nvmf/common.sh@478 -- # killprocess 1239695 00:22:54.126 16:47:19 -- common/autotest_common.sh@926 -- # '[' -z 1239695 ']' 00:22:54.126 16:47:19 -- common/autotest_common.sh@930 -- # kill -0 1239695 00:22:54.126 16:47:19 -- common/autotest_common.sh@931 -- # uname 00:22:54.126 16:47:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:54.126 16:47:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1239695 00:22:54.126 16:47:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:54.126 16:47:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:54.126 16:47:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1239695' 00:22:54.126 killing process with pid 1239695 00:22:54.126 16:47:19 -- common/autotest_common.sh@945 -- # kill 1239695 00:22:54.126 16:47:19 -- common/autotest_common.sh@950 -- # wait 1239695 00:22:54.126 16:47:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:54.126 16:47:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:54.126 16:47:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:54.126 16:47:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:54.126 16:47:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:54.126 16:47:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:54.126 16:47:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:54.126 16:47:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:56.026 16:47:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:56.026 16:47:21 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:56.026 00:22:56.026 real 0m37.642s 00:22:56.026 user 0m51.883s 00:22:56.026 sys 0m14.753s 00:22:56.026 16:47:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:56.026 16:47:21 -- common/autotest_common.sh@10 -- # set +x 00:22:56.026 ************************************ 00:22:56.026 END TEST nvmf_fuzz 00:22:56.026 ************************************ 00:22:56.026 16:47:21 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:56.026 16:47:21 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:56.026 16:47:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:56.026 16:47:21 -- common/autotest_common.sh@10 -- # set +x 00:22:56.026 ************************************ 00:22:56.026 START TEST nvmf_multiconnection 00:22:56.026 ************************************ 00:22:56.026 16:47:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:56.026 * Looking for test storage... 00:22:56.026 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:56.026 16:47:21 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:56.026 16:47:21 -- nvmf/common.sh@7 -- # uname -s 00:22:56.284 16:47:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:56.285 16:47:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:56.285 16:47:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:56.285 16:47:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:56.285 16:47:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:56.285 16:47:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:56.285 16:47:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:56.285 16:47:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:56.285 16:47:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:56.285 16:47:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:56.285 16:47:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:56.285 16:47:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:56.285 16:47:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:56.285 16:47:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:56.285 16:47:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:56.285 16:47:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:56.285 16:47:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:56.285 16:47:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:56.285 16:47:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:56.285 16:47:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.285 16:47:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.285 16:47:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.285 16:47:21 -- paths/export.sh@5 -- # export PATH 00:22:56.285 16:47:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.285 16:47:21 -- nvmf/common.sh@46 -- # : 0 00:22:56.285 16:47:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:56.285 16:47:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:56.285 16:47:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:56.285 16:47:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:56.285 16:47:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:56.285 16:47:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:56.285 16:47:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:56.285 16:47:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:56.285 16:47:21 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:56.285 16:47:21 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:56.285 16:47:21 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:56.285 16:47:21 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:56.285 16:47:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:56.285 16:47:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:56.285 16:47:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:56.285 16:47:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:56.285 16:47:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:56.285 16:47:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:56.285 16:47:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:56.285 16:47:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:56.285 16:47:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:56.285 16:47:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:56.285 16:47:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:56.285 16:47:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.187 16:47:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:58.187 16:47:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:58.187 16:47:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:58.187 16:47:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:58.187 16:47:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:58.187 16:47:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:58.187 16:47:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:58.187 16:47:23 -- nvmf/common.sh@294 -- # net_devs=() 00:22:58.187 16:47:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:58.187 16:47:23 -- nvmf/common.sh@295 -- # e810=() 00:22:58.187 16:47:23 -- nvmf/common.sh@295 -- # local -ga e810 00:22:58.187 16:47:23 -- nvmf/common.sh@296 -- # x722=() 00:22:58.187 16:47:23 -- nvmf/common.sh@296 -- # local -ga x722 00:22:58.187 16:47:23 -- nvmf/common.sh@297 -- # mlx=() 00:22:58.187 16:47:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:58.187 16:47:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:58.187 16:47:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:58.187 16:47:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:58.187 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:58.187 16:47:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:58.187 16:47:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:58.187 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:58.187 16:47:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:58.187 16:47:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:58.187 16:47:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:58.187 16:47:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:58.187 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:58.187 16:47:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:58.187 16:47:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:58.187 16:47:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:58.187 16:47:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:58.187 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:58.187 16:47:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:58.187 16:47:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:58.187 16:47:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:58.187 16:47:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:58.187 16:47:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:58.187 16:47:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:58.187 16:47:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:58.187 16:47:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:58.187 16:47:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:58.187 16:47:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:58.187 16:47:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:58.187 16:47:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:58.187 16:47:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:58.187 16:47:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:58.187 16:47:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:58.187 16:47:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:58.187 16:47:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:58.187 16:47:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:58.187 16:47:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:58.187 16:47:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:58.187 16:47:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:58.187 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:58.187 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:22:58.187 00:22:58.187 --- 10.0.0.2 ping statistics --- 00:22:58.187 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:58.187 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:22:58.187 16:47:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:58.187 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:58.187 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:22:58.187 00:22:58.187 --- 10.0.0.1 ping statistics --- 00:22:58.187 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:58.187 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:22:58.187 16:47:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:58.187 16:47:23 -- nvmf/common.sh@410 -- # return 0 00:22:58.187 16:47:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:58.187 16:47:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:58.187 16:47:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:58.187 16:47:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:58.187 16:47:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:58.187 16:47:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:58.187 16:47:23 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:58.187 16:47:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:58.187 16:47:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:58.187 16:47:23 -- common/autotest_common.sh@10 -- # set +x 00:22:58.187 16:47:23 -- nvmf/common.sh@469 -- # nvmfpid=1245553 00:22:58.187 16:47:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:58.188 16:47:23 -- nvmf/common.sh@470 -- # waitforlisten 1245553 00:22:58.188 16:47:23 -- common/autotest_common.sh@819 -- # '[' -z 1245553 ']' 00:22:58.188 16:47:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:58.188 16:47:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:58.188 16:47:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:58.188 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:58.188 16:47:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:58.188 16:47:23 -- common/autotest_common.sh@10 -- # set +x 00:22:58.188 [2024-10-13 16:47:23.664519] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:22:58.188 [2024-10-13 16:47:23.664611] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:58.446 EAL: No free 2048 kB hugepages reported on node 1 00:22:58.446 [2024-10-13 16:47:23.733966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:58.446 [2024-10-13 16:47:23.827509] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:58.446 [2024-10-13 16:47:23.827694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:58.446 [2024-10-13 16:47:23.827714] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:58.446 [2024-10-13 16:47:23.827728] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:58.446 [2024-10-13 16:47:23.827814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:58.446 [2024-10-13 16:47:23.827871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:58.446 [2024-10-13 16:47:23.827924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:58.446 [2024-10-13 16:47:23.827926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:59.379 16:47:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:59.379 16:47:24 -- common/autotest_common.sh@852 -- # return 0 00:22:59.379 16:47:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:59.379 16:47:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:59.379 16:47:24 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 [2024-10-13 16:47:24.654015] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.379 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 Malloc1 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 [2024-10-13 16:47:24.709785] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.379 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 Malloc2 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.379 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 Malloc3 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.379 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 Malloc4 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:59.379 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.379 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.379 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.379 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.379 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:59.380 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.380 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.380 Malloc5 00:22:59.380 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.380 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:59.380 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.380 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.638 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 Malloc6 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.638 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 Malloc7 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.638 16:47:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:59.638 16:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:24 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 Malloc8 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.638 16:47:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 Malloc9 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.638 16:47:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 Malloc10 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.638 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.638 16:47:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:59.638 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.638 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.896 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.897 16:47:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.897 16:47:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:59.897 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.897 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.897 Malloc11 00:22:59.897 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.897 16:47:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:59.897 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.897 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.897 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.897 16:47:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:59.897 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.897 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.897 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.897 16:47:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:59.897 16:47:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.897 16:47:25 -- common/autotest_common.sh@10 -- # set +x 00:22:59.897 16:47:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.897 16:47:25 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:59.897 16:47:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.897 16:47:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:00.462 16:47:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:23:00.462 16:47:25 -- common/autotest_common.sh@1177 -- # local i=0 00:23:00.462 16:47:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:00.462 16:47:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:00.462 16:47:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:02.359 16:47:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:02.359 16:47:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:02.359 16:47:27 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:23:02.359 16:47:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:02.359 16:47:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:02.359 16:47:27 -- common/autotest_common.sh@1187 -- # return 0 00:23:02.359 16:47:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:02.359 16:47:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:23:03.290 16:47:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:23:03.290 16:47:28 -- common/autotest_common.sh@1177 -- # local i=0 00:23:03.290 16:47:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:03.290 16:47:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:03.290 16:47:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:05.188 16:47:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:05.188 16:47:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:05.188 16:47:30 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:23:05.188 16:47:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:05.188 16:47:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:05.188 16:47:30 -- common/autotest_common.sh@1187 -- # return 0 00:23:05.188 16:47:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:05.188 16:47:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:23:05.753 16:47:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:23:05.753 16:47:31 -- common/autotest_common.sh@1177 -- # local i=0 00:23:05.753 16:47:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:05.753 16:47:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:05.753 16:47:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:08.279 16:47:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:08.279 16:47:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:08.279 16:47:33 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:23:08.279 16:47:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:08.279 16:47:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:08.279 16:47:33 -- common/autotest_common.sh@1187 -- # return 0 00:23:08.279 16:47:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.279 16:47:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:23:08.535 16:47:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:23:08.535 16:47:33 -- common/autotest_common.sh@1177 -- # local i=0 00:23:08.535 16:47:33 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:08.535 16:47:33 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:08.535 16:47:33 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:11.061 16:47:35 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:11.061 16:47:35 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:11.061 16:47:35 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:23:11.061 16:47:35 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:11.061 16:47:35 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:11.061 16:47:35 -- common/autotest_common.sh@1187 -- # return 0 00:23:11.061 16:47:35 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.061 16:47:35 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:23:11.318 16:47:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:23:11.318 16:47:36 -- common/autotest_common.sh@1177 -- # local i=0 00:23:11.318 16:47:36 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:11.318 16:47:36 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:11.318 16:47:36 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:13.842 16:47:38 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:13.842 16:47:38 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:13.842 16:47:38 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:23:13.842 16:47:38 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:13.842 16:47:38 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:13.842 16:47:38 -- common/autotest_common.sh@1187 -- # return 0 00:23:13.842 16:47:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.842 16:47:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:23:14.099 16:47:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:23:14.099 16:47:39 -- common/autotest_common.sh@1177 -- # local i=0 00:23:14.099 16:47:39 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:14.099 16:47:39 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:14.099 16:47:39 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:16.662 16:47:41 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:16.662 16:47:41 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:16.662 16:47:41 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:23:16.662 16:47:41 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:16.662 16:47:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:16.662 16:47:41 -- common/autotest_common.sh@1187 -- # return 0 00:23:16.662 16:47:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:16.662 16:47:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:23:16.946 16:47:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:23:16.946 16:47:42 -- common/autotest_common.sh@1177 -- # local i=0 00:23:16.946 16:47:42 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:16.946 16:47:42 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:16.946 16:47:42 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:18.843 16:47:44 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:18.843 16:47:44 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:18.843 16:47:44 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:23:18.843 16:47:44 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:18.843 16:47:44 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:18.843 16:47:44 -- common/autotest_common.sh@1187 -- # return 0 00:23:18.843 16:47:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:18.843 16:47:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:23:19.776 16:47:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:23:19.776 16:47:45 -- common/autotest_common.sh@1177 -- # local i=0 00:23:19.776 16:47:45 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:19.776 16:47:45 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:19.776 16:47:45 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:21.674 16:47:47 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:21.674 16:47:47 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:21.674 16:47:47 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:23:21.674 16:47:47 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:21.674 16:47:47 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:21.674 16:47:47 -- common/autotest_common.sh@1187 -- # return 0 00:23:21.674 16:47:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:21.674 16:47:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:23:22.607 16:47:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:23:22.607 16:47:48 -- common/autotest_common.sh@1177 -- # local i=0 00:23:22.607 16:47:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:22.607 16:47:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:22.607 16:47:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:25.135 16:47:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:25.135 16:47:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:25.135 16:47:50 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:23:25.135 16:47:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:25.135 16:47:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:25.135 16:47:50 -- common/autotest_common.sh@1187 -- # return 0 00:23:25.135 16:47:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:25.135 16:47:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:23:25.700 16:47:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:23:25.700 16:47:51 -- common/autotest_common.sh@1177 -- # local i=0 00:23:25.700 16:47:51 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:25.700 16:47:51 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:25.700 16:47:51 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:27.598 16:47:53 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:27.598 16:47:53 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:27.598 16:47:53 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:23:27.598 16:47:53 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:27.598 16:47:53 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:27.598 16:47:53 -- common/autotest_common.sh@1187 -- # return 0 00:23:27.598 16:47:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:27.598 16:47:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:23:28.531 16:47:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:23:28.531 16:47:53 -- common/autotest_common.sh@1177 -- # local i=0 00:23:28.531 16:47:53 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:28.531 16:47:53 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:28.531 16:47:53 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:31.058 16:47:55 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:31.058 16:47:55 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:31.058 16:47:55 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:23:31.058 16:47:55 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:31.058 16:47:55 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:31.058 16:47:55 -- common/autotest_common.sh@1187 -- # return 0 00:23:31.058 16:47:55 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:23:31.058 [global] 00:23:31.058 thread=1 00:23:31.058 invalidate=1 00:23:31.058 rw=read 00:23:31.058 time_based=1 00:23:31.058 runtime=10 00:23:31.058 ioengine=libaio 00:23:31.058 direct=1 00:23:31.058 bs=262144 00:23:31.058 iodepth=64 00:23:31.058 norandommap=1 00:23:31.058 numjobs=1 00:23:31.058 00:23:31.058 [job0] 00:23:31.058 filename=/dev/nvme0n1 00:23:31.058 [job1] 00:23:31.058 filename=/dev/nvme10n1 00:23:31.058 [job2] 00:23:31.058 filename=/dev/nvme1n1 00:23:31.058 [job3] 00:23:31.058 filename=/dev/nvme2n1 00:23:31.058 [job4] 00:23:31.058 filename=/dev/nvme3n1 00:23:31.058 [job5] 00:23:31.058 filename=/dev/nvme4n1 00:23:31.058 [job6] 00:23:31.058 filename=/dev/nvme5n1 00:23:31.058 [job7] 00:23:31.058 filename=/dev/nvme6n1 00:23:31.058 [job8] 00:23:31.058 filename=/dev/nvme7n1 00:23:31.058 [job9] 00:23:31.058 filename=/dev/nvme8n1 00:23:31.058 [job10] 00:23:31.058 filename=/dev/nvme9n1 00:23:31.058 Could not set queue depth (nvme0n1) 00:23:31.058 Could not set queue depth (nvme10n1) 00:23:31.058 Could not set queue depth (nvme1n1) 00:23:31.058 Could not set queue depth (nvme2n1) 00:23:31.058 Could not set queue depth (nvme3n1) 00:23:31.058 Could not set queue depth (nvme4n1) 00:23:31.058 Could not set queue depth (nvme5n1) 00:23:31.058 Could not set queue depth (nvme6n1) 00:23:31.058 Could not set queue depth (nvme7n1) 00:23:31.058 Could not set queue depth (nvme8n1) 00:23:31.058 Could not set queue depth (nvme9n1) 00:23:31.058 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:31.058 fio-3.35 00:23:31.058 Starting 11 threads 00:23:43.260 00:23:43.260 job0: (groupid=0, jobs=1): err= 0: pid=1250070: Sun Oct 13 16:48:06 2024 00:23:43.260 read: IOPS=670, BW=168MiB/s (176MB/s)(1680MiB/10028msec) 00:23:43.260 slat (usec): min=9, max=76732, avg=943.20, stdev=3895.76 00:23:43.260 clat (usec): min=899, max=210721, avg=94515.45, stdev=41453.04 00:23:43.260 lat (usec): min=933, max=217199, avg=95458.65, stdev=41942.55 00:23:43.260 clat percentiles (msec): 00:23:43.260 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 37], 20.00th=[ 59], 00:23:43.260 | 30.00th=[ 75], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 106], 00:23:43.260 | 70.00th=[ 118], 80.00th=[ 131], 90.00th=[ 148], 95.00th=[ 161], 00:23:43.260 | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 199], 99.95th=[ 207], 00:23:43.260 | 99.99th=[ 211] 00:23:43.260 bw ( KiB/s): min=110080, max=255488, per=8.45%, avg=170362.20, stdev=41009.66, samples=20 00:23:43.260 iops : min= 430, max= 998, avg=665.40, stdev=160.22, samples=20 00:23:43.260 lat (usec) : 1000=0.01% 00:23:43.260 lat (msec) : 2=0.01%, 4=0.21%, 10=2.53%, 20=3.18%, 50=9.61% 00:23:43.260 lat (msec) : 100=38.70%, 250=45.74% 00:23:43.260 cpu : usr=0.41%, sys=1.92%, ctx=1509, majf=0, minf=4097 00:23:43.260 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:43.260 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.260 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.260 issued rwts: total=6719,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.260 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.260 job1: (groupid=0, jobs=1): err= 0: pid=1250071: Sun Oct 13 16:48:06 2024 00:23:43.260 read: IOPS=708, BW=177MiB/s (186MB/s)(1783MiB/10068msec) 00:23:43.260 slat (usec): min=13, max=78995, avg=1235.83, stdev=4302.76 00:23:43.260 clat (usec): min=1850, max=247977, avg=89032.52, stdev=41381.43 00:23:43.260 lat (usec): min=1877, max=248051, avg=90268.35, stdev=42042.89 00:23:43.260 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 48], 00:23:43.261 | 30.00th=[ 66], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 97], 00:23:43.261 | 70.00th=[ 114], 80.00th=[ 128], 90.00th=[ 142], 95.00th=[ 161], 00:23:43.261 | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 203], 99.95th=[ 232], 00:23:43.261 | 99.99th=[ 249] 00:23:43.261 bw ( KiB/s): min=98501, max=517120, per=8.97%, avg=180917.00, stdev=87795.71, samples=20 00:23:43.261 iops : min= 384, max= 2020, avg=706.60, stdev=343.01, samples=20 00:23:43.261 lat (msec) : 2=0.01%, 4=0.06%, 10=0.36%, 20=0.52%, 50=20.34% 00:23:43.261 lat (msec) : 100=40.48%, 250=38.22% 00:23:43.261 cpu : usr=0.41%, sys=2.49%, ctx=1364, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=7132,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job2: (groupid=0, jobs=1): err= 0: pid=1250072: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=732, BW=183MiB/s (192MB/s)(1844MiB/10071msec) 00:23:43.261 slat (usec): min=8, max=76783, avg=1082.09, stdev=4006.99 00:23:43.261 clat (usec): min=1210, max=223158, avg=86235.34, stdev=45427.33 00:23:43.261 lat (usec): min=1243, max=258904, avg=87317.43, stdev=46136.28 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 43], 00:23:43.261 | 30.00th=[ 55], 40.00th=[ 69], 50.00th=[ 81], 60.00th=[ 94], 00:23:43.261 | 70.00th=[ 115], 80.00th=[ 130], 90.00th=[ 150], 95.00th=[ 165], 00:23:43.261 | 99.00th=[ 192], 99.50th=[ 205], 99.90th=[ 218], 99.95th=[ 218], 00:23:43.261 | 99.99th=[ 224] 00:23:43.261 bw ( KiB/s): min=97792, max=418816, per=9.28%, avg=187182.05, stdev=81489.86, samples=20 00:23:43.261 iops : min= 382, max= 1636, avg=731.15, stdev=318.33, samples=20 00:23:43.261 lat (msec) : 2=0.01%, 4=0.19%, 10=0.95%, 20=2.09%, 50=22.95% 00:23:43.261 lat (msec) : 100=36.32%, 250=37.49% 00:23:43.261 cpu : usr=0.38%, sys=2.39%, ctx=1380, majf=0, minf=3722 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=7376,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job3: (groupid=0, jobs=1): err= 0: pid=1250073: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=765, BW=191MiB/s (201MB/s)(1928MiB/10076msec) 00:23:43.261 slat (usec): min=8, max=97786, avg=909.61, stdev=4251.77 00:23:43.261 clat (usec): min=801, max=276895, avg=82648.01, stdev=51332.83 00:23:43.261 lat (usec): min=857, max=276908, avg=83557.62, stdev=52011.03 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 5], 5.00th=[ 10], 10.00th=[ 20], 20.00th=[ 33], 00:23:43.261 | 30.00th=[ 47], 40.00th=[ 62], 50.00th=[ 75], 60.00th=[ 90], 00:23:43.261 | 70.00th=[ 112], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 174], 00:23:43.261 | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 230], 99.95th=[ 266], 00:23:43.261 | 99.99th=[ 279] 00:23:43.261 bw ( KiB/s): min=95744, max=474112, per=9.71%, avg=195799.15, stdev=83170.71, samples=20 00:23:43.261 iops : min= 374, max= 1852, avg=764.75, stdev=324.92, samples=20 00:23:43.261 lat (usec) : 1000=0.01% 00:23:43.261 lat (msec) : 2=0.04%, 4=0.49%, 10=4.76%, 20=4.93%, 50=21.36% 00:23:43.261 lat (msec) : 100=33.71%, 250=34.63%, 500=0.06% 00:23:43.261 cpu : usr=0.30%, sys=2.15%, ctx=1584, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=7712,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job4: (groupid=0, jobs=1): err= 0: pid=1250074: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=628, BW=157MiB/s (165MB/s)(1583MiB/10070msec) 00:23:43.261 slat (usec): min=9, max=99568, avg=1079.18, stdev=4579.08 00:23:43.261 clat (usec): min=1465, max=273031, avg=100617.85, stdev=46201.16 00:23:43.261 lat (usec): min=1485, max=277791, avg=101697.02, stdev=46932.34 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 10], 5.00th=[ 21], 10.00th=[ 39], 20.00th=[ 59], 00:23:43.261 | 30.00th=[ 74], 40.00th=[ 88], 50.00th=[ 100], 60.00th=[ 116], 00:23:43.261 | 70.00th=[ 130], 80.00th=[ 142], 90.00th=[ 161], 95.00th=[ 178], 00:23:43.261 | 99.00th=[ 199], 99.50th=[ 201], 99.90th=[ 224], 99.95th=[ 251], 00:23:43.261 | 99.99th=[ 275] 00:23:43.261 bw ( KiB/s): min=94208, max=226304, per=7.96%, avg=160491.00, stdev=37300.32, samples=20 00:23:43.261 iops : min= 368, max= 884, avg=626.85, stdev=145.69, samples=20 00:23:43.261 lat (msec) : 2=0.03%, 4=0.05%, 10=1.04%, 20=3.54%, 50=10.72% 00:23:43.261 lat (msec) : 100=35.20%, 250=49.36%, 500=0.06% 00:23:43.261 cpu : usr=0.31%, sys=1.86%, ctx=1376, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=6333,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job5: (groupid=0, jobs=1): err= 0: pid=1250075: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=603, BW=151MiB/s (158MB/s)(1517MiB/10059msec) 00:23:43.261 slat (usec): min=9, max=109974, avg=668.47, stdev=4064.65 00:23:43.261 clat (usec): min=1882, max=251516, avg=105341.99, stdev=46101.89 00:23:43.261 lat (usec): min=1948, max=290443, avg=106010.46, stdev=46560.09 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 7], 5.00th=[ 24], 10.00th=[ 41], 20.00th=[ 63], 00:23:43.261 | 30.00th=[ 83], 40.00th=[ 94], 50.00th=[ 109], 60.00th=[ 122], 00:23:43.261 | 70.00th=[ 134], 80.00th=[ 146], 90.00th=[ 165], 95.00th=[ 176], 00:23:43.261 | 99.00th=[ 197], 99.50th=[ 205], 99.90th=[ 213], 99.95th=[ 241], 00:23:43.261 | 99.99th=[ 251] 00:23:43.261 bw ( KiB/s): min=92672, max=260608, per=7.63%, avg=153751.85, stdev=44030.04, samples=20 00:23:43.261 iops : min= 362, max= 1018, avg=600.55, stdev=172.04, samples=20 00:23:43.261 lat (msec) : 2=0.02%, 4=0.02%, 10=1.85%, 20=2.59%, 50=9.34% 00:23:43.261 lat (msec) : 100=30.57%, 250=55.59%, 500=0.03% 00:23:43.261 cpu : usr=0.31%, sys=1.64%, ctx=1565, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=6069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job6: (groupid=0, jobs=1): err= 0: pid=1250076: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=727, BW=182MiB/s (191MB/s)(1833MiB/10079msec) 00:23:43.261 slat (usec): min=9, max=95135, avg=1034.65, stdev=3689.11 00:23:43.261 clat (usec): min=803, max=230343, avg=86854.20, stdev=46806.57 00:23:43.261 lat (usec): min=838, max=230388, avg=87888.85, stdev=47440.81 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 31], 20.00th=[ 41], 00:23:43.261 | 30.00th=[ 59], 40.00th=[ 73], 50.00th=[ 84], 60.00th=[ 95], 00:23:43.261 | 70.00th=[ 108], 80.00th=[ 129], 90.00th=[ 155], 95.00th=[ 174], 00:23:43.261 | 99.00th=[ 194], 99.50th=[ 201], 99.90th=[ 213], 99.95th=[ 215], 00:23:43.261 | 99.99th=[ 230] 00:23:43.261 bw ( KiB/s): min=88576, max=443392, per=9.23%, avg=186083.65, stdev=84116.48, samples=20 00:23:43.261 iops : min= 346, max= 1732, avg=726.80, stdev=328.63, samples=20 00:23:43.261 lat (usec) : 1000=0.01% 00:23:43.261 lat (msec) : 2=0.05%, 4=1.16%, 10=2.93%, 20=1.55%, 50=18.71% 00:23:43.261 lat (msec) : 100=40.08%, 250=35.50% 00:23:43.261 cpu : usr=0.41%, sys=2.34%, ctx=1438, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=7333,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job7: (groupid=0, jobs=1): err= 0: pid=1250077: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=840, BW=210MiB/s (220MB/s)(2106MiB/10027msec) 00:23:43.261 slat (usec): min=13, max=68945, avg=1082.45, stdev=3564.24 00:23:43.261 clat (msec): min=4, max=208, avg=75.03, stdev=34.86 00:23:43.261 lat (msec): min=4, max=217, avg=76.11, stdev=35.33 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 32], 20.00th=[ 40], 00:23:43.261 | 30.00th=[ 53], 40.00th=[ 64], 50.00th=[ 73], 60.00th=[ 82], 00:23:43.261 | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 123], 95.00th=[ 140], 00:23:43.261 | 99.00th=[ 167], 99.50th=[ 180], 99.90th=[ 197], 99.95th=[ 205], 00:23:43.261 | 99.99th=[ 209] 00:23:43.261 bw ( KiB/s): min=119296, max=390898, per=10.61%, avg=213993.00, stdev=81307.12, samples=20 00:23:43.261 iops : min= 466, max= 1526, avg=835.85, stdev=317.47, samples=20 00:23:43.261 lat (msec) : 10=0.40%, 20=0.55%, 50=26.74%, 100=49.65%, 250=22.66% 00:23:43.261 cpu : usr=0.56%, sys=2.85%, ctx=1500, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:43.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.261 issued rwts: total=8425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.261 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.261 job8: (groupid=0, jobs=1): err= 0: pid=1250080: Sun Oct 13 16:48:06 2024 00:23:43.261 read: IOPS=684, BW=171MiB/s (179MB/s)(1720MiB/10058msec) 00:23:43.261 slat (usec): min=8, max=99897, avg=1101.37, stdev=4047.90 00:23:43.261 clat (usec): min=1262, max=214604, avg=92386.43, stdev=51723.95 00:23:43.261 lat (usec): min=1282, max=217527, avg=93487.80, stdev=52426.83 00:23:43.261 clat percentiles (msec): 00:23:43.261 | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 22], 20.00th=[ 32], 00:23:43.261 | 30.00th=[ 58], 40.00th=[ 78], 50.00th=[ 94], 60.00th=[ 114], 00:23:43.261 | 70.00th=[ 130], 80.00th=[ 142], 90.00th=[ 161], 95.00th=[ 174], 00:23:43.261 | 99.00th=[ 190], 99.50th=[ 192], 99.90th=[ 201], 99.95th=[ 203], 00:23:43.261 | 99.99th=[ 215] 00:23:43.261 bw ( KiB/s): min=99840, max=435200, per=8.66%, avg=174514.75, stdev=87744.73, samples=20 00:23:43.261 iops : min= 390, max= 1700, avg=681.65, stdev=342.78, samples=20 00:23:43.261 lat (msec) : 2=0.03%, 4=0.15%, 10=1.86%, 20=6.60%, 50=18.21% 00:23:43.261 lat (msec) : 100=26.46%, 250=46.69% 00:23:43.261 cpu : usr=0.32%, sys=2.18%, ctx=1527, majf=0, minf=4097 00:23:43.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:43.262 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.262 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.262 issued rwts: total=6881,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.262 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.262 job9: (groupid=0, jobs=1): err= 0: pid=1250081: Sun Oct 13 16:48:06 2024 00:23:43.262 read: IOPS=613, BW=153MiB/s (161MB/s)(1545MiB/10080msec) 00:23:43.262 slat (usec): min=8, max=121619, avg=1066.08, stdev=4543.46 00:23:43.262 clat (usec): min=712, max=292512, avg=103226.55, stdev=51364.67 00:23:43.262 lat (usec): min=735, max=292545, avg=104292.63, stdev=51999.56 00:23:43.262 clat percentiles (msec): 00:23:43.262 | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 27], 20.00th=[ 60], 00:23:43.262 | 30.00th=[ 77], 40.00th=[ 91], 50.00th=[ 106], 60.00th=[ 121], 00:23:43.262 | 70.00th=[ 134], 80.00th=[ 148], 90.00th=[ 171], 95.00th=[ 184], 00:23:43.262 | 99.00th=[ 205], 99.50th=[ 213], 99.90th=[ 222], 99.95th=[ 228], 00:23:43.262 | 99.99th=[ 292] 00:23:43.262 bw ( KiB/s): min=102912, max=258048, per=7.77%, avg=156587.30, stdev=48440.04, samples=20 00:23:43.262 iops : min= 402, max= 1008, avg=611.65, stdev=189.21, samples=20 00:23:43.262 lat (usec) : 750=0.06%, 1000=0.11% 00:23:43.262 lat (msec) : 2=0.26%, 4=1.00%, 10=6.03%, 20=1.73%, 50=5.89% 00:23:43.262 lat (msec) : 100=31.53%, 250=53.32%, 500=0.05% 00:23:43.262 cpu : usr=0.31%, sys=1.85%, ctx=1473, majf=0, minf=4098 00:23:43.262 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:43.262 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.262 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.262 issued rwts: total=6181,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.262 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.262 job10: (groupid=0, jobs=1): err= 0: pid=1250082: Sun Oct 13 16:48:06 2024 00:23:43.262 read: IOPS=916, BW=229MiB/s (240MB/s)(2307MiB/10072msec) 00:23:43.262 slat (usec): min=9, max=77940, avg=935.15, stdev=3382.41 00:23:43.262 clat (msec): min=2, max=240, avg=68.87, stdev=44.54 00:23:43.262 lat (msec): min=2, max=240, avg=69.81, stdev=45.10 00:23:43.262 clat percentiles (msec): 00:23:43.262 | 1.00th=[ 12], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 32], 00:23:43.262 | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 58], 60.00th=[ 72], 00:23:43.262 | 70.00th=[ 87], 80.00th=[ 103], 90.00th=[ 132], 95.00th=[ 165], 00:23:43.262 | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 236], 99.95th=[ 239], 00:23:43.262 | 99.99th=[ 241] 00:23:43.262 bw ( KiB/s): min=86016, max=518144, per=11.64%, avg=234627.55, stdev=133372.01, samples=20 00:23:43.262 iops : min= 336, max= 2024, avg=916.50, stdev=521.00, samples=20 00:23:43.262 lat (msec) : 4=0.12%, 10=0.60%, 20=2.08%, 50=43.17%, 100=32.94% 00:23:43.262 lat (msec) : 250=21.09% 00:23:43.262 cpu : usr=0.39%, sys=2.80%, ctx=1738, majf=0, minf=4097 00:23:43.262 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:23:43.262 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:43.262 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:43.262 issued rwts: total=9228,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:43.262 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:43.262 00:23:43.262 Run status group 0 (all jobs): 00:23:43.262 READ: bw=1969MiB/s (2065MB/s), 151MiB/s-229MiB/s (158MB/s-240MB/s), io=19.4GiB (20.8GB), run=10027-10080msec 00:23:43.262 00:23:43.262 Disk stats (read/write): 00:23:43.262 nvme0n1: ios=13218/0, merge=0/0, ticks=1241696/0, in_queue=1241696, util=97.17% 00:23:43.262 nvme10n1: ios=14014/0, merge=0/0, ticks=1233581/0, in_queue=1233581, util=97.38% 00:23:43.262 nvme1n1: ios=14516/0, merge=0/0, ticks=1239537/0, in_queue=1239537, util=97.68% 00:23:43.262 nvme2n1: ios=15215/0, merge=0/0, ticks=1240460/0, in_queue=1240460, util=97.81% 00:23:43.262 nvme3n1: ios=12450/0, merge=0/0, ticks=1238661/0, in_queue=1238661, util=97.91% 00:23:43.262 nvme4n1: ios=11892/0, merge=0/0, ticks=1248812/0, in_queue=1248812, util=98.24% 00:23:43.262 nvme5n1: ios=14441/0, merge=0/0, ticks=1238454/0, in_queue=1238454, util=98.41% 00:23:43.262 nvme6n1: ios=16658/0, merge=0/0, ticks=1235578/0, in_queue=1235578, util=98.51% 00:23:43.262 nvme7n1: ios=13545/0, merge=0/0, ticks=1237457/0, in_queue=1237457, util=98.93% 00:23:43.262 nvme8n1: ios=12144/0, merge=0/0, ticks=1238461/0, in_queue=1238461, util=99.12% 00:23:43.262 nvme9n1: ios=18261/0, merge=0/0, ticks=1236190/0, in_queue=1236190, util=99.21% 00:23:43.262 16:48:06 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:43.262 [global] 00:23:43.262 thread=1 00:23:43.262 invalidate=1 00:23:43.262 rw=randwrite 00:23:43.262 time_based=1 00:23:43.262 runtime=10 00:23:43.262 ioengine=libaio 00:23:43.262 direct=1 00:23:43.262 bs=262144 00:23:43.262 iodepth=64 00:23:43.262 norandommap=1 00:23:43.262 numjobs=1 00:23:43.262 00:23:43.262 [job0] 00:23:43.262 filename=/dev/nvme0n1 00:23:43.262 [job1] 00:23:43.262 filename=/dev/nvme10n1 00:23:43.262 [job2] 00:23:43.262 filename=/dev/nvme1n1 00:23:43.262 [job3] 00:23:43.262 filename=/dev/nvme2n1 00:23:43.262 [job4] 00:23:43.262 filename=/dev/nvme3n1 00:23:43.262 [job5] 00:23:43.262 filename=/dev/nvme4n1 00:23:43.262 [job6] 00:23:43.262 filename=/dev/nvme5n1 00:23:43.262 [job7] 00:23:43.262 filename=/dev/nvme6n1 00:23:43.262 [job8] 00:23:43.262 filename=/dev/nvme7n1 00:23:43.262 [job9] 00:23:43.262 filename=/dev/nvme8n1 00:23:43.262 [job10] 00:23:43.262 filename=/dev/nvme9n1 00:23:43.262 Could not set queue depth (nvme0n1) 00:23:43.262 Could not set queue depth (nvme10n1) 00:23:43.262 Could not set queue depth (nvme1n1) 00:23:43.262 Could not set queue depth (nvme2n1) 00:23:43.262 Could not set queue depth (nvme3n1) 00:23:43.262 Could not set queue depth (nvme4n1) 00:23:43.262 Could not set queue depth (nvme5n1) 00:23:43.262 Could not set queue depth (nvme6n1) 00:23:43.262 Could not set queue depth (nvme7n1) 00:23:43.262 Could not set queue depth (nvme8n1) 00:23:43.262 Could not set queue depth (nvme9n1) 00:23:43.262 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:43.262 fio-3.35 00:23:43.262 Starting 11 threads 00:23:53.241 00:23:53.241 job0: (groupid=0, jobs=1): err= 0: pid=1251322: Sun Oct 13 16:48:17 2024 00:23:53.241 write: IOPS=374, BW=93.7MiB/s (98.2MB/s)(949MiB/10131msec); 0 zone resets 00:23:53.241 slat (usec): min=26, max=65159, avg=2395.61, stdev=5356.29 00:23:53.241 clat (msec): min=8, max=394, avg=168.33, stdev=67.09 00:23:53.241 lat (msec): min=11, max=394, avg=170.73, stdev=67.91 00:23:53.241 clat percentiles (msec): 00:23:53.241 | 1.00th=[ 20], 5.00th=[ 82], 10.00th=[ 106], 20.00th=[ 120], 00:23:53.241 | 30.00th=[ 130], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 178], 00:23:53.241 | 70.00th=[ 197], 80.00th=[ 213], 90.00th=[ 264], 95.00th=[ 300], 00:23:53.241 | 99.00th=[ 376], 99.50th=[ 380], 99.90th=[ 393], 99.95th=[ 397], 00:23:53.241 | 99.99th=[ 397] 00:23:53.241 bw ( KiB/s): min=45056, max=155648, per=6.58%, avg=95552.70, stdev=28865.30, samples=20 00:23:53.241 iops : min= 176, max= 608, avg=373.25, stdev=112.75, samples=20 00:23:53.241 lat (msec) : 10=0.03%, 20=1.11%, 50=1.69%, 100=5.87%, 250=78.69% 00:23:53.241 lat (msec) : 500=12.62% 00:23:53.241 cpu : usr=1.29%, sys=1.08%, ctx=1310, majf=0, minf=1 00:23:53.241 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:23:53.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.241 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.241 issued rwts: total=0,3796,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.241 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.241 job1: (groupid=0, jobs=1): err= 0: pid=1251377: Sun Oct 13 16:48:17 2024 00:23:53.241 write: IOPS=299, BW=75.0MiB/s (78.6MB/s)(763MiB/10174msec); 0 zone resets 00:23:53.241 slat (usec): min=23, max=107329, avg=3088.78, stdev=6896.59 00:23:53.241 clat (msec): min=7, max=451, avg=210.22, stdev=71.24 00:23:53.241 lat (msec): min=9, max=451, avg=213.31, stdev=72.13 00:23:53.241 clat percentiles (msec): 00:23:53.241 | 1.00th=[ 22], 5.00th=[ 89], 10.00th=[ 127], 20.00th=[ 165], 00:23:53.241 | 30.00th=[ 180], 40.00th=[ 192], 50.00th=[ 211], 60.00th=[ 224], 00:23:53.241 | 70.00th=[ 236], 80.00th=[ 255], 90.00th=[ 305], 95.00th=[ 342], 00:23:53.241 | 99.00th=[ 393], 99.50th=[ 401], 99.90th=[ 435], 99.95th=[ 451], 00:23:53.241 | 99.99th=[ 451] 00:23:53.241 bw ( KiB/s): min=45056, max=139776, per=5.27%, avg=76459.40, stdev=23571.62, samples=20 00:23:53.241 iops : min= 176, max= 546, avg=298.65, stdev=92.08, samples=20 00:23:53.241 lat (msec) : 10=0.10%, 20=0.82%, 50=1.77%, 100=2.75%, 250=72.30% 00:23:53.241 lat (msec) : 500=22.25% 00:23:53.241 cpu : usr=0.85%, sys=1.08%, ctx=995, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=97.9% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,3051,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job2: (groupid=0, jobs=1): err= 0: pid=1251398: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=420, BW=105MiB/s (110MB/s)(1070MiB/10177msec); 0 zone resets 00:23:53.242 slat (usec): min=18, max=316202, avg=1962.40, stdev=8073.19 00:23:53.242 clat (usec): min=861, max=638707, avg=150037.02, stdev=102121.60 00:23:53.242 lat (usec): min=945, max=638754, avg=151999.42, stdev=103331.15 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 3], 5.00th=[ 14], 10.00th=[ 25], 20.00th=[ 64], 00:23:53.242 | 30.00th=[ 88], 40.00th=[ 109], 50.00th=[ 113], 60.00th=[ 169], 00:23:53.242 | 70.00th=[ 218], 80.00th=[ 239], 90.00th=[ 275], 95.00th=[ 313], 00:23:53.242 | 99.00th=[ 447], 99.50th=[ 567], 99.90th=[ 592], 99.95th=[ 625], 00:23:53.242 | 99.99th=[ 642] 00:23:53.242 bw ( KiB/s): min=44544, max=229888, per=7.44%, avg=107994.05, stdev=52193.85, samples=20 00:23:53.242 iops : min= 174, max= 898, avg=421.85, stdev=203.88, samples=20 00:23:53.242 lat (usec) : 1000=0.02% 00:23:53.242 lat (msec) : 2=0.51%, 4=1.28%, 10=1.73%, 20=4.41%, 50=8.90% 00:23:53.242 lat (msec) : 100=15.88%, 250=50.22%, 500=16.28%, 750=0.75% 00:23:53.242 cpu : usr=1.38%, sys=1.24%, ctx=2136, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,4281,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job3: (groupid=0, jobs=1): err= 0: pid=1251399: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=798, BW=200MiB/s (209MB/s)(2025MiB/10137msec); 0 zone resets 00:23:53.242 slat (usec): min=14, max=81574, avg=894.37, stdev=2668.68 00:23:53.242 clat (usec): min=692, max=326923, avg=79178.60, stdev=61552.95 00:23:53.242 lat (usec): min=744, max=326955, avg=80072.97, stdev=62208.93 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 8], 5.00th=[ 17], 10.00th=[ 32], 20.00th=[ 41], 00:23:53.242 | 30.00th=[ 42], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 66], 00:23:53.242 | 70.00th=[ 81], 80.00th=[ 128], 90.00th=[ 186], 95.00th=[ 211], 00:23:53.242 | 99.00th=[ 247], 99.50th=[ 284], 99.90th=[ 313], 99.95th=[ 317], 00:23:53.242 | 99.99th=[ 326] 00:23:53.242 bw ( KiB/s): min=73216, max=415232, per=14.17%, avg=205751.05, stdev=115127.16, samples=20 00:23:53.242 iops : min= 286, max= 1622, avg=803.70, stdev=449.70, samples=20 00:23:53.242 lat (usec) : 750=0.04%, 1000=0.02% 00:23:53.242 lat (msec) : 2=0.06%, 4=0.25%, 10=1.28%, 20=4.86%, 50=46.07% 00:23:53.242 lat (msec) : 100=23.25%, 250=23.24%, 500=0.93% 00:23:53.242 cpu : usr=2.31%, sys=2.34%, ctx=4023, majf=0, minf=2 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,8099,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job4: (groupid=0, jobs=1): err= 0: pid=1251402: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=450, BW=113MiB/s (118MB/s)(1142MiB/10133msec); 0 zone resets 00:23:53.242 slat (usec): min=16, max=252135, avg=1632.51, stdev=6743.16 00:23:53.242 clat (usec): min=1351, max=421208, avg=140248.34, stdev=77921.54 00:23:53.242 lat (usec): min=1387, max=421334, avg=141880.85, stdev=78740.28 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 28], 20.00th=[ 80], 00:23:53.242 | 30.00th=[ 104], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 155], 00:23:53.242 | 70.00th=[ 180], 80.00th=[ 205], 90.00th=[ 232], 95.00th=[ 279], 00:23:53.242 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 405], 99.95th=[ 405], 00:23:53.242 | 99.99th=[ 422] 00:23:53.242 bw ( KiB/s): min=72192, max=162816, per=7.94%, avg=115319.35, stdev=31505.33, samples=20 00:23:53.242 iops : min= 282, max= 636, avg=450.45, stdev=123.08, samples=20 00:23:53.242 lat (msec) : 2=0.07%, 4=0.83%, 10=1.42%, 20=3.42%, 50=10.31% 00:23:53.242 lat (msec) : 100=10.62%, 250=65.94%, 500=7.40% 00:23:53.242 cpu : usr=1.36%, sys=1.52%, ctx=2333, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,4568,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job5: (groupid=0, jobs=1): err= 0: pid=1251409: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=652, BW=163MiB/s (171MB/s)(1652MiB/10135msec); 0 zone resets 00:23:53.242 slat (usec): min=20, max=131066, avg=1213.80, stdev=3841.36 00:23:53.242 clat (msec): min=2, max=433, avg=96.82, stdev=70.94 00:23:53.242 lat (msec): min=2, max=433, avg=98.04, stdev=71.78 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 9], 5.00th=[ 40], 10.00th=[ 42], 20.00th=[ 44], 00:23:53.242 | 30.00th=[ 45], 40.00th=[ 63], 50.00th=[ 78], 60.00th=[ 83], 00:23:53.242 | 70.00th=[ 103], 80.00th=[ 155], 90.00th=[ 199], 95.00th=[ 215], 00:23:53.242 | 99.00th=[ 372], 99.50th=[ 401], 99.90th=[ 430], 99.95th=[ 430], 00:23:53.242 | 99.99th=[ 435] 00:23:53.242 bw ( KiB/s): min=64641, max=371712, per=11.54%, avg=167584.05, stdev=97053.58, samples=20 00:23:53.242 iops : min= 252, max= 1452, avg=654.60, stdev=379.14, samples=20 00:23:53.242 lat (msec) : 4=0.32%, 10=0.94%, 20=1.32%, 50=32.08%, 100=34.24% 00:23:53.242 lat (msec) : 250=28.14%, 500=2.97% 00:23:53.242 cpu : usr=2.06%, sys=2.08%, ctx=2594, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,6609,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job6: (groupid=0, jobs=1): err= 0: pid=1251410: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=598, BW=150MiB/s (157MB/s)(1523MiB/10178msec); 0 zone resets 00:23:53.242 slat (usec): min=16, max=46144, avg=1200.11, stdev=3119.92 00:23:53.242 clat (usec): min=1405, max=444378, avg=105659.58, stdev=57126.83 00:23:53.242 lat (usec): min=1443, max=444420, avg=106859.69, stdev=57838.84 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 36], 20.00th=[ 53], 00:23:53.242 | 30.00th=[ 81], 40.00th=[ 94], 50.00th=[ 104], 60.00th=[ 113], 00:23:53.242 | 70.00th=[ 127], 80.00th=[ 144], 90.00th=[ 184], 95.00th=[ 207], 00:23:53.242 | 99.00th=[ 245], 99.50th=[ 330], 99.90th=[ 430], 99.95th=[ 439], 00:23:53.242 | 99.99th=[ 443] 00:23:53.242 bw ( KiB/s): min=77824, max=284160, per=10.63%, avg=154344.30, stdev=61137.45, samples=20 00:23:53.242 iops : min= 304, max= 1110, avg=602.90, stdev=238.80, samples=20 00:23:53.242 lat (msec) : 2=0.05%, 4=0.41%, 10=2.05%, 20=3.27%, 50=13.35% 00:23:53.242 lat (msec) : 100=25.96%, 250=54.03%, 500=0.89% 00:23:53.242 cpu : usr=1.59%, sys=1.62%, ctx=2824, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,6091,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job7: (groupid=0, jobs=1): err= 0: pid=1251414: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=576, BW=144MiB/s (151MB/s)(1448MiB/10037msec); 0 zone resets 00:23:53.242 slat (usec): min=18, max=288672, avg=1471.84, stdev=6142.68 00:23:53.242 clat (usec): min=1022, max=430205, avg=109434.49, stdev=82136.51 00:23:53.242 lat (usec): min=1068, max=430506, avg=110906.33, stdev=82957.63 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 6], 5.00th=[ 19], 10.00th=[ 30], 20.00th=[ 55], 00:23:53.242 | 30.00th=[ 77], 40.00th=[ 80], 50.00th=[ 84], 60.00th=[ 106], 00:23:53.242 | 70.00th=[ 113], 80.00th=[ 116], 90.00th=[ 257], 95.00th=[ 317], 00:23:53.242 | 99.00th=[ 359], 99.50th=[ 376], 99.90th=[ 414], 99.95th=[ 430], 00:23:53.242 | 99.99th=[ 430] 00:23:53.242 bw ( KiB/s): min=43520, max=292352, per=10.10%, avg=146611.20, stdev=65029.47, samples=20 00:23:53.242 iops : min= 170, max= 1142, avg=572.70, stdev=254.02, samples=20 00:23:53.242 lat (msec) : 2=0.10%, 4=0.36%, 10=2.45%, 20=2.59%, 50=13.87% 00:23:53.242 lat (msec) : 100=37.06%, 250=33.25%, 500=10.31% 00:23:53.242 cpu : usr=1.74%, sys=1.35%, ctx=2364, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,5790,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job8: (groupid=0, jobs=1): err= 0: pid=1251415: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=562, BW=141MiB/s (147MB/s)(1430MiB/10176msec); 0 zone resets 00:23:53.242 slat (usec): min=16, max=85620, avg=1224.45, stdev=3580.85 00:23:53.242 clat (usec): min=794, max=468633, avg=112552.68, stdev=79245.70 00:23:53.242 lat (usec): min=826, max=468666, avg=113777.13, stdev=80015.23 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 18], 20.00th=[ 37], 00:23:53.242 | 30.00th=[ 75], 40.00th=[ 81], 50.00th=[ 105], 60.00th=[ 113], 00:23:53.242 | 70.00th=[ 133], 80.00th=[ 180], 90.00th=[ 228], 95.00th=[ 279], 00:23:53.242 | 99.00th=[ 326], 99.50th=[ 368], 99.90th=[ 451], 99.95th=[ 451], 00:23:53.242 | 99.99th=[ 468] 00:23:53.242 bw ( KiB/s): min=59392, max=297472, per=9.98%, avg=144852.60, stdev=58156.38, samples=20 00:23:53.242 iops : min= 232, max= 1162, avg=565.80, stdev=227.21, samples=20 00:23:53.242 lat (usec) : 1000=0.14% 00:23:53.242 lat (msec) : 2=0.31%, 4=0.94%, 10=3.09%, 20=7.36%, 50=11.96% 00:23:53.242 lat (msec) : 100=24.86%, 250=43.84%, 500=7.50% 00:23:53.242 cpu : usr=1.58%, sys=1.76%, ctx=3164, majf=0, minf=1 00:23:53.242 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:53.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.242 issued rwts: total=0,5721,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.242 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.242 job9: (groupid=0, jobs=1): err= 0: pid=1251418: Sun Oct 13 16:48:17 2024 00:23:53.242 write: IOPS=565, BW=141MiB/s (148MB/s)(1423MiB/10072msec); 0 zone resets 00:23:53.242 slat (usec): min=18, max=124274, avg=1550.89, stdev=4653.71 00:23:53.242 clat (usec): min=971, max=400328, avg=111648.59, stdev=93297.30 00:23:53.242 lat (usec): min=1016, max=405458, avg=113199.47, stdev=94552.70 00:23:53.242 clat percentiles (msec): 00:23:53.242 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 30], 20.00th=[ 43], 00:23:53.243 | 30.00th=[ 45], 40.00th=[ 47], 50.00th=[ 62], 60.00th=[ 88], 00:23:53.243 | 70.00th=[ 165], 80.00th=[ 224], 90.00th=[ 259], 95.00th=[ 284], 00:23:53.243 | 99.00th=[ 334], 99.50th=[ 355], 99.90th=[ 380], 99.95th=[ 393], 00:23:53.243 | 99.99th=[ 401] 00:23:53.243 bw ( KiB/s): min=55296, max=364544, per=9.92%, avg=144094.70, stdev=99934.83, samples=20 00:23:53.243 iops : min= 216, max= 1424, avg=562.85, stdev=390.38, samples=20 00:23:53.243 lat (usec) : 1000=0.02% 00:23:53.243 lat (msec) : 2=0.25%, 4=1.26%, 10=2.44%, 20=3.07%, 50=39.79% 00:23:53.243 lat (msec) : 100=16.48%, 250=25.04%, 500=11.65% 00:23:53.243 cpu : usr=1.75%, sys=1.69%, ctx=2358, majf=0, minf=1 00:23:53.243 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:53.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.243 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.243 issued rwts: total=0,5692,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.243 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.243 job10: (groupid=0, jobs=1): err= 0: pid=1251419: Sun Oct 13 16:48:17 2024 00:23:53.243 write: IOPS=399, BW=100.0MiB/s (105MB/s)(1007MiB/10074msec); 0 zone resets 00:23:53.243 slat (usec): min=17, max=147951, avg=1970.37, stdev=5636.31 00:23:53.243 clat (usec): min=1414, max=492259, avg=157966.45, stdev=85203.27 00:23:53.243 lat (msec): min=2, max=492, avg=159.94, stdev=86.41 00:23:53.243 clat percentiles (msec): 00:23:53.243 | 1.00th=[ 7], 5.00th=[ 28], 10.00th=[ 50], 20.00th=[ 72], 00:23:53.243 | 30.00th=[ 86], 40.00th=[ 112], 50.00th=[ 182], 60.00th=[ 205], 00:23:53.243 | 70.00th=[ 220], 80.00th=[ 236], 90.00th=[ 257], 95.00th=[ 275], 00:23:53.243 | 99.00th=[ 326], 99.50th=[ 351], 99.90th=[ 405], 99.95th=[ 493], 00:23:53.243 | 99.99th=[ 493] 00:23:53.243 bw ( KiB/s): min=51712, max=231936, per=6.99%, avg=101496.80, stdev=54368.34, samples=20 00:23:53.243 iops : min= 202, max= 906, avg=396.45, stdev=212.39, samples=20 00:23:53.243 lat (msec) : 2=0.02%, 4=0.32%, 10=1.46%, 20=1.96%, 50=6.68% 00:23:53.243 lat (msec) : 100=24.16%, 250=52.21%, 500=13.18% 00:23:53.243 cpu : usr=1.20%, sys=0.97%, ctx=1837, majf=0, minf=1 00:23:53.243 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:53.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:53.243 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:53.243 issued rwts: total=0,4028,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:53.243 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:53.243 00:23:53.243 Run status group 0 (all jobs): 00:23:53.243 WRITE: bw=1418MiB/s (1487MB/s), 75.0MiB/s-200MiB/s (78.6MB/s-209MB/s), io=14.1GiB (15.1GB), run=10037-10178msec 00:23:53.243 00:23:53.243 Disk stats (read/write): 00:23:53.243 nvme0n1: ios=49/7489, merge=0/0, ticks=42/1220992, in_queue=1221034, util=95.95% 00:23:53.243 nvme10n1: ios=45/5982, merge=0/0, ticks=277/1209260, in_queue=1209537, util=98.36% 00:23:53.243 nvme1n1: ios=33/8450, merge=0/0, ticks=2806/1188879, in_queue=1191685, util=100.00% 00:23:53.243 nvme2n1: ios=30/16096, merge=0/0, ticks=62/1230550, in_queue=1230612, util=97.19% 00:23:53.243 nvme3n1: ios=43/9030, merge=0/0, ticks=2659/1170941, in_queue=1173600, util=100.00% 00:23:53.243 nvme4n1: ios=41/13119, merge=0/0, ticks=944/1223899, in_queue=1224843, util=100.00% 00:23:53.243 nvme5n1: ios=42/12069, merge=0/0, ticks=674/1217592, in_queue=1218266, util=99.86% 00:23:53.243 nvme6n1: ios=39/11551, merge=0/0, ticks=3151/1191623, in_queue=1194774, util=99.86% 00:23:53.243 nvme7n1: ios=0/11332, merge=0/0, ticks=0/1222266, in_queue=1222266, util=98.78% 00:23:53.243 nvme8n1: ios=0/11292, merge=0/0, ticks=0/1225435, in_queue=1225435, util=98.91% 00:23:53.243 nvme9n1: ios=42/7975, merge=0/0, ticks=1695/1224876, in_queue=1226571, util=100.00% 00:23:53.243 16:48:17 -- target/multiconnection.sh@36 -- # sync 00:23:53.243 16:48:17 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:53.243 16:48:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.243 16:48:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:53.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:53.243 16:48:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:53.243 16:48:18 -- common/autotest_common.sh@1198 -- # local i=0 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:23:53.243 16:48:18 -- common/autotest_common.sh@1210 -- # return 0 00:23:53.243 16:48:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:53.243 16:48:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:53.243 16:48:18 -- common/autotest_common.sh@10 -- # set +x 00:23:53.243 16:48:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:53.243 16:48:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.243 16:48:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:53.243 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:53.243 16:48:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:53.243 16:48:18 -- common/autotest_common.sh@1198 -- # local i=0 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:23:53.243 16:48:18 -- common/autotest_common.sh@1210 -- # return 0 00:23:53.243 16:48:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:53.243 16:48:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:53.243 16:48:18 -- common/autotest_common.sh@10 -- # set +x 00:23:53.243 16:48:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:53.243 16:48:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.243 16:48:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:53.243 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:53.243 16:48:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:53.243 16:48:18 -- common/autotest_common.sh@1198 -- # local i=0 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:53.243 16:48:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:23:53.243 16:48:18 -- common/autotest_common.sh@1210 -- # return 0 00:23:53.243 16:48:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:53.243 16:48:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:53.243 16:48:18 -- common/autotest_common.sh@10 -- # set +x 00:23:53.243 16:48:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:53.243 16:48:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.243 16:48:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:53.809 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:53.809 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:53.810 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:53.810 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:53.810 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:23:53.810 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:53.810 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:23:53.810 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:53.810 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:53.810 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:53.810 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:53.810 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:53.810 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.810 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:53.810 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:53.810 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:53.810 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:53.810 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:53.810 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:23:53.810 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:53.810 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:23:53.810 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:53.810 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:53.810 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:53.810 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:53.810 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:53.810 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:53.810 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:54.070 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:54.070 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:54.070 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.070 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.070 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:23:54.070 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.070 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:23:54.070 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.070 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:54.070 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.070 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:54.070 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.070 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:54.070 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:54.330 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:54.330 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:54.330 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.330 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.330 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:23:54.330 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.330 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:23:54.330 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.330 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:54.330 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.330 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:54.330 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.330 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:54.330 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:54.330 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:54.330 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:54.330 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.331 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.331 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:23:54.331 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.331 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:23:54.331 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.331 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:54.331 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.331 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:54.331 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.331 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:54.331 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:54.589 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:54.590 16:48:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:54.590 16:48:19 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.590 16:48:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.590 16:48:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:23:54.590 16:48:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.590 16:48:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:23:54.590 16:48:19 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.590 16:48:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:54.590 16:48:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.590 16:48:19 -- common/autotest_common.sh@10 -- # set +x 00:23:54.590 16:48:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.590 16:48:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:54.590 16:48:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:54.590 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:54.590 16:48:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:54.590 16:48:20 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.590 16:48:20 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.590 16:48:20 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:23:54.590 16:48:20 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.590 16:48:20 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:23:54.851 16:48:20 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.851 16:48:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:54.851 16:48:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.851 16:48:20 -- common/autotest_common.sh@10 -- # set +x 00:23:54.851 16:48:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.851 16:48:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:54.851 16:48:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:54.851 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:54.851 16:48:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:54.851 16:48:20 -- common/autotest_common.sh@1198 -- # local i=0 00:23:54.851 16:48:20 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:54.851 16:48:20 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:23:54.851 16:48:20 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:54.851 16:48:20 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:23:54.851 16:48:20 -- common/autotest_common.sh@1210 -- # return 0 00:23:54.851 16:48:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:54.851 16:48:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:54.851 16:48:20 -- common/autotest_common.sh@10 -- # set +x 00:23:54.851 16:48:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:54.851 16:48:20 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:54.851 16:48:20 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:54.851 16:48:20 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:54.851 16:48:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:54.851 16:48:20 -- nvmf/common.sh@116 -- # sync 00:23:54.851 16:48:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:54.851 16:48:20 -- nvmf/common.sh@119 -- # set +e 00:23:54.851 16:48:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:54.851 16:48:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:54.851 rmmod nvme_tcp 00:23:54.851 rmmod nvme_fabrics 00:23:54.851 rmmod nvme_keyring 00:23:54.851 16:48:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:54.851 16:48:20 -- nvmf/common.sh@123 -- # set -e 00:23:54.851 16:48:20 -- nvmf/common.sh@124 -- # return 0 00:23:54.851 16:48:20 -- nvmf/common.sh@477 -- # '[' -n 1245553 ']' 00:23:54.851 16:48:20 -- nvmf/common.sh@478 -- # killprocess 1245553 00:23:54.851 16:48:20 -- common/autotest_common.sh@926 -- # '[' -z 1245553 ']' 00:23:54.851 16:48:20 -- common/autotest_common.sh@930 -- # kill -0 1245553 00:23:54.851 16:48:20 -- common/autotest_common.sh@931 -- # uname 00:23:54.851 16:48:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:54.851 16:48:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1245553 00:23:54.851 16:48:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:54.851 16:48:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:54.851 16:48:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1245553' 00:23:54.851 killing process with pid 1245553 00:23:54.851 16:48:20 -- common/autotest_common.sh@945 -- # kill 1245553 00:23:54.851 16:48:20 -- common/autotest_common.sh@950 -- # wait 1245553 00:23:55.418 16:48:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:55.418 16:48:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:55.418 16:48:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:55.418 16:48:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:55.418 16:48:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:55.418 16:48:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:55.418 16:48:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:55.418 16:48:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:57.323 16:48:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:57.582 00:23:57.582 real 1m1.352s 00:23:57.582 user 3m29.264s 00:23:57.582 sys 0m24.346s 00:23:57.582 16:48:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:57.582 16:48:22 -- common/autotest_common.sh@10 -- # set +x 00:23:57.582 ************************************ 00:23:57.582 END TEST nvmf_multiconnection 00:23:57.582 ************************************ 00:23:57.582 16:48:22 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:57.582 16:48:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:57.582 16:48:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:57.582 16:48:22 -- common/autotest_common.sh@10 -- # set +x 00:23:57.582 ************************************ 00:23:57.582 START TEST nvmf_initiator_timeout 00:23:57.582 ************************************ 00:23:57.582 16:48:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:57.582 * Looking for test storage... 00:23:57.582 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:57.582 16:48:22 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:57.582 16:48:22 -- nvmf/common.sh@7 -- # uname -s 00:23:57.582 16:48:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:57.582 16:48:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:57.582 16:48:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:57.582 16:48:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:57.582 16:48:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:57.582 16:48:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:57.582 16:48:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:57.582 16:48:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:57.582 16:48:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:57.582 16:48:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:57.582 16:48:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:57.582 16:48:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:57.582 16:48:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:57.582 16:48:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:57.582 16:48:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:57.582 16:48:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:57.582 16:48:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:57.582 16:48:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:57.582 16:48:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:57.582 16:48:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:57.582 16:48:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:57.582 16:48:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:57.582 16:48:22 -- paths/export.sh@5 -- # export PATH 00:23:57.582 16:48:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:57.582 16:48:22 -- nvmf/common.sh@46 -- # : 0 00:23:57.582 16:48:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:57.582 16:48:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:57.582 16:48:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:57.582 16:48:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:57.582 16:48:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:57.582 16:48:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:57.582 16:48:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:57.582 16:48:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:57.582 16:48:22 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:57.582 16:48:22 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:57.582 16:48:22 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:57.582 16:48:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:57.582 16:48:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:57.582 16:48:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:57.582 16:48:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:57.582 16:48:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:57.582 16:48:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:57.582 16:48:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:57.582 16:48:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:57.582 16:48:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:57.582 16:48:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:57.582 16:48:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:57.582 16:48:22 -- common/autotest_common.sh@10 -- # set +x 00:24:00.117 16:48:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:00.117 16:48:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:00.117 16:48:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:00.117 16:48:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:00.117 16:48:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:00.117 16:48:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:00.117 16:48:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:00.117 16:48:24 -- nvmf/common.sh@294 -- # net_devs=() 00:24:00.117 16:48:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:00.117 16:48:24 -- nvmf/common.sh@295 -- # e810=() 00:24:00.117 16:48:24 -- nvmf/common.sh@295 -- # local -ga e810 00:24:00.117 16:48:24 -- nvmf/common.sh@296 -- # x722=() 00:24:00.117 16:48:24 -- nvmf/common.sh@296 -- # local -ga x722 00:24:00.117 16:48:24 -- nvmf/common.sh@297 -- # mlx=() 00:24:00.117 16:48:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:00.117 16:48:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:00.117 16:48:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:00.117 16:48:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:00.117 16:48:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:00.117 16:48:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:00.117 16:48:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:00.117 16:48:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:00.117 16:48:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:00.117 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:00.117 16:48:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:00.117 16:48:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:00.117 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:00.117 16:48:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:00.117 16:48:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:00.117 16:48:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:00.117 16:48:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:00.117 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:00.117 16:48:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:00.117 16:48:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:00.117 16:48:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:00.117 16:48:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:00.117 16:48:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:00.117 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:00.117 16:48:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:00.117 16:48:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:00.117 16:48:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:00.117 16:48:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:00.117 16:48:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:00.117 16:48:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:00.117 16:48:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:00.117 16:48:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:00.117 16:48:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:00.117 16:48:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:00.117 16:48:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:00.117 16:48:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:00.117 16:48:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:00.117 16:48:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:00.117 16:48:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:00.117 16:48:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:00.117 16:48:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:00.117 16:48:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:00.117 16:48:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:00.117 16:48:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:00.117 16:48:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:00.117 16:48:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:00.117 16:48:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:00.117 16:48:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:00.117 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:00.117 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:24:00.117 00:24:00.117 --- 10.0.0.2 ping statistics --- 00:24:00.118 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:00.118 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:24:00.118 16:48:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:00.118 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:00.118 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:24:00.118 00:24:00.118 --- 10.0.0.1 ping statistics --- 00:24:00.118 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:00.118 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:24:00.118 16:48:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:00.118 16:48:25 -- nvmf/common.sh@410 -- # return 0 00:24:00.118 16:48:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:00.118 16:48:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:00.118 16:48:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:00.118 16:48:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:00.118 16:48:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:00.118 16:48:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:00.118 16:48:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:00.118 16:48:25 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:24:00.118 16:48:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:00.118 16:48:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:00.118 16:48:25 -- common/autotest_common.sh@10 -- # set +x 00:24:00.118 16:48:25 -- nvmf/common.sh@469 -- # nvmfpid=1255285 00:24:00.118 16:48:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:00.118 16:48:25 -- nvmf/common.sh@470 -- # waitforlisten 1255285 00:24:00.118 16:48:25 -- common/autotest_common.sh@819 -- # '[' -z 1255285 ']' 00:24:00.118 16:48:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:00.118 16:48:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:00.118 16:48:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:00.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:00.118 16:48:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:00.118 16:48:25 -- common/autotest_common.sh@10 -- # set +x 00:24:00.118 [2024-10-13 16:48:25.202128] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:24:00.118 [2024-10-13 16:48:25.202210] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:00.118 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.118 [2024-10-13 16:48:25.270106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:00.118 [2024-10-13 16:48:25.362418] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:00.118 [2024-10-13 16:48:25.362576] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:00.118 [2024-10-13 16:48:25.362596] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:00.118 [2024-10-13 16:48:25.362611] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:00.118 [2024-10-13 16:48:25.362707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:00.118 [2024-10-13 16:48:25.362767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:00.118 [2024-10-13 16:48:25.362821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:00.118 [2024-10-13 16:48:25.362825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:00.684 16:48:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:00.684 16:48:26 -- common/autotest_common.sh@852 -- # return 0 00:24:00.684 16:48:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:00.684 16:48:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:00.684 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.684 16:48:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:00.684 16:48:26 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:24:00.684 16:48:26 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:00.684 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.684 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.944 Malloc0 00:24:00.944 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.944 16:48:26 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:24:00.944 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.944 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.944 Delay0 00:24:00.944 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.944 16:48:26 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:00.944 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.944 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.944 [2024-10-13 16:48:26.214959] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:00.944 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.944 16:48:26 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:24:00.944 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.945 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.945 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.945 16:48:26 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:24:00.945 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.945 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.945 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.945 16:48:26 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:00.945 16:48:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:00.945 16:48:26 -- common/autotest_common.sh@10 -- # set +x 00:24:00.945 [2024-10-13 16:48:26.243245] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:00.945 16:48:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.945 16:48:26 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:24:01.514 16:48:26 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:24:01.514 16:48:26 -- common/autotest_common.sh@1177 -- # local i=0 00:24:01.514 16:48:26 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:24:01.514 16:48:26 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:24:01.514 16:48:26 -- common/autotest_common.sh@1184 -- # sleep 2 00:24:03.419 16:48:28 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:24:03.419 16:48:28 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:24:03.419 16:48:28 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:24:03.419 16:48:28 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:24:03.419 16:48:28 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:24:03.419 16:48:28 -- common/autotest_common.sh@1187 -- # return 0 00:24:03.419 16:48:28 -- target/initiator_timeout.sh@35 -- # fio_pid=1255736 00:24:03.419 16:48:28 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:24:03.419 16:48:28 -- target/initiator_timeout.sh@37 -- # sleep 3 00:24:03.419 [global] 00:24:03.419 thread=1 00:24:03.419 invalidate=1 00:24:03.419 rw=write 00:24:03.419 time_based=1 00:24:03.419 runtime=60 00:24:03.419 ioengine=libaio 00:24:03.419 direct=1 00:24:03.419 bs=4096 00:24:03.419 iodepth=1 00:24:03.419 norandommap=0 00:24:03.419 numjobs=1 00:24:03.419 00:24:03.419 verify_dump=1 00:24:03.419 verify_backlog=512 00:24:03.419 verify_state_save=0 00:24:03.419 do_verify=1 00:24:03.419 verify=crc32c-intel 00:24:03.419 [job0] 00:24:03.419 filename=/dev/nvme0n1 00:24:03.419 Could not set queue depth (nvme0n1) 00:24:03.678 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:24:03.678 fio-3.35 00:24:03.678 Starting 1 thread 00:24:06.970 16:48:31 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:24:06.970 16:48:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:06.970 16:48:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.970 true 00:24:06.970 16:48:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:06.970 16:48:31 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:24:06.970 16:48:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:06.970 16:48:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.970 true 00:24:06.970 16:48:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:06.970 16:48:31 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:24:06.970 16:48:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:06.970 16:48:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.970 true 00:24:06.970 16:48:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:06.970 16:48:31 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:24:06.970 16:48:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:06.970 16:48:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.970 true 00:24:06.970 16:48:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:06.970 16:48:31 -- target/initiator_timeout.sh@45 -- # sleep 3 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:24:09.589 16:48:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:09.589 16:48:34 -- common/autotest_common.sh@10 -- # set +x 00:24:09.589 true 00:24:09.589 16:48:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:24:09.589 16:48:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:09.589 16:48:34 -- common/autotest_common.sh@10 -- # set +x 00:24:09.589 true 00:24:09.589 16:48:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:24:09.589 16:48:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:09.589 16:48:34 -- common/autotest_common.sh@10 -- # set +x 00:24:09.589 true 00:24:09.589 16:48:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:24:09.589 16:48:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:09.589 16:48:34 -- common/autotest_common.sh@10 -- # set +x 00:24:09.589 true 00:24:09.589 16:48:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:24:09.589 16:48:34 -- target/initiator_timeout.sh@54 -- # wait 1255736 00:25:05.839 00:25:05.839 job0: (groupid=0, jobs=1): err= 0: pid=1255805: Sun Oct 13 16:49:29 2024 00:25:05.839 read: IOPS=202, BW=810KiB/s (829kB/s)(47.4MiB/60001msec) 00:25:05.839 slat (usec): min=4, max=15620, avg=15.18, stdev=165.26 00:25:05.839 clat (usec): min=205, max=40871k, avg=4686.37, stdev=370943.86 00:25:05.839 lat (usec): min=210, max=40871k, avg=4701.55, stdev=370944.07 00:25:05.839 clat percentiles (usec): 00:25:05.839 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 237], 20.00th=[ 245], 00:25:05.839 | 30.00th=[ 253], 40.00th=[ 262], 50.00th=[ 269], 60.00th=[ 277], 00:25:05.839 | 70.00th=[ 285], 80.00th=[ 297], 90.00th=[ 322], 95.00th=[ 445], 00:25:05.839 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:25:05.839 | 99.99th=[42206] 00:25:05.839 write: IOPS=204, BW=819KiB/s (839kB/s)(48.0MiB/60001msec); 0 zone resets 00:25:05.839 slat (usec): min=5, max=24827, avg=17.51, stdev=223.96 00:25:05.839 clat (usec): min=161, max=1451, avg=210.65, stdev=36.74 00:25:05.839 lat (usec): min=169, max=25061, avg=228.16, stdev=227.83 00:25:05.839 clat percentiles (usec): 00:25:05.839 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 182], 20.00th=[ 188], 00:25:05.839 | 30.00th=[ 192], 40.00th=[ 198], 50.00th=[ 206], 60.00th=[ 215], 00:25:05.839 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 237], 95.00th=[ 251], 00:25:05.839 | 99.00th=[ 351], 99.50th=[ 400], 99.90th=[ 445], 99.95th=[ 807], 00:25:05.839 | 99.99th=[ 1057] 00:25:05.839 bw ( KiB/s): min= 1256, max= 8872, per=100.00%, avg=5541.65, stdev=2501.71, samples=17 00:25:05.839 iops : min= 314, max= 2220, avg=1385.41, stdev=625.43, samples=17 00:25:05.839 lat (usec) : 250=61.03%, 500=36.97%, 750=0.66%, 1000=0.04% 00:25:05.839 lat (msec) : 2=0.02%, 4=0.01%, 50=1.27%, >=2000=0.01% 00:25:05.839 cpu : usr=0.38%, sys=0.81%, ctx=24437, majf=0, minf=1 00:25:05.839 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:25:05.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:05.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:05.839 issued rwts: total=12143,12288,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:05.839 latency : target=0, window=0, percentile=100.00%, depth=1 00:25:05.839 00:25:05.839 Run status group 0 (all jobs): 00:25:05.839 READ: bw=810KiB/s (829kB/s), 810KiB/s-810KiB/s (829kB/s-829kB/s), io=47.4MiB (49.7MB), run=60001-60001msec 00:25:05.839 WRITE: bw=819KiB/s (839kB/s), 819KiB/s-819KiB/s (839kB/s-839kB/s), io=48.0MiB (50.3MB), run=60001-60001msec 00:25:05.839 00:25:05.839 Disk stats (read/write): 00:25:05.839 nvme0n1: ios=11885/12288, merge=0/0, ticks=17120/2427, in_queue=19547, util=99.67% 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:25:05.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:25:05.839 16:49:29 -- common/autotest_common.sh@1198 -- # local i=0 00:25:05.839 16:49:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:25:05.839 16:49:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:25:05.839 16:49:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:25:05.839 16:49:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:25:05.839 16:49:29 -- common/autotest_common.sh@1210 -- # return 0 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:25:05.839 nvmf hotplug test: fio successful as expected 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:05.839 16:49:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.839 16:49:29 -- common/autotest_common.sh@10 -- # set +x 00:25:05.839 16:49:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:25:05.839 16:49:29 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:25:05.839 16:49:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:05.839 16:49:29 -- nvmf/common.sh@116 -- # sync 00:25:05.839 16:49:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:05.839 16:49:29 -- nvmf/common.sh@119 -- # set +e 00:25:05.839 16:49:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:05.839 16:49:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:05.839 rmmod nvme_tcp 00:25:05.839 rmmod nvme_fabrics 00:25:05.839 rmmod nvme_keyring 00:25:05.839 16:49:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:05.839 16:49:29 -- nvmf/common.sh@123 -- # set -e 00:25:05.839 16:49:29 -- nvmf/common.sh@124 -- # return 0 00:25:05.839 16:49:29 -- nvmf/common.sh@477 -- # '[' -n 1255285 ']' 00:25:05.839 16:49:29 -- nvmf/common.sh@478 -- # killprocess 1255285 00:25:05.839 16:49:29 -- common/autotest_common.sh@926 -- # '[' -z 1255285 ']' 00:25:05.839 16:49:29 -- common/autotest_common.sh@930 -- # kill -0 1255285 00:25:05.839 16:49:29 -- common/autotest_common.sh@931 -- # uname 00:25:05.839 16:49:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:05.839 16:49:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1255285 00:25:05.839 16:49:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:05.839 16:49:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:05.839 16:49:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1255285' 00:25:05.839 killing process with pid 1255285 00:25:05.839 16:49:29 -- common/autotest_common.sh@945 -- # kill 1255285 00:25:05.839 16:49:29 -- common/autotest_common.sh@950 -- # wait 1255285 00:25:05.839 16:49:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:05.839 16:49:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:05.839 16:49:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:05.839 16:49:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:05.839 16:49:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:05.839 16:49:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:05.839 16:49:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:05.839 16:49:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.409 16:49:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:06.409 00:25:06.409 real 1m8.853s 00:25:06.409 user 4m12.979s 00:25:06.409 sys 0m7.353s 00:25:06.409 16:49:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:06.409 16:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:06.409 ************************************ 00:25:06.409 END TEST nvmf_initiator_timeout 00:25:06.409 ************************************ 00:25:06.409 16:49:31 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:25:06.409 16:49:31 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:25:06.409 16:49:31 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:25:06.409 16:49:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:06.409 16:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:08.316 16:49:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:08.316 16:49:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:08.316 16:49:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:08.316 16:49:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:08.316 16:49:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:08.316 16:49:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:08.316 16:49:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:08.316 16:49:33 -- nvmf/common.sh@294 -- # net_devs=() 00:25:08.316 16:49:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:08.316 16:49:33 -- nvmf/common.sh@295 -- # e810=() 00:25:08.316 16:49:33 -- nvmf/common.sh@295 -- # local -ga e810 00:25:08.316 16:49:33 -- nvmf/common.sh@296 -- # x722=() 00:25:08.316 16:49:33 -- nvmf/common.sh@296 -- # local -ga x722 00:25:08.316 16:49:33 -- nvmf/common.sh@297 -- # mlx=() 00:25:08.316 16:49:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:08.316 16:49:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:08.316 16:49:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:08.316 16:49:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:08.316 16:49:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:08.316 16:49:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:08.316 16:49:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:08.316 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:08.316 16:49:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:08.316 16:49:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:08.316 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:08.316 16:49:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:08.316 16:49:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:08.316 16:49:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:08.316 16:49:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.316 16:49:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:08.316 16:49:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.316 16:49:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:08.316 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:08.316 16:49:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.316 16:49:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:08.316 16:49:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.316 16:49:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:08.316 16:49:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.316 16:49:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:08.316 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:08.316 16:49:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.316 16:49:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:08.316 16:49:33 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:08.316 16:49:33 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:25:08.316 16:49:33 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:25:08.316 16:49:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:08.316 16:49:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:08.316 16:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:08.316 ************************************ 00:25:08.316 START TEST nvmf_perf_adq 00:25:08.316 ************************************ 00:25:08.316 16:49:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:25:08.316 * Looking for test storage... 00:25:08.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:08.317 16:49:33 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:08.317 16:49:33 -- nvmf/common.sh@7 -- # uname -s 00:25:08.317 16:49:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:08.317 16:49:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:08.317 16:49:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:08.317 16:49:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:08.317 16:49:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:08.317 16:49:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:08.317 16:49:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:08.317 16:49:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:08.317 16:49:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:08.317 16:49:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:08.317 16:49:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:08.317 16:49:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:08.317 16:49:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:08.317 16:49:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:08.317 16:49:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:08.317 16:49:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:08.317 16:49:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:08.317 16:49:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:08.317 16:49:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:08.317 16:49:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.317 16:49:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.317 16:49:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.317 16:49:33 -- paths/export.sh@5 -- # export PATH 00:25:08.317 16:49:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:08.317 16:49:33 -- nvmf/common.sh@46 -- # : 0 00:25:08.317 16:49:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:08.317 16:49:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:08.317 16:49:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:08.317 16:49:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:08.317 16:49:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:08.317 16:49:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:08.317 16:49:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:08.317 16:49:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:08.317 16:49:33 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:25:08.317 16:49:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:08.317 16:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:10.852 16:49:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:10.852 16:49:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:10.852 16:49:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:10.852 16:49:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:10.852 16:49:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:10.852 16:49:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:10.852 16:49:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:10.852 16:49:35 -- nvmf/common.sh@294 -- # net_devs=() 00:25:10.852 16:49:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:10.852 16:49:35 -- nvmf/common.sh@295 -- # e810=() 00:25:10.852 16:49:35 -- nvmf/common.sh@295 -- # local -ga e810 00:25:10.852 16:49:35 -- nvmf/common.sh@296 -- # x722=() 00:25:10.852 16:49:35 -- nvmf/common.sh@296 -- # local -ga x722 00:25:10.852 16:49:35 -- nvmf/common.sh@297 -- # mlx=() 00:25:10.852 16:49:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:10.852 16:49:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:10.852 16:49:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:10.852 16:49:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:10.852 16:49:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:10.852 16:49:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:10.852 16:49:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:10.852 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:10.852 16:49:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:10.852 16:49:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:10.852 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:10.852 16:49:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:10.852 16:49:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:10.852 16:49:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:10.852 16:49:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:10.852 16:49:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:10.852 16:49:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:10.852 16:49:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:10.852 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:10.852 16:49:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:10.852 16:49:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:10.852 16:49:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:10.852 16:49:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:10.852 16:49:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:10.852 16:49:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:10.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:10.852 16:49:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:10.852 16:49:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:10.852 16:49:35 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:10.852 16:49:35 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:25:10.852 16:49:35 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:25:10.852 16:49:35 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:25:10.852 16:49:35 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:11.112 16:49:36 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:13.655 16:49:39 -- target/perf_adq.sh@54 -- # sleep 5 00:25:18.941 16:49:44 -- target/perf_adq.sh@67 -- # nvmftestinit 00:25:18.941 16:49:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:18.941 16:49:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:18.941 16:49:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:18.941 16:49:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:18.941 16:49:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:18.941 16:49:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:18.941 16:49:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:18.941 16:49:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:18.941 16:49:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:18.941 16:49:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:18.941 16:49:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:18.941 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:18.941 16:49:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:18.941 16:49:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:18.941 16:49:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:18.941 16:49:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:18.941 16:49:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:18.941 16:49:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:18.941 16:49:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:18.941 16:49:44 -- nvmf/common.sh@294 -- # net_devs=() 00:25:18.941 16:49:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:18.941 16:49:44 -- nvmf/common.sh@295 -- # e810=() 00:25:18.941 16:49:44 -- nvmf/common.sh@295 -- # local -ga e810 00:25:18.941 16:49:44 -- nvmf/common.sh@296 -- # x722=() 00:25:18.941 16:49:44 -- nvmf/common.sh@296 -- # local -ga x722 00:25:18.941 16:49:44 -- nvmf/common.sh@297 -- # mlx=() 00:25:18.941 16:49:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:18.941 16:49:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:18.941 16:49:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:18.941 16:49:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:18.941 16:49:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:18.942 16:49:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:18.942 16:49:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:18.942 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:18.942 16:49:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:18.942 16:49:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:18.942 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:18.942 16:49:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:18.942 16:49:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:18.942 16:49:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:18.942 16:49:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:18.942 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:18.942 16:49:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:18.942 16:49:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:18.942 16:49:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:18.942 16:49:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:18.942 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:18.942 16:49:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:18.942 16:49:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:18.942 16:49:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:18.942 16:49:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:18.942 16:49:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:18.942 16:49:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:18.942 16:49:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:18.942 16:49:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:18.942 16:49:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:18.942 16:49:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:18.942 16:49:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:18.942 16:49:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:18.942 16:49:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:18.942 16:49:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:18.942 16:49:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:18.942 16:49:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:18.942 16:49:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:18.942 16:49:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:18.942 16:49:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:18.942 16:49:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:18.942 16:49:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:18.942 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:18.942 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:25:18.942 00:25:18.942 --- 10.0.0.2 ping statistics --- 00:25:18.942 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:18.942 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:25:18.942 16:49:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:18.942 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:18.942 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:25:18.942 00:25:18.942 --- 10.0.0.1 ping statistics --- 00:25:18.942 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:18.942 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:25:18.942 16:49:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:18.942 16:49:44 -- nvmf/common.sh@410 -- # return 0 00:25:18.942 16:49:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:18.942 16:49:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:18.942 16:49:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:18.942 16:49:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:18.942 16:49:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:18.942 16:49:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:18.942 16:49:44 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:18.942 16:49:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:18.942 16:49:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:18.942 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:18.942 16:49:44 -- nvmf/common.sh@469 -- # nvmfpid=1267723 00:25:18.942 16:49:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:18.942 16:49:44 -- nvmf/common.sh@470 -- # waitforlisten 1267723 00:25:18.942 16:49:44 -- common/autotest_common.sh@819 -- # '[' -z 1267723 ']' 00:25:18.942 16:49:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:18.942 16:49:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:18.942 16:49:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:18.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:18.942 16:49:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:18.942 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:18.942 [2024-10-13 16:49:44.325880] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:25:18.942 [2024-10-13 16:49:44.325957] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:18.942 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.942 [2024-10-13 16:49:44.393770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:19.201 [2024-10-13 16:49:44.486488] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:19.201 [2024-10-13 16:49:44.486663] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:19.201 [2024-10-13 16:49:44.486683] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:19.201 [2024-10-13 16:49:44.486697] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:19.201 [2024-10-13 16:49:44.486767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:19.201 [2024-10-13 16:49:44.486824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:19.201 [2024-10-13 16:49:44.486858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:19.201 [2024-10-13 16:49:44.486860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:19.201 16:49:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:19.201 16:49:44 -- common/autotest_common.sh@852 -- # return 0 00:25:19.201 16:49:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:19.201 16:49:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:19.201 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.201 16:49:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:19.201 16:49:44 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:25:19.201 16:49:44 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:25:19.201 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.201 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.201 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.201 16:49:44 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:19.201 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.201 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.201 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.201 16:49:44 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:25:19.201 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.201 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.201 [2024-10-13 16:49:44.680033] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:19.201 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.201 16:49:44 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:19.201 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.201 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.460 Malloc1 00:25:19.460 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.460 16:49:44 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:19.460 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.460 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.460 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.460 16:49:44 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:19.460 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.460 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.460 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.460 16:49:44 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:19.460 16:49:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.460 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:25:19.460 [2024-10-13 16:49:44.731522] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:19.460 16:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.460 16:49:44 -- target/perf_adq.sh@73 -- # perfpid=1267876 00:25:19.460 16:49:44 -- target/perf_adq.sh@74 -- # sleep 2 00:25:19.460 16:49:44 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:19.460 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.365 16:49:46 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:25:21.365 16:49:46 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:25:21.365 16:49:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:21.365 16:49:46 -- common/autotest_common.sh@10 -- # set +x 00:25:21.365 16:49:46 -- target/perf_adq.sh@76 -- # wc -l 00:25:21.365 16:49:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:21.365 16:49:46 -- target/perf_adq.sh@76 -- # count=4 00:25:21.365 16:49:46 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:25:21.365 16:49:46 -- target/perf_adq.sh@81 -- # wait 1267876 00:25:29.489 Initializing NVMe Controllers 00:25:29.489 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:29.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:29.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:29.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:29.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:29.489 Initialization complete. Launching workers. 00:25:29.489 ======================================================== 00:25:29.489 Latency(us) 00:25:29.489 Device Information : IOPS MiB/s Average min max 00:25:29.489 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10887.40 42.53 5879.59 1532.52 9364.15 00:25:29.489 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11088.00 43.31 5772.67 1505.35 9608.87 00:25:29.489 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11531.50 45.04 5550.45 2011.09 9037.22 00:25:29.489 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11451.30 44.73 5590.70 1478.87 9656.85 00:25:29.489 ======================================================== 00:25:29.489 Total : 44958.20 175.62 5695.21 1478.87 9656.85 00:25:29.489 00:25:29.489 16:49:54 -- target/perf_adq.sh@82 -- # nvmftestfini 00:25:29.489 16:49:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:29.489 16:49:54 -- nvmf/common.sh@116 -- # sync 00:25:29.489 16:49:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:29.489 16:49:54 -- nvmf/common.sh@119 -- # set +e 00:25:29.489 16:49:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:29.489 16:49:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:29.489 rmmod nvme_tcp 00:25:29.489 rmmod nvme_fabrics 00:25:29.489 rmmod nvme_keyring 00:25:29.489 16:49:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:29.489 16:49:54 -- nvmf/common.sh@123 -- # set -e 00:25:29.489 16:49:54 -- nvmf/common.sh@124 -- # return 0 00:25:29.489 16:49:54 -- nvmf/common.sh@477 -- # '[' -n 1267723 ']' 00:25:29.489 16:49:54 -- nvmf/common.sh@478 -- # killprocess 1267723 00:25:29.489 16:49:54 -- common/autotest_common.sh@926 -- # '[' -z 1267723 ']' 00:25:29.489 16:49:54 -- common/autotest_common.sh@930 -- # kill -0 1267723 00:25:29.489 16:49:54 -- common/autotest_common.sh@931 -- # uname 00:25:29.489 16:49:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:29.489 16:49:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1267723 00:25:29.489 16:49:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:29.489 16:49:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:29.489 16:49:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1267723' 00:25:29.489 killing process with pid 1267723 00:25:29.489 16:49:54 -- common/autotest_common.sh@945 -- # kill 1267723 00:25:29.489 16:49:54 -- common/autotest_common.sh@950 -- # wait 1267723 00:25:29.748 16:49:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:29.748 16:49:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:29.748 16:49:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:29.748 16:49:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:29.748 16:49:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:29.748 16:49:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:29.748 16:49:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:29.748 16:49:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.291 16:49:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.291 16:49:57 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:32.291 16:49:57 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:32.550 16:49:57 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:35.086 16:50:00 -- target/perf_adq.sh@54 -- # sleep 5 00:25:40.366 16:50:05 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:40.367 16:50:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.367 16:50:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.367 16:50:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.367 16:50:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.367 16:50:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.367 16:50:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.367 16:50:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.367 16:50:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.367 16:50:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.367 16:50:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.367 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.367 16:50:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.367 16:50:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.367 16:50:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.367 16:50:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.367 16:50:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.367 16:50:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.367 16:50:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.367 16:50:05 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.367 16:50:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.367 16:50:05 -- nvmf/common.sh@295 -- # e810=() 00:25:40.367 16:50:05 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.367 16:50:05 -- nvmf/common.sh@296 -- # x722=() 00:25:40.367 16:50:05 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.367 16:50:05 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.367 16:50:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.367 16:50:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.367 16:50:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.367 16:50:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.367 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.367 16:50:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.367 16:50:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.367 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.367 16:50:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.367 16:50:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.367 16:50:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.367 16:50:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.367 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.367 16:50:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.367 16:50:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.367 16:50:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.367 16:50:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.367 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.367 16:50:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.367 16:50:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.367 16:50:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.367 16:50:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.367 16:50:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.367 16:50:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.367 16:50:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.367 16:50:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.367 16:50:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.367 16:50:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.367 16:50:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.367 16:50:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.367 16:50:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.367 16:50:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:40.367 16:50:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:40.367 16:50:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:40.367 16:50:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:40.367 16:50:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:40.367 16:50:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:40.367 16:50:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:40.367 16:50:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:40.367 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:40.367 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:25:40.367 00:25:40.367 --- 10.0.0.2 ping statistics --- 00:25:40.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.367 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:25:40.367 16:50:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:40.367 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:40.367 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:25:40.367 00:25:40.367 --- 10.0.0.1 ping statistics --- 00:25:40.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.367 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:25:40.367 16:50:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:40.367 16:50:05 -- nvmf/common.sh@410 -- # return 0 00:25:40.367 16:50:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:40.367 16:50:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:40.367 16:50:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:40.367 16:50:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:40.367 16:50:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:40.367 16:50:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:40.368 16:50:05 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:40.368 16:50:05 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:40.368 16:50:05 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:40.368 16:50:05 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:40.368 net.core.busy_poll = 1 00:25:40.368 16:50:05 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:40.368 net.core.busy_read = 1 00:25:40.368 16:50:05 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:40.368 16:50:05 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:40.368 16:50:05 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:40.368 16:50:05 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:40.368 16:50:05 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:40.368 16:50:05 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:40.368 16:50:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:40.368 16:50:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:40.368 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.368 16:50:05 -- nvmf/common.sh@469 -- # nvmfpid=1270561 00:25:40.368 16:50:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:40.368 16:50:05 -- nvmf/common.sh@470 -- # waitforlisten 1270561 00:25:40.368 16:50:05 -- common/autotest_common.sh@819 -- # '[' -z 1270561 ']' 00:25:40.368 16:50:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:40.368 16:50:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:40.368 16:50:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:40.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:40.368 16:50:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:40.368 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.368 [2024-10-13 16:50:05.533818] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:25:40.368 [2024-10-13 16:50:05.533894] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:40.368 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.368 [2024-10-13 16:50:05.597327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:40.368 [2024-10-13 16:50:05.681304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:40.368 [2024-10-13 16:50:05.681448] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:40.368 [2024-10-13 16:50:05.681466] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:40.368 [2024-10-13 16:50:05.681478] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:40.368 [2024-10-13 16:50:05.681622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:40.368 [2024-10-13 16:50:05.681685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:40.368 [2024-10-13 16:50:05.681749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:40.368 [2024-10-13 16:50:05.681752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:40.368 16:50:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:40.368 16:50:05 -- common/autotest_common.sh@852 -- # return 0 00:25:40.368 16:50:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:40.368 16:50:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:40.368 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.368 16:50:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:40.368 16:50:05 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:40.368 16:50:05 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:40.368 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.368 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.368 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.368 16:50:05 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:40.368 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.368 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:40.628 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.628 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 [2024-10-13 16:50:05.889961] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:40.628 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.628 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 Malloc1 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:40.628 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.628 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:40.628 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.628 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:40.628 16:50:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.628 16:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 [2024-10-13 16:50:05.940627] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:40.628 16:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.628 16:50:05 -- target/perf_adq.sh@94 -- # perfpid=1270592 00:25:40.628 16:50:05 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:40.628 16:50:05 -- target/perf_adq.sh@95 -- # sleep 2 00:25:40.628 EAL: No free 2048 kB hugepages reported on node 1 00:25:42.574 16:50:07 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:42.574 16:50:07 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:42.574 16:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:42.574 16:50:07 -- target/perf_adq.sh@97 -- # wc -l 00:25:42.574 16:50:07 -- common/autotest_common.sh@10 -- # set +x 00:25:42.574 16:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:42.574 16:50:07 -- target/perf_adq.sh@97 -- # count=2 00:25:42.574 16:50:07 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:42.574 16:50:07 -- target/perf_adq.sh@103 -- # wait 1270592 00:25:50.757 Initializing NVMe Controllers 00:25:50.757 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:50.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:50.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:50.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:50.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:50.757 Initialization complete. Launching workers. 00:25:50.757 ======================================================== 00:25:50.757 Latency(us) 00:25:50.757 Device Information : IOPS MiB/s Average min max 00:25:50.757 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5211.38 20.36 12319.95 1094.99 57882.27 00:25:50.757 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4658.68 18.20 13740.84 2027.10 61811.65 00:25:50.757 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4992.78 19.50 12855.07 1477.84 58118.47 00:25:50.757 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 15060.65 58.83 4249.63 1155.70 45437.61 00:25:50.757 ======================================================== 00:25:50.757 Total : 29923.50 116.89 8568.62 1094.99 61811.65 00:25:50.757 00:25:50.757 16:50:16 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:50.757 16:50:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:50.757 16:50:16 -- nvmf/common.sh@116 -- # sync 00:25:50.757 16:50:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:50.757 16:50:16 -- nvmf/common.sh@119 -- # set +e 00:25:50.757 16:50:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:50.757 16:50:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:50.757 rmmod nvme_tcp 00:25:50.757 rmmod nvme_fabrics 00:25:50.757 rmmod nvme_keyring 00:25:50.757 16:50:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:50.757 16:50:16 -- nvmf/common.sh@123 -- # set -e 00:25:50.757 16:50:16 -- nvmf/common.sh@124 -- # return 0 00:25:50.757 16:50:16 -- nvmf/common.sh@477 -- # '[' -n 1270561 ']' 00:25:50.757 16:50:16 -- nvmf/common.sh@478 -- # killprocess 1270561 00:25:50.757 16:50:16 -- common/autotest_common.sh@926 -- # '[' -z 1270561 ']' 00:25:50.757 16:50:16 -- common/autotest_common.sh@930 -- # kill -0 1270561 00:25:50.757 16:50:16 -- common/autotest_common.sh@931 -- # uname 00:25:50.757 16:50:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:50.757 16:50:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1270561 00:25:50.757 16:50:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:50.757 16:50:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:50.757 16:50:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1270561' 00:25:50.757 killing process with pid 1270561 00:25:50.757 16:50:16 -- common/autotest_common.sh@945 -- # kill 1270561 00:25:50.757 16:50:16 -- common/autotest_common.sh@950 -- # wait 1270561 00:25:51.014 16:50:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:51.014 16:50:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:51.014 16:50:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:51.015 16:50:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:51.015 16:50:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:51.015 16:50:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:51.015 16:50:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:51.015 16:50:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.303 16:50:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:54.303 16:50:19 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:54.303 00:25:54.303 real 0m45.817s 00:25:54.303 user 2m40.421s 00:25:54.303 sys 0m8.822s 00:25:54.303 16:50:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:54.303 16:50:19 -- common/autotest_common.sh@10 -- # set +x 00:25:54.303 ************************************ 00:25:54.303 END TEST nvmf_perf_adq 00:25:54.303 ************************************ 00:25:54.303 16:50:19 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:54.303 16:50:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:54.303 16:50:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:54.303 16:50:19 -- common/autotest_common.sh@10 -- # set +x 00:25:54.303 ************************************ 00:25:54.303 START TEST nvmf_shutdown 00:25:54.303 ************************************ 00:25:54.303 16:50:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:54.303 * Looking for test storage... 00:25:54.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:54.303 16:50:19 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:54.303 16:50:19 -- nvmf/common.sh@7 -- # uname -s 00:25:54.303 16:50:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:54.303 16:50:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:54.303 16:50:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:54.303 16:50:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:54.303 16:50:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:54.303 16:50:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:54.303 16:50:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:54.303 16:50:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:54.303 16:50:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:54.303 16:50:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:54.303 16:50:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.303 16:50:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:54.303 16:50:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:54.303 16:50:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:54.303 16:50:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:54.303 16:50:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:54.303 16:50:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:54.303 16:50:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:54.303 16:50:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:54.303 16:50:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.303 16:50:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.303 16:50:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.303 16:50:19 -- paths/export.sh@5 -- # export PATH 00:25:54.303 16:50:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:54.303 16:50:19 -- nvmf/common.sh@46 -- # : 0 00:25:54.303 16:50:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:54.303 16:50:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:54.303 16:50:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:54.303 16:50:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:54.303 16:50:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:54.303 16:50:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:54.303 16:50:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:54.303 16:50:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:54.303 16:50:19 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:54.303 16:50:19 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:54.303 16:50:19 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:54.303 16:50:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:54.303 16:50:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:54.304 16:50:19 -- common/autotest_common.sh@10 -- # set +x 00:25:54.304 ************************************ 00:25:54.304 START TEST nvmf_shutdown_tc1 00:25:54.304 ************************************ 00:25:54.304 16:50:19 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:25:54.304 16:50:19 -- target/shutdown.sh@74 -- # starttarget 00:25:54.304 16:50:19 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:54.304 16:50:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:54.304 16:50:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:54.304 16:50:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:54.304 16:50:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:54.304 16:50:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:54.304 16:50:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.304 16:50:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.304 16:50:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.304 16:50:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:54.304 16:50:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:54.304 16:50:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:54.304 16:50:19 -- common/autotest_common.sh@10 -- # set +x 00:25:56.205 16:50:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:56.205 16:50:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:56.205 16:50:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:56.205 16:50:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:56.205 16:50:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:56.205 16:50:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:56.205 16:50:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:56.205 16:50:21 -- nvmf/common.sh@294 -- # net_devs=() 00:25:56.205 16:50:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:56.205 16:50:21 -- nvmf/common.sh@295 -- # e810=() 00:25:56.205 16:50:21 -- nvmf/common.sh@295 -- # local -ga e810 00:25:56.205 16:50:21 -- nvmf/common.sh@296 -- # x722=() 00:25:56.205 16:50:21 -- nvmf/common.sh@296 -- # local -ga x722 00:25:56.205 16:50:21 -- nvmf/common.sh@297 -- # mlx=() 00:25:56.205 16:50:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:56.205 16:50:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:56.205 16:50:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:56.205 16:50:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:56.205 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:56.205 16:50:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:56.205 16:50:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:56.205 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:56.205 16:50:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:56.205 16:50:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:56.205 16:50:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:56.205 16:50:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:56.205 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:56.205 16:50:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:56.205 16:50:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:56.205 16:50:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:56.205 16:50:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:56.205 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:56.205 16:50:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:56.205 16:50:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:56.205 16:50:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:56.205 16:50:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:56.205 16:50:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:56.205 16:50:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:56.205 16:50:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:56.205 16:50:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:56.205 16:50:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:56.205 16:50:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:56.205 16:50:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:56.205 16:50:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:56.205 16:50:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:56.205 16:50:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:56.205 16:50:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:56.205 16:50:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:56.205 16:50:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:56.205 16:50:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:56.205 16:50:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:56.205 16:50:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:56.205 16:50:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:56.205 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:56.205 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:25:56.205 00:25:56.205 --- 10.0.0.2 ping statistics --- 00:25:56.205 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:56.205 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:25:56.205 16:50:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:56.205 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:56.205 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:25:56.205 00:25:56.205 --- 10.0.0.1 ping statistics --- 00:25:56.205 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:56.205 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:25:56.205 16:50:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:56.205 16:50:21 -- nvmf/common.sh@410 -- # return 0 00:25:56.205 16:50:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:56.205 16:50:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:56.205 16:50:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:56.205 16:50:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:56.205 16:50:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:56.205 16:50:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:56.205 16:50:21 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:56.205 16:50:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:56.205 16:50:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:56.205 16:50:21 -- common/autotest_common.sh@10 -- # set +x 00:25:56.205 16:50:21 -- nvmf/common.sh@469 -- # nvmfpid=1273930 00:25:56.205 16:50:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:56.205 16:50:21 -- nvmf/common.sh@470 -- # waitforlisten 1273930 00:25:56.205 16:50:21 -- common/autotest_common.sh@819 -- # '[' -z 1273930 ']' 00:25:56.205 16:50:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:56.464 16:50:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:56.464 16:50:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:56.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:56.464 16:50:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:56.464 16:50:21 -- common/autotest_common.sh@10 -- # set +x 00:25:56.464 [2024-10-13 16:50:21.749276] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:25:56.464 [2024-10-13 16:50:21.749371] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:56.464 EAL: No free 2048 kB hugepages reported on node 1 00:25:56.464 [2024-10-13 16:50:21.813780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:56.464 [2024-10-13 16:50:21.904908] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:56.464 [2024-10-13 16:50:21.905081] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:56.464 [2024-10-13 16:50:21.905098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:56.464 [2024-10-13 16:50:21.905110] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:56.464 [2024-10-13 16:50:21.905201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:56.464 [2024-10-13 16:50:21.905247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:56.464 [2024-10-13 16:50:21.905301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:56.464 [2024-10-13 16:50:21.905304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:57.397 16:50:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:57.397 16:50:22 -- common/autotest_common.sh@852 -- # return 0 00:25:57.397 16:50:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:57.397 16:50:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:57.397 16:50:22 -- common/autotest_common.sh@10 -- # set +x 00:25:57.397 16:50:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:57.397 16:50:22 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:57.397 16:50:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:57.397 16:50:22 -- common/autotest_common.sh@10 -- # set +x 00:25:57.397 [2024-10-13 16:50:22.764093] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:57.397 16:50:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:57.397 16:50:22 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:57.397 16:50:22 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:57.397 16:50:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:57.397 16:50:22 -- common/autotest_common.sh@10 -- # set +x 00:25:57.397 16:50:22 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:57.397 16:50:22 -- target/shutdown.sh@28 -- # cat 00:25:57.397 16:50:22 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:57.398 16:50:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:57.398 16:50:22 -- common/autotest_common.sh@10 -- # set +x 00:25:57.398 Malloc1 00:25:57.398 [2024-10-13 16:50:22.839153] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:57.398 Malloc2 00:25:57.656 Malloc3 00:25:57.656 Malloc4 00:25:57.656 Malloc5 00:25:57.656 Malloc6 00:25:57.656 Malloc7 00:25:57.914 Malloc8 00:25:57.914 Malloc9 00:25:57.914 Malloc10 00:25:57.914 16:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:57.914 16:50:23 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:57.914 16:50:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:57.914 16:50:23 -- common/autotest_common.sh@10 -- # set +x 00:25:57.914 16:50:23 -- target/shutdown.sh@78 -- # perfpid=1274124 00:25:57.914 16:50:23 -- target/shutdown.sh@79 -- # waitforlisten 1274124 /var/tmp/bdevperf.sock 00:25:57.914 16:50:23 -- common/autotest_common.sh@819 -- # '[' -z 1274124 ']' 00:25:57.914 16:50:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:57.914 16:50:23 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:57.914 16:50:23 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:57.914 16:50:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:57.914 16:50:23 -- nvmf/common.sh@520 -- # config=() 00:25:57.914 16:50:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:57.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:57.914 16:50:23 -- nvmf/common.sh@520 -- # local subsystem config 00:25:57.914 16:50:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:57.914 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.914 16:50:23 -- common/autotest_common.sh@10 -- # set +x 00:25:57.914 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.914 { 00:25:57.914 "params": { 00:25:57.914 "name": "Nvme$subsystem", 00:25:57.914 "trtype": "$TEST_TRANSPORT", 00:25:57.914 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.914 "adrfam": "ipv4", 00:25:57.914 "trsvcid": "$NVMF_PORT", 00:25:57.914 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.914 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.914 "hdgst": ${hdgst:-false}, 00:25:57.914 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.915 { 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme$subsystem", 00:25:57.915 "trtype": "$TEST_TRANSPORT", 00:25:57.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "$NVMF_PORT", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.915 "hdgst": ${hdgst:-false}, 00:25:57.915 "ddgst": ${ddgst:-false} 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 } 00:25:57.915 EOF 00:25:57.915 )") 00:25:57.915 16:50:23 -- nvmf/common.sh@542 -- # cat 00:25:57.915 16:50:23 -- nvmf/common.sh@544 -- # jq . 00:25:57.915 16:50:23 -- nvmf/common.sh@545 -- # IFS=, 00:25:57.915 16:50:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme1", 00:25:57.915 "trtype": "tcp", 00:25:57.915 "traddr": "10.0.0.2", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "4420", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:57.915 "hdgst": false, 00:25:57.915 "ddgst": false 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 },{ 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme2", 00:25:57.915 "trtype": "tcp", 00:25:57.915 "traddr": "10.0.0.2", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "4420", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:57.915 "hdgst": false, 00:25:57.915 "ddgst": false 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 },{ 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme3", 00:25:57.915 "trtype": "tcp", 00:25:57.915 "traddr": "10.0.0.2", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "4420", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:57.915 "hdgst": false, 00:25:57.915 "ddgst": false 00:25:57.915 }, 00:25:57.915 "method": "bdev_nvme_attach_controller" 00:25:57.915 },{ 00:25:57.915 "params": { 00:25:57.915 "name": "Nvme4", 00:25:57.915 "trtype": "tcp", 00:25:57.915 "traddr": "10.0.0.2", 00:25:57.915 "adrfam": "ipv4", 00:25:57.915 "trsvcid": "4420", 00:25:57.915 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:57.915 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:57.915 "hdgst": false, 00:25:57.915 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme5", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme6", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme7", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme8", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme9", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 },{ 00:25:57.916 "params": { 00:25:57.916 "name": "Nvme10", 00:25:57.916 "trtype": "tcp", 00:25:57.916 "traddr": "10.0.0.2", 00:25:57.916 "adrfam": "ipv4", 00:25:57.916 "trsvcid": "4420", 00:25:57.916 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:57.916 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:57.916 "hdgst": false, 00:25:57.916 "ddgst": false 00:25:57.916 }, 00:25:57.916 "method": "bdev_nvme_attach_controller" 00:25:57.916 }' 00:25:57.916 [2024-10-13 16:50:23.342815] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:25:57.916 [2024-10-13 16:50:23.342893] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:57.916 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.916 [2024-10-13 16:50:23.408419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.174 [2024-10-13 16:50:23.494744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.071 16:50:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:00.071 16:50:25 -- common/autotest_common.sh@852 -- # return 0 00:26:00.071 16:50:25 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:00.071 16:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:00.071 16:50:25 -- common/autotest_common.sh@10 -- # set +x 00:26:00.071 16:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:00.071 16:50:25 -- target/shutdown.sh@83 -- # kill -9 1274124 00:26:00.071 16:50:25 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:26:00.071 16:50:25 -- target/shutdown.sh@87 -- # sleep 1 00:26:00.637 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1274124 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:26:00.637 16:50:26 -- target/shutdown.sh@88 -- # kill -0 1273930 00:26:00.637 16:50:26 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:26:00.637 16:50:26 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:00.637 16:50:26 -- nvmf/common.sh@520 -- # config=() 00:26:00.637 16:50:26 -- nvmf/common.sh@520 -- # local subsystem config 00:26:00.637 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.637 { 00:26:00.637 "params": { 00:26:00.637 "name": "Nvme$subsystem", 00:26:00.637 "trtype": "$TEST_TRANSPORT", 00:26:00.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.637 "adrfam": "ipv4", 00:26:00.637 "trsvcid": "$NVMF_PORT", 00:26:00.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.637 "hdgst": ${hdgst:-false}, 00:26:00.637 "ddgst": ${ddgst:-false} 00:26:00.637 }, 00:26:00.637 "method": "bdev_nvme_attach_controller" 00:26:00.637 } 00:26:00.637 EOF 00:26:00.637 )") 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.637 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.637 { 00:26:00.637 "params": { 00:26:00.637 "name": "Nvme$subsystem", 00:26:00.637 "trtype": "$TEST_TRANSPORT", 00:26:00.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.637 "adrfam": "ipv4", 00:26:00.637 "trsvcid": "$NVMF_PORT", 00:26:00.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.637 "hdgst": ${hdgst:-false}, 00:26:00.637 "ddgst": ${ddgst:-false} 00:26:00.637 }, 00:26:00.637 "method": "bdev_nvme_attach_controller" 00:26:00.637 } 00:26:00.637 EOF 00:26:00.637 )") 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.637 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.637 { 00:26:00.637 "params": { 00:26:00.637 "name": "Nvme$subsystem", 00:26:00.637 "trtype": "$TEST_TRANSPORT", 00:26:00.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.637 "adrfam": "ipv4", 00:26:00.637 "trsvcid": "$NVMF_PORT", 00:26:00.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.637 "hdgst": ${hdgst:-false}, 00:26:00.637 "ddgst": ${ddgst:-false} 00:26:00.637 }, 00:26:00.637 "method": "bdev_nvme_attach_controller" 00:26:00.637 } 00:26:00.637 EOF 00:26:00.637 )") 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.637 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.637 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.637 { 00:26:00.637 "params": { 00:26:00.637 "name": "Nvme$subsystem", 00:26:00.637 "trtype": "$TEST_TRANSPORT", 00:26:00.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.637 "adrfam": "ipv4", 00:26:00.637 "trsvcid": "$NVMF_PORT", 00:26:00.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.637 "hdgst": ${hdgst:-false}, 00:26:00.638 "ddgst": ${ddgst:-false} 00:26:00.638 }, 00:26:00.638 "method": "bdev_nvme_attach_controller" 00:26:00.638 } 00:26:00.638 EOF 00:26:00.638 )") 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.638 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.638 { 00:26:00.638 "params": { 00:26:00.638 "name": "Nvme$subsystem", 00:26:00.638 "trtype": "$TEST_TRANSPORT", 00:26:00.638 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.638 "adrfam": "ipv4", 00:26:00.638 "trsvcid": "$NVMF_PORT", 00:26:00.638 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.638 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.638 "hdgst": ${hdgst:-false}, 00:26:00.638 "ddgst": ${ddgst:-false} 00:26:00.638 }, 00:26:00.638 "method": "bdev_nvme_attach_controller" 00:26:00.638 } 00:26:00.638 EOF 00:26:00.638 )") 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.638 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.638 { 00:26:00.638 "params": { 00:26:00.638 "name": "Nvme$subsystem", 00:26:00.638 "trtype": "$TEST_TRANSPORT", 00:26:00.638 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.638 "adrfam": "ipv4", 00:26:00.638 "trsvcid": "$NVMF_PORT", 00:26:00.638 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.638 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.638 "hdgst": ${hdgst:-false}, 00:26:00.638 "ddgst": ${ddgst:-false} 00:26:00.638 }, 00:26:00.638 "method": "bdev_nvme_attach_controller" 00:26:00.638 } 00:26:00.638 EOF 00:26:00.638 )") 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.638 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.638 { 00:26:00.638 "params": { 00:26:00.638 "name": "Nvme$subsystem", 00:26:00.638 "trtype": "$TEST_TRANSPORT", 00:26:00.638 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.638 "adrfam": "ipv4", 00:26:00.638 "trsvcid": "$NVMF_PORT", 00:26:00.638 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.638 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.638 "hdgst": ${hdgst:-false}, 00:26:00.638 "ddgst": ${ddgst:-false} 00:26:00.638 }, 00:26:00.638 "method": "bdev_nvme_attach_controller" 00:26:00.638 } 00:26:00.638 EOF 00:26:00.638 )") 00:26:00.638 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.896 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.896 { 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme$subsystem", 00:26:00.896 "trtype": "$TEST_TRANSPORT", 00:26:00.896 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "$NVMF_PORT", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.896 "hdgst": ${hdgst:-false}, 00:26:00.896 "ddgst": ${ddgst:-false} 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 } 00:26:00.896 EOF 00:26:00.896 )") 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.896 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.896 { 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme$subsystem", 00:26:00.896 "trtype": "$TEST_TRANSPORT", 00:26:00.896 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "$NVMF_PORT", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.896 "hdgst": ${hdgst:-false}, 00:26:00.896 "ddgst": ${ddgst:-false} 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 } 00:26:00.896 EOF 00:26:00.896 )") 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.896 16:50:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:00.896 { 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme$subsystem", 00:26:00.896 "trtype": "$TEST_TRANSPORT", 00:26:00.896 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "$NVMF_PORT", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:00.896 "hdgst": ${hdgst:-false}, 00:26:00.896 "ddgst": ${ddgst:-false} 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 } 00:26:00.896 EOF 00:26:00.896 )") 00:26:00.896 16:50:26 -- nvmf/common.sh@542 -- # cat 00:26:00.896 16:50:26 -- nvmf/common.sh@544 -- # jq . 00:26:00.896 16:50:26 -- nvmf/common.sh@545 -- # IFS=, 00:26:00.896 16:50:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme1", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme2", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme3", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme4", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme5", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme6", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme7", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme8", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme9", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 },{ 00:26:00.896 "params": { 00:26:00.896 "name": "Nvme10", 00:26:00.896 "trtype": "tcp", 00:26:00.896 "traddr": "10.0.0.2", 00:26:00.896 "adrfam": "ipv4", 00:26:00.896 "trsvcid": "4420", 00:26:00.896 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:00.896 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:00.896 "hdgst": false, 00:26:00.896 "ddgst": false 00:26:00.896 }, 00:26:00.896 "method": "bdev_nvme_attach_controller" 00:26:00.896 }' 00:26:00.896 [2024-10-13 16:50:26.157370] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:00.897 [2024-10-13 16:50:26.157477] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1274559 ] 00:26:00.897 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.897 [2024-10-13 16:50:26.220845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:00.897 [2024-10-13 16:50:26.305481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:02.793 Running I/O for 1 seconds... 00:26:03.725 00:26:03.725 Latency(us) 00:26:03.725 [2024-10-13T14:50:29.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme1n1 : 1.08 401.82 25.11 0.00 0.00 156341.56 19515.16 127382.57 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme2n1 : 1.10 395.97 24.75 0.00 0.00 157373.76 21359.88 126605.84 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme3n1 : 1.08 401.33 25.08 0.00 0.00 154325.48 19320.98 120392.06 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme4n1 : 1.09 399.47 24.97 0.00 0.00 153728.40 21456.97 118061.89 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme5n1 : 1.09 397.56 24.85 0.00 0.00 153338.69 21942.42 118838.61 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme6n1 : 1.10 400.13 25.01 0.00 0.00 151438.14 14951.92 119615.34 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme7n1 : 1.10 395.25 24.70 0.00 0.00 152375.62 19418.07 123498.95 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme8n1 : 1.10 394.08 24.63 0.00 0.00 151905.60 18155.90 123498.95 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme9n1 : 1.10 393.13 24.57 0.00 0.00 151653.48 14660.65 125829.12 00:26:03.725 [2024-10-13T14:50:29.226Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:03.725 Verification LBA range: start 0x0 length 0x400 00:26:03.725 Nvme10n1 : 1.15 380.87 23.80 0.00 0.00 150441.36 7621.59 125829.12 00:26:03.725 [2024-10-13T14:50:29.226Z] =================================================================================================================== 00:26:03.725 [2024-10-13T14:50:29.226Z] Total : 3959.61 247.48 0.00 0.00 153287.68 7621.59 127382.57 00:26:03.983 16:50:29 -- target/shutdown.sh@93 -- # stoptarget 00:26:03.983 16:50:29 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:03.983 16:50:29 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:03.983 16:50:29 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:03.983 16:50:29 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:03.983 16:50:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:03.983 16:50:29 -- nvmf/common.sh@116 -- # sync 00:26:03.983 16:50:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:03.983 16:50:29 -- nvmf/common.sh@119 -- # set +e 00:26:03.983 16:50:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:03.983 16:50:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:03.983 rmmod nvme_tcp 00:26:03.983 rmmod nvme_fabrics 00:26:03.983 rmmod nvme_keyring 00:26:03.983 16:50:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:03.983 16:50:29 -- nvmf/common.sh@123 -- # set -e 00:26:03.983 16:50:29 -- nvmf/common.sh@124 -- # return 0 00:26:03.983 16:50:29 -- nvmf/common.sh@477 -- # '[' -n 1273930 ']' 00:26:03.983 16:50:29 -- nvmf/common.sh@478 -- # killprocess 1273930 00:26:03.983 16:50:29 -- common/autotest_common.sh@926 -- # '[' -z 1273930 ']' 00:26:03.983 16:50:29 -- common/autotest_common.sh@930 -- # kill -0 1273930 00:26:03.983 16:50:29 -- common/autotest_common.sh@931 -- # uname 00:26:03.983 16:50:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:03.983 16:50:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1273930 00:26:03.983 16:50:29 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:03.983 16:50:29 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:03.983 16:50:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1273930' 00:26:03.983 killing process with pid 1273930 00:26:03.983 16:50:29 -- common/autotest_common.sh@945 -- # kill 1273930 00:26:03.983 16:50:29 -- common/autotest_common.sh@950 -- # wait 1273930 00:26:04.550 16:50:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:04.550 16:50:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:04.550 16:50:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:04.550 16:50:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:04.550 16:50:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:04.550 16:50:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.550 16:50:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.550 16:50:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.460 16:50:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:06.460 00:26:06.460 real 0m12.309s 00:26:06.460 user 0m37.077s 00:26:06.460 sys 0m3.107s 00:26:06.460 16:50:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:06.460 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:26:06.460 ************************************ 00:26:06.460 END TEST nvmf_shutdown_tc1 00:26:06.460 ************************************ 00:26:06.460 16:50:31 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:26:06.460 16:50:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:06.460 16:50:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:06.460 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:26:06.460 ************************************ 00:26:06.460 START TEST nvmf_shutdown_tc2 00:26:06.460 ************************************ 00:26:06.460 16:50:31 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:26:06.460 16:50:31 -- target/shutdown.sh@98 -- # starttarget 00:26:06.460 16:50:31 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:06.460 16:50:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:06.460 16:50:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:06.460 16:50:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:06.460 16:50:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:06.460 16:50:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:06.460 16:50:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:06.460 16:50:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:06.460 16:50:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:06.460 16:50:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:06.460 16:50:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:06.460 16:50:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:06.460 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:26:06.460 16:50:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:06.460 16:50:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:06.460 16:50:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:06.460 16:50:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:06.460 16:50:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:06.460 16:50:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:06.460 16:50:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:06.461 16:50:31 -- nvmf/common.sh@294 -- # net_devs=() 00:26:06.461 16:50:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:06.461 16:50:31 -- nvmf/common.sh@295 -- # e810=() 00:26:06.461 16:50:31 -- nvmf/common.sh@295 -- # local -ga e810 00:26:06.461 16:50:31 -- nvmf/common.sh@296 -- # x722=() 00:26:06.461 16:50:31 -- nvmf/common.sh@296 -- # local -ga x722 00:26:06.461 16:50:31 -- nvmf/common.sh@297 -- # mlx=() 00:26:06.461 16:50:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:06.461 16:50:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:06.461 16:50:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:06.721 16:50:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:06.721 16:50:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.721 16:50:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:06.721 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:06.721 16:50:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.721 16:50:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:06.721 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:06.721 16:50:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.721 16:50:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.721 16:50:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.721 16:50:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:06.721 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:06.721 16:50:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.721 16:50:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.721 16:50:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.721 16:50:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.721 16:50:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:06.721 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:06.721 16:50:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.721 16:50:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:06.721 16:50:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:06.721 16:50:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:06.721 16:50:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:06.721 16:50:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:06.721 16:50:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:06.721 16:50:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:06.721 16:50:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:06.721 16:50:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:06.721 16:50:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:06.721 16:50:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:06.721 16:50:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:06.721 16:50:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:06.721 16:50:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:06.721 16:50:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:06.721 16:50:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:06.721 16:50:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:06.721 16:50:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:06.721 16:50:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:06.721 16:50:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:06.721 16:50:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:06.721 16:50:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:06.721 16:50:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:06.721 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:06.721 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.388 ms 00:26:06.721 00:26:06.721 --- 10.0.0.2 ping statistics --- 00:26:06.721 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.721 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:26:06.721 16:50:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:06.721 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:06.721 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.169 ms 00:26:06.721 00:26:06.721 --- 10.0.0.1 ping statistics --- 00:26:06.721 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.721 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:26:06.721 16:50:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:06.721 16:50:32 -- nvmf/common.sh@410 -- # return 0 00:26:06.721 16:50:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:06.721 16:50:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:06.722 16:50:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:06.722 16:50:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:06.722 16:50:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:06.722 16:50:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:06.722 16:50:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:06.722 16:50:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:06.722 16:50:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:06.722 16:50:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:06.722 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:26:06.722 16:50:32 -- nvmf/common.sh@469 -- # nvmfpid=1275332 00:26:06.722 16:50:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:06.722 16:50:32 -- nvmf/common.sh@470 -- # waitforlisten 1275332 00:26:06.722 16:50:32 -- common/autotest_common.sh@819 -- # '[' -z 1275332 ']' 00:26:06.722 16:50:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:06.722 16:50:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:06.722 16:50:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:06.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:06.722 16:50:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:06.722 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:26:06.722 [2024-10-13 16:50:32.175715] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:06.722 [2024-10-13 16:50:32.175810] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:06.722 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.981 [2024-10-13 16:50:32.248192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:06.981 [2024-10-13 16:50:32.345570] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:06.981 [2024-10-13 16:50:32.345729] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:06.981 [2024-10-13 16:50:32.345747] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:06.981 [2024-10-13 16:50:32.345769] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:06.981 [2024-10-13 16:50:32.345820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:06.981 [2024-10-13 16:50:32.345882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:06.981 [2024-10-13 16:50:32.345949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:06.981 [2024-10-13 16:50:32.345951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:07.918 16:50:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:07.918 16:50:33 -- common/autotest_common.sh@852 -- # return 0 00:26:07.918 16:50:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:07.918 16:50:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:07.918 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:07.918 16:50:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:07.918 16:50:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:07.918 16:50:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.918 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:07.918 [2024-10-13 16:50:33.202125] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:07.918 16:50:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.918 16:50:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:07.918 16:50:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:07.918 16:50:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:07.918 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:07.918 16:50:33 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:07.918 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.918 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.918 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.918 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.918 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.918 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.918 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.918 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.918 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.918 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.919 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.919 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.919 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.919 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:07.919 16:50:33 -- target/shutdown.sh@28 -- # cat 00:26:07.919 16:50:33 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:07.919 16:50:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.919 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:07.919 Malloc1 00:26:07.919 [2024-10-13 16:50:33.277093] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:07.919 Malloc2 00:26:07.919 Malloc3 00:26:07.919 Malloc4 00:26:08.178 Malloc5 00:26:08.178 Malloc6 00:26:08.178 Malloc7 00:26:08.178 Malloc8 00:26:08.178 Malloc9 00:26:08.438 Malloc10 00:26:08.438 16:50:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:08.438 16:50:33 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:08.438 16:50:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:08.438 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:08.438 16:50:33 -- target/shutdown.sh@102 -- # perfpid=1275647 00:26:08.438 16:50:33 -- target/shutdown.sh@103 -- # waitforlisten 1275647 /var/tmp/bdevperf.sock 00:26:08.438 16:50:33 -- common/autotest_common.sh@819 -- # '[' -z 1275647 ']' 00:26:08.438 16:50:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:08.438 16:50:33 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:08.438 16:50:33 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:08.438 16:50:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:08.438 16:50:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:08.438 16:50:33 -- nvmf/common.sh@520 -- # config=() 00:26:08.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:08.438 16:50:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:08.438 16:50:33 -- nvmf/common.sh@520 -- # local subsystem config 00:26:08.438 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:08.438 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.438 { 00:26:08.438 "params": { 00:26:08.438 "name": "Nvme$subsystem", 00:26:08.438 "trtype": "$TEST_TRANSPORT", 00:26:08.438 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.438 "adrfam": "ipv4", 00:26:08.438 "trsvcid": "$NVMF_PORT", 00:26:08.438 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.438 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.438 "hdgst": ${hdgst:-false}, 00:26:08.438 "ddgst": ${ddgst:-false} 00:26:08.438 }, 00:26:08.438 "method": "bdev_nvme_attach_controller" 00:26:08.438 } 00:26:08.438 EOF 00:26:08.438 )") 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.438 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.438 { 00:26:08.438 "params": { 00:26:08.438 "name": "Nvme$subsystem", 00:26:08.438 "trtype": "$TEST_TRANSPORT", 00:26:08.438 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.438 "adrfam": "ipv4", 00:26:08.438 "trsvcid": "$NVMF_PORT", 00:26:08.438 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.438 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.438 "hdgst": ${hdgst:-false}, 00:26:08.438 "ddgst": ${ddgst:-false} 00:26:08.438 }, 00:26:08.438 "method": "bdev_nvme_attach_controller" 00:26:08.438 } 00:26:08.438 EOF 00:26:08.438 )") 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.438 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.438 { 00:26:08.438 "params": { 00:26:08.438 "name": "Nvme$subsystem", 00:26:08.438 "trtype": "$TEST_TRANSPORT", 00:26:08.438 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.438 "adrfam": "ipv4", 00:26:08.438 "trsvcid": "$NVMF_PORT", 00:26:08.438 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.438 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.438 "hdgst": ${hdgst:-false}, 00:26:08.438 "ddgst": ${ddgst:-false} 00:26:08.438 }, 00:26:08.438 "method": "bdev_nvme_attach_controller" 00:26:08.438 } 00:26:08.438 EOF 00:26:08.438 )") 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.438 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.438 { 00:26:08.438 "params": { 00:26:08.438 "name": "Nvme$subsystem", 00:26:08.438 "trtype": "$TEST_TRANSPORT", 00:26:08.438 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.438 "adrfam": "ipv4", 00:26:08.438 "trsvcid": "$NVMF_PORT", 00:26:08.438 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.438 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.438 "hdgst": ${hdgst:-false}, 00:26:08.438 "ddgst": ${ddgst:-false} 00:26:08.438 }, 00:26:08.438 "method": "bdev_nvme_attach_controller" 00:26:08.438 } 00:26:08.438 EOF 00:26:08.438 )") 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.438 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.438 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.438 { 00:26:08.438 "params": { 00:26:08.438 "name": "Nvme$subsystem", 00:26:08.438 "trtype": "$TEST_TRANSPORT", 00:26:08.438 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.438 "adrfam": "ipv4", 00:26:08.438 "trsvcid": "$NVMF_PORT", 00:26:08.438 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.438 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.438 "hdgst": ${hdgst:-false}, 00:26:08.438 "ddgst": ${ddgst:-false} 00:26:08.438 }, 00:26:08.438 "method": "bdev_nvme_attach_controller" 00:26:08.438 } 00:26:08.438 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.439 { 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme$subsystem", 00:26:08.439 "trtype": "$TEST_TRANSPORT", 00:26:08.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "$NVMF_PORT", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.439 "hdgst": ${hdgst:-false}, 00:26:08.439 "ddgst": ${ddgst:-false} 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 } 00:26:08.439 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.439 { 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme$subsystem", 00:26:08.439 "trtype": "$TEST_TRANSPORT", 00:26:08.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "$NVMF_PORT", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.439 "hdgst": ${hdgst:-false}, 00:26:08.439 "ddgst": ${ddgst:-false} 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 } 00:26:08.439 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.439 { 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme$subsystem", 00:26:08.439 "trtype": "$TEST_TRANSPORT", 00:26:08.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "$NVMF_PORT", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.439 "hdgst": ${hdgst:-false}, 00:26:08.439 "ddgst": ${ddgst:-false} 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 } 00:26:08.439 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.439 { 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme$subsystem", 00:26:08.439 "trtype": "$TEST_TRANSPORT", 00:26:08.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "$NVMF_PORT", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.439 "hdgst": ${hdgst:-false}, 00:26:08.439 "ddgst": ${ddgst:-false} 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 } 00:26:08.439 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:08.439 { 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme$subsystem", 00:26:08.439 "trtype": "$TEST_TRANSPORT", 00:26:08.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "$NVMF_PORT", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:08.439 "hdgst": ${hdgst:-false}, 00:26:08.439 "ddgst": ${ddgst:-false} 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 } 00:26:08.439 EOF 00:26:08.439 )") 00:26:08.439 16:50:33 -- nvmf/common.sh@542 -- # cat 00:26:08.439 16:50:33 -- nvmf/common.sh@544 -- # jq . 00:26:08.439 16:50:33 -- nvmf/common.sh@545 -- # IFS=, 00:26:08.439 16:50:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme1", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme2", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme3", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme4", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme5", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme6", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme7", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:08.439 "hdgst": false, 00:26:08.439 "ddgst": false 00:26:08.439 }, 00:26:08.439 "method": "bdev_nvme_attach_controller" 00:26:08.439 },{ 00:26:08.439 "params": { 00:26:08.439 "name": "Nvme8", 00:26:08.439 "trtype": "tcp", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "adrfam": "ipv4", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:08.439 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:08.439 "hdgst": false, 00:26:08.440 "ddgst": false 00:26:08.440 }, 00:26:08.440 "method": "bdev_nvme_attach_controller" 00:26:08.440 },{ 00:26:08.440 "params": { 00:26:08.440 "name": "Nvme9", 00:26:08.440 "trtype": "tcp", 00:26:08.440 "traddr": "10.0.0.2", 00:26:08.440 "adrfam": "ipv4", 00:26:08.440 "trsvcid": "4420", 00:26:08.440 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:08.440 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:08.440 "hdgst": false, 00:26:08.440 "ddgst": false 00:26:08.440 }, 00:26:08.440 "method": "bdev_nvme_attach_controller" 00:26:08.440 },{ 00:26:08.440 "params": { 00:26:08.440 "name": "Nvme10", 00:26:08.440 "trtype": "tcp", 00:26:08.440 "traddr": "10.0.0.2", 00:26:08.440 "adrfam": "ipv4", 00:26:08.440 "trsvcid": "4420", 00:26:08.440 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:08.440 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:08.440 "hdgst": false, 00:26:08.440 "ddgst": false 00:26:08.440 }, 00:26:08.440 "method": "bdev_nvme_attach_controller" 00:26:08.440 }' 00:26:08.440 [2024-10-13 16:50:33.779022] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:08.440 [2024-10-13 16:50:33.779098] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1275647 ] 00:26:08.440 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.440 [2024-10-13 16:50:33.840668] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:08.440 [2024-10-13 16:50:33.925490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:10.344 Running I/O for 10 seconds... 00:26:10.912 16:50:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:10.912 16:50:36 -- common/autotest_common.sh@852 -- # return 0 00:26:10.912 16:50:36 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:10.912 16:50:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:10.912 16:50:36 -- common/autotest_common.sh@10 -- # set +x 00:26:10.912 16:50:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:10.912 16:50:36 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:10.912 16:50:36 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:10.912 16:50:36 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:10.912 16:50:36 -- target/shutdown.sh@57 -- # local ret=1 00:26:10.912 16:50:36 -- target/shutdown.sh@58 -- # local i 00:26:10.912 16:50:36 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:10.912 16:50:36 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:10.912 16:50:36 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:10.912 16:50:36 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:10.912 16:50:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:10.912 16:50:36 -- common/autotest_common.sh@10 -- # set +x 00:26:10.912 16:50:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:10.912 16:50:36 -- target/shutdown.sh@60 -- # read_io_count=254 00:26:10.912 16:50:36 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:26:10.912 16:50:36 -- target/shutdown.sh@64 -- # ret=0 00:26:10.912 16:50:36 -- target/shutdown.sh@65 -- # break 00:26:10.912 16:50:36 -- target/shutdown.sh@69 -- # return 0 00:26:10.912 16:50:36 -- target/shutdown.sh@109 -- # killprocess 1275647 00:26:10.912 16:50:36 -- common/autotest_common.sh@926 -- # '[' -z 1275647 ']' 00:26:10.912 16:50:36 -- common/autotest_common.sh@930 -- # kill -0 1275647 00:26:10.912 16:50:36 -- common/autotest_common.sh@931 -- # uname 00:26:10.912 16:50:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:10.912 16:50:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1275647 00:26:10.912 16:50:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:10.912 16:50:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:10.912 16:50:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1275647' 00:26:10.912 killing process with pid 1275647 00:26:10.912 16:50:36 -- common/autotest_common.sh@945 -- # kill 1275647 00:26:10.912 16:50:36 -- common/autotest_common.sh@950 -- # wait 1275647 00:26:11.171 Received shutdown signal, test time was about 0.861965 seconds 00:26:11.171 00:26:11.171 Latency(us) 00:26:11.171 [2024-10-13T14:50:36.672Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme1n1 : 0.86 412.24 25.76 0.00 0.00 152215.68 17379.18 135926.52 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme2n1 : 0.85 415.32 25.96 0.00 0.00 149816.87 16893.72 133596.35 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme3n1 : 0.86 414.68 25.92 0.00 0.00 148156.21 21359.88 115731.72 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme4n1 : 0.85 416.04 26.00 0.00 0.00 146814.72 16408.27 118061.89 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme5n1 : 0.86 414.02 25.88 0.00 0.00 146124.43 16990.81 117285.17 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme6n1 : 0.82 383.15 23.95 0.00 0.00 155660.52 22136.60 119615.34 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme7n1 : 0.83 380.41 23.78 0.00 0.00 155238.26 23107.51 119615.34 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme8n1 : 0.83 384.63 24.04 0.00 0.00 152152.44 20680.25 123498.95 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme9n1 : 0.84 374.32 23.39 0.00 0.00 154083.34 27573.67 125052.40 00:26:11.171 [2024-10-13T14:50:36.672Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:11.171 Verification LBA range: start 0x0 length 0x400 00:26:11.171 Nvme10n1 : 0.85 370.96 23.18 0.00 0.00 154779.31 25049.32 125829.12 00:26:11.171 [2024-10-13T14:50:36.672Z] =================================================================================================================== 00:26:11.171 [2024-10-13T14:50:36.672Z] Total : 3965.75 247.86 0.00 0.00 151333.54 16408.27 135926.52 00:26:11.430 16:50:36 -- target/shutdown.sh@112 -- # sleep 1 00:26:12.366 16:50:37 -- target/shutdown.sh@113 -- # kill -0 1275332 00:26:12.366 16:50:37 -- target/shutdown.sh@115 -- # stoptarget 00:26:12.366 16:50:37 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:12.366 16:50:37 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:12.366 16:50:37 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:12.366 16:50:37 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:12.366 16:50:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:12.366 16:50:37 -- nvmf/common.sh@116 -- # sync 00:26:12.366 16:50:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:12.366 16:50:37 -- nvmf/common.sh@119 -- # set +e 00:26:12.366 16:50:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:12.366 16:50:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:12.366 rmmod nvme_tcp 00:26:12.366 rmmod nvme_fabrics 00:26:12.366 rmmod nvme_keyring 00:26:12.366 16:50:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:12.366 16:50:37 -- nvmf/common.sh@123 -- # set -e 00:26:12.366 16:50:37 -- nvmf/common.sh@124 -- # return 0 00:26:12.366 16:50:37 -- nvmf/common.sh@477 -- # '[' -n 1275332 ']' 00:26:12.366 16:50:37 -- nvmf/common.sh@478 -- # killprocess 1275332 00:26:12.366 16:50:37 -- common/autotest_common.sh@926 -- # '[' -z 1275332 ']' 00:26:12.366 16:50:37 -- common/autotest_common.sh@930 -- # kill -0 1275332 00:26:12.366 16:50:37 -- common/autotest_common.sh@931 -- # uname 00:26:12.366 16:50:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:12.366 16:50:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1275332 00:26:12.366 16:50:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:12.366 16:50:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:12.366 16:50:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1275332' 00:26:12.366 killing process with pid 1275332 00:26:12.366 16:50:37 -- common/autotest_common.sh@945 -- # kill 1275332 00:26:12.366 16:50:37 -- common/autotest_common.sh@950 -- # wait 1275332 00:26:12.933 16:50:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:12.933 16:50:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:12.933 16:50:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:12.933 16:50:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:12.933 16:50:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:12.933 16:50:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.933 16:50:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.933 16:50:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.841 16:50:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:14.841 00:26:14.841 real 0m8.354s 00:26:14.841 user 0m26.622s 00:26:14.841 sys 0m1.547s 00:26:14.841 16:50:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:14.841 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:26:14.841 ************************************ 00:26:14.841 END TEST nvmf_shutdown_tc2 00:26:14.841 ************************************ 00:26:14.841 16:50:40 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:26:14.841 16:50:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:14.841 16:50:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:14.841 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:26:14.841 ************************************ 00:26:14.841 START TEST nvmf_shutdown_tc3 00:26:14.841 ************************************ 00:26:14.841 16:50:40 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:26:14.841 16:50:40 -- target/shutdown.sh@120 -- # starttarget 00:26:14.841 16:50:40 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:14.841 16:50:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:14.841 16:50:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:14.841 16:50:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:14.841 16:50:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:14.841 16:50:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:14.841 16:50:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.841 16:50:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.841 16:50:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.841 16:50:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:14.841 16:50:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:14.841 16:50:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:14.841 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:26:14.841 16:50:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:14.841 16:50:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:14.841 16:50:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:14.841 16:50:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:14.841 16:50:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:14.841 16:50:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:14.841 16:50:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:14.841 16:50:40 -- nvmf/common.sh@294 -- # net_devs=() 00:26:14.841 16:50:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:14.841 16:50:40 -- nvmf/common.sh@295 -- # e810=() 00:26:14.841 16:50:40 -- nvmf/common.sh@295 -- # local -ga e810 00:26:14.841 16:50:40 -- nvmf/common.sh@296 -- # x722=() 00:26:14.841 16:50:40 -- nvmf/common.sh@296 -- # local -ga x722 00:26:14.841 16:50:40 -- nvmf/common.sh@297 -- # mlx=() 00:26:14.841 16:50:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:14.841 16:50:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:14.841 16:50:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:14.841 16:50:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:14.841 16:50:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:14.841 16:50:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:14.841 16:50:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:14.842 16:50:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.842 16:50:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:14.842 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:14.842 16:50:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.842 16:50:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:14.842 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:14.842 16:50:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.842 16:50:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.842 16:50:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.842 16:50:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:14.842 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:14.842 16:50:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.842 16:50:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.842 16:50:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.842 16:50:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.842 16:50:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:14.842 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:14.842 16:50:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.842 16:50:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:14.842 16:50:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:14.842 16:50:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:14.842 16:50:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:14.842 16:50:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:14.842 16:50:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:14.842 16:50:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:14.842 16:50:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:15.109 16:50:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:15.109 16:50:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:15.109 16:50:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:15.109 16:50:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:15.109 16:50:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:15.109 16:50:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:15.109 16:50:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:15.110 16:50:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:15.110 16:50:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:15.110 16:50:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:15.110 16:50:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:15.110 16:50:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:15.110 16:50:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:15.110 16:50:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:15.110 16:50:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:15.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:15.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:26:15.110 00:26:15.110 --- 10.0.0.2 ping statistics --- 00:26:15.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.110 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:26:15.110 16:50:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:15.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:15.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:26:15.110 00:26:15.110 --- 10.0.0.1 ping statistics --- 00:26:15.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.110 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:26:15.110 16:50:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:15.110 16:50:40 -- nvmf/common.sh@410 -- # return 0 00:26:15.110 16:50:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:15.110 16:50:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:15.110 16:50:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:15.110 16:50:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:15.111 16:50:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:15.111 16:50:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:15.111 16:50:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:15.111 16:50:40 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:15.111 16:50:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:15.111 16:50:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:15.111 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:26:15.111 16:50:40 -- nvmf/common.sh@469 -- # nvmfpid=1276524 00:26:15.111 16:50:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:15.111 16:50:40 -- nvmf/common.sh@470 -- # waitforlisten 1276524 00:26:15.111 16:50:40 -- common/autotest_common.sh@819 -- # '[' -z 1276524 ']' 00:26:15.111 16:50:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:15.111 16:50:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:15.111 16:50:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:15.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:15.111 16:50:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:15.111 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:26:15.111 [2024-10-13 16:50:40.531796] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:15.111 [2024-10-13 16:50:40.531886] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:15.111 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.111 [2024-10-13 16:50:40.601205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:15.370 [2024-10-13 16:50:40.690781] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:15.370 [2024-10-13 16:50:40.690941] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:15.370 [2024-10-13 16:50:40.690960] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:15.370 [2024-10-13 16:50:40.690975] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:15.370 [2024-10-13 16:50:40.691061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:15.370 [2024-10-13 16:50:40.691185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:15.370 [2024-10-13 16:50:40.691254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:15.370 [2024-10-13 16:50:40.691256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:16.304 16:50:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:16.304 16:50:41 -- common/autotest_common.sh@852 -- # return 0 00:26:16.304 16:50:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:16.304 16:50:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:16.304 16:50:41 -- common/autotest_common.sh@10 -- # set +x 00:26:16.304 16:50:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:16.304 16:50:41 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:16.304 16:50:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.304 16:50:41 -- common/autotest_common.sh@10 -- # set +x 00:26:16.304 [2024-10-13 16:50:41.519056] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.304 16:50:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.304 16:50:41 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:16.304 16:50:41 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:16.304 16:50:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:16.304 16:50:41 -- common/autotest_common.sh@10 -- # set +x 00:26:16.304 16:50:41 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:16.304 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.304 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:16.305 16:50:41 -- target/shutdown.sh@28 -- # cat 00:26:16.305 16:50:41 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:16.305 16:50:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.305 16:50:41 -- common/autotest_common.sh@10 -- # set +x 00:26:16.305 Malloc1 00:26:16.305 [2024-10-13 16:50:41.594950] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.305 Malloc2 00:26:16.305 Malloc3 00:26:16.305 Malloc4 00:26:16.305 Malloc5 00:26:16.564 Malloc6 00:26:16.564 Malloc7 00:26:16.564 Malloc8 00:26:16.564 Malloc9 00:26:16.564 Malloc10 00:26:16.564 16:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.564 16:50:42 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:16.564 16:50:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:16.564 16:50:42 -- common/autotest_common.sh@10 -- # set +x 00:26:16.564 16:50:42 -- target/shutdown.sh@124 -- # perfpid=1276770 00:26:16.564 16:50:42 -- target/shutdown.sh@125 -- # waitforlisten 1276770 /var/tmp/bdevperf.sock 00:26:16.564 16:50:42 -- common/autotest_common.sh@819 -- # '[' -z 1276770 ']' 00:26:16.564 16:50:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:16.564 16:50:42 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:16.564 16:50:42 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:16.564 16:50:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:16.564 16:50:42 -- nvmf/common.sh@520 -- # config=() 00:26:16.564 16:50:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:16.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:16.564 16:50:42 -- nvmf/common.sh@520 -- # local subsystem config 00:26:16.564 16:50:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.564 16:50:42 -- common/autotest_common.sh@10 -- # set +x 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.564 { 00:26:16.564 "params": { 00:26:16.564 "name": "Nvme$subsystem", 00:26:16.564 "trtype": "$TEST_TRANSPORT", 00:26:16.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.564 "adrfam": "ipv4", 00:26:16.564 "trsvcid": "$NVMF_PORT", 00:26:16.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.564 "hdgst": ${hdgst:-false}, 00:26:16.564 "ddgst": ${ddgst:-false} 00:26:16.564 }, 00:26:16.564 "method": "bdev_nvme_attach_controller" 00:26:16.564 } 00:26:16.564 EOF 00:26:16.564 )") 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.564 { 00:26:16.564 "params": { 00:26:16.564 "name": "Nvme$subsystem", 00:26:16.564 "trtype": "$TEST_TRANSPORT", 00:26:16.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.564 "adrfam": "ipv4", 00:26:16.564 "trsvcid": "$NVMF_PORT", 00:26:16.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.564 "hdgst": ${hdgst:-false}, 00:26:16.564 "ddgst": ${ddgst:-false} 00:26:16.564 }, 00:26:16.564 "method": "bdev_nvme_attach_controller" 00:26:16.564 } 00:26:16.564 EOF 00:26:16.564 )") 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.564 { 00:26:16.564 "params": { 00:26:16.564 "name": "Nvme$subsystem", 00:26:16.564 "trtype": "$TEST_TRANSPORT", 00:26:16.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.564 "adrfam": "ipv4", 00:26:16.564 "trsvcid": "$NVMF_PORT", 00:26:16.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.564 "hdgst": ${hdgst:-false}, 00:26:16.564 "ddgst": ${ddgst:-false} 00:26:16.564 }, 00:26:16.564 "method": "bdev_nvme_attach_controller" 00:26:16.564 } 00:26:16.564 EOF 00:26:16.564 )") 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.564 { 00:26:16.564 "params": { 00:26:16.564 "name": "Nvme$subsystem", 00:26:16.564 "trtype": "$TEST_TRANSPORT", 00:26:16.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.564 "adrfam": "ipv4", 00:26:16.564 "trsvcid": "$NVMF_PORT", 00:26:16.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.564 "hdgst": ${hdgst:-false}, 00:26:16.564 "ddgst": ${ddgst:-false} 00:26:16.564 }, 00:26:16.564 "method": "bdev_nvme_attach_controller" 00:26:16.564 } 00:26:16.564 EOF 00:26:16.564 )") 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.564 { 00:26:16.564 "params": { 00:26:16.564 "name": "Nvme$subsystem", 00:26:16.564 "trtype": "$TEST_TRANSPORT", 00:26:16.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.564 "adrfam": "ipv4", 00:26:16.564 "trsvcid": "$NVMF_PORT", 00:26:16.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.564 "hdgst": ${hdgst:-false}, 00:26:16.564 "ddgst": ${ddgst:-false} 00:26:16.564 }, 00:26:16.564 "method": "bdev_nvme_attach_controller" 00:26:16.564 } 00:26:16.564 EOF 00:26:16.564 )") 00:26:16.564 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.564 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.565 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.565 { 00:26:16.565 "params": { 00:26:16.565 "name": "Nvme$subsystem", 00:26:16.565 "trtype": "$TEST_TRANSPORT", 00:26:16.565 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.565 "adrfam": "ipv4", 00:26:16.565 "trsvcid": "$NVMF_PORT", 00:26:16.565 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.565 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.565 "hdgst": ${hdgst:-false}, 00:26:16.565 "ddgst": ${ddgst:-false} 00:26:16.565 }, 00:26:16.565 "method": "bdev_nvme_attach_controller" 00:26:16.565 } 00:26:16.565 EOF 00:26:16.565 )") 00:26:16.565 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.824 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.824 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.824 { 00:26:16.824 "params": { 00:26:16.824 "name": "Nvme$subsystem", 00:26:16.824 "trtype": "$TEST_TRANSPORT", 00:26:16.824 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.824 "adrfam": "ipv4", 00:26:16.824 "trsvcid": "$NVMF_PORT", 00:26:16.824 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.824 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.824 "hdgst": ${hdgst:-false}, 00:26:16.824 "ddgst": ${ddgst:-false} 00:26:16.824 }, 00:26:16.824 "method": "bdev_nvme_attach_controller" 00:26:16.824 } 00:26:16.824 EOF 00:26:16.824 )") 00:26:16.824 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.824 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.824 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.824 { 00:26:16.824 "params": { 00:26:16.824 "name": "Nvme$subsystem", 00:26:16.824 "trtype": "$TEST_TRANSPORT", 00:26:16.824 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.824 "adrfam": "ipv4", 00:26:16.824 "trsvcid": "$NVMF_PORT", 00:26:16.824 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.824 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.824 "hdgst": ${hdgst:-false}, 00:26:16.824 "ddgst": ${ddgst:-false} 00:26:16.824 }, 00:26:16.824 "method": "bdev_nvme_attach_controller" 00:26:16.824 } 00:26:16.824 EOF 00:26:16.824 )") 00:26:16.824 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.824 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.824 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.824 { 00:26:16.824 "params": { 00:26:16.824 "name": "Nvme$subsystem", 00:26:16.824 "trtype": "$TEST_TRANSPORT", 00:26:16.824 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.824 "adrfam": "ipv4", 00:26:16.824 "trsvcid": "$NVMF_PORT", 00:26:16.824 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.824 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.824 "hdgst": ${hdgst:-false}, 00:26:16.824 "ddgst": ${ddgst:-false} 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 } 00:26:16.825 EOF 00:26:16.825 )") 00:26:16.825 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.825 16:50:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:16.825 16:50:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:16.825 { 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme$subsystem", 00:26:16.825 "trtype": "$TEST_TRANSPORT", 00:26:16.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "$NVMF_PORT", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:16.825 "hdgst": ${hdgst:-false}, 00:26:16.825 "ddgst": ${ddgst:-false} 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 } 00:26:16.825 EOF 00:26:16.825 )") 00:26:16.825 16:50:42 -- nvmf/common.sh@542 -- # cat 00:26:16.825 16:50:42 -- nvmf/common.sh@544 -- # jq . 00:26:16.825 16:50:42 -- nvmf/common.sh@545 -- # IFS=, 00:26:16.825 16:50:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme1", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme2", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme3", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme4", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme5", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme6", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme7", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme8", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme9", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 },{ 00:26:16.825 "params": { 00:26:16.825 "name": "Nvme10", 00:26:16.825 "trtype": "tcp", 00:26:16.825 "traddr": "10.0.0.2", 00:26:16.825 "adrfam": "ipv4", 00:26:16.825 "trsvcid": "4420", 00:26:16.825 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:16.825 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:16.825 "hdgst": false, 00:26:16.825 "ddgst": false 00:26:16.825 }, 00:26:16.825 "method": "bdev_nvme_attach_controller" 00:26:16.825 }' 00:26:16.825 [2024-10-13 16:50:42.086243] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:16.825 [2024-10-13 16:50:42.086316] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1276770 ] 00:26:16.825 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.825 [2024-10-13 16:50:42.148064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.825 [2024-10-13 16:50:42.237694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:18.202 Running I/O for 10 seconds... 00:26:18.460 16:50:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:18.460 16:50:43 -- common/autotest_common.sh@852 -- # return 0 00:26:18.460 16:50:43 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:18.460 16:50:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.460 16:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:18.460 16:50:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.460 16:50:43 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:18.460 16:50:43 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:18.461 16:50:43 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:18.461 16:50:43 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:18.461 16:50:43 -- target/shutdown.sh@57 -- # local ret=1 00:26:18.461 16:50:43 -- target/shutdown.sh@58 -- # local i 00:26:18.461 16:50:43 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:18.461 16:50:43 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:18.461 16:50:43 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:18.461 16:50:43 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:18.461 16:50:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.461 16:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:18.719 16:50:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.719 16:50:43 -- target/shutdown.sh@60 -- # read_io_count=42 00:26:18.719 16:50:43 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:26:18.719 16:50:43 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:18.990 16:50:44 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:18.990 16:50:44 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:18.990 16:50:44 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:18.990 16:50:44 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:18.990 16:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.990 16:50:44 -- common/autotest_common.sh@10 -- # set +x 00:26:18.990 16:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.990 16:50:44 -- target/shutdown.sh@60 -- # read_io_count=169 00:26:18.990 16:50:44 -- target/shutdown.sh@63 -- # '[' 169 -ge 100 ']' 00:26:18.990 16:50:44 -- target/shutdown.sh@64 -- # ret=0 00:26:18.990 16:50:44 -- target/shutdown.sh@65 -- # break 00:26:18.990 16:50:44 -- target/shutdown.sh@69 -- # return 0 00:26:18.990 16:50:44 -- target/shutdown.sh@134 -- # killprocess 1276524 00:26:18.990 16:50:44 -- common/autotest_common.sh@926 -- # '[' -z 1276524 ']' 00:26:18.990 16:50:44 -- common/autotest_common.sh@930 -- # kill -0 1276524 00:26:18.990 16:50:44 -- common/autotest_common.sh@931 -- # uname 00:26:18.990 16:50:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:18.990 16:50:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1276524 00:26:18.990 16:50:44 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:18.990 16:50:44 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:18.990 16:50:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1276524' 00:26:18.990 killing process with pid 1276524 00:26:18.990 16:50:44 -- common/autotest_common.sh@945 -- # kill 1276524 00:26:18.990 16:50:44 -- common/autotest_common.sh@950 -- # wait 1276524 00:26:18.990 [2024-10-13 16:50:44.337153] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337287] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337337] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337353] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337587] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337598] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337656] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337674] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337817] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337894] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337913] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337930] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337954] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.337990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.338114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a3fe70 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.340934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.340969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.340985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.340997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341033] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341045] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341057] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341117] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.991 [2024-10-13 16:50:44.341140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341152] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341187] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341224] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341248] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341631] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341643] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.341727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42840 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.343293] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a407b0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.343830] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c40 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.343864] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a40c40 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a410f0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a410f0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a410f0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a410f0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a415a0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.344712] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a415a0 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.345435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a41a30 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.346431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42390 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.374294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.992 [2024-10-13 16:50:44.374404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.992 [2024-10-13 16:50:44.374435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.992 [2024-10-13 16:50:44.374470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.992 [2024-10-13 16:50:44.374496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a5e80 is same with the state(5) to be set 00:26:18.992 [2024-10-13 16:50:44.374560] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.992 [2024-10-13 16:50:44.374595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.992 [2024-10-13 16:50:44.374608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x79f960 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.374732] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374793] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374819] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x604200 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.374905] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.374978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.374992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x781980 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x602710 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375332] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d7fe0 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375489] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x623190 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375648] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375673] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x79f240 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375808] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375842] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x629c00 is same with the state(5) to be set 00:26:18.993 [2024-10-13 16:50:44.375914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.375974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.993 [2024-10-13 16:50:44.375987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.993 [2024-10-13 16:50:44.376000] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.994 [2024-10-13 16:50:44.376013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x62f4f0 is same with the state(5) to be set 00:26:18.994 [2024-10-13 16:50:44.376172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.376983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.376998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.994 [2024-10-13 16:50:44.377222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.994 [2024-10-13 16:50:44.377235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.377983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.377997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.378011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.378028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.378041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.378055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x74fe90 is same with the state(5) to be set 00:26:18.995 [2024-10-13 16:50:44.378134] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x74fe90 was disconnected and freed. reset controller. 00:26:18.995 [2024-10-13 16:50:44.378200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.995 [2024-10-13 16:50:44.378221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.995 [2024-10-13 16:50:44.378241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.378974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.378987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.996 [2024-10-13 16:50:44.379303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.996 [2024-10-13 16:50:44.379318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.379977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.379990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x75c1e0 is same with the state(5) to be set 00:26:18.997 [2024-10-13 16:50:44.380129] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x75c1e0 was disconnected and freed. reset controller. 00:26:18.997 [2024-10-13 16:50:44.380182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.997 [2024-10-13 16:50:44.380495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.997 [2024-10-13 16:50:44.380508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.380980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.380995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.998 [2024-10-13 16:50:44.381522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.998 [2024-10-13 16:50:44.381535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.381981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.381998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c6d20 is same with the state(5) to be set 00:26:18.999 [2024-10-13 16:50:44.382070] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5c6d20 was disconnected and freed. reset controller. 00:26:18.999 [2024-10-13 16:50:44.389539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.389978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.389992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:18.999 [2024-10-13 16:50:44.390192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.999 [2024-10-13 16:50:44.390207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.390982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.390995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.391023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.391051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.391084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.391113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.000 [2024-10-13 16:50:44.391142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.000 [2024-10-13 16:50:44.391158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.391505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.391520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c98e0 is same with the state(5) to be set 00:26:19.001 [2024-10-13 16:50:44.391602] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5c98e0 was disconnected and freed. reset controller. 00:26:19.001 [2024-10-13 16:50:44.400301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7a5e80 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x79f960 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x604200 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x781980 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x602710 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d7fe0 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x623190 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x79f240 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x629c00 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.400609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x62f4f0 (9): Bad file descriptor 00:26:19.001 [2024-10-13 16:50:44.404140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.001 [2024-10-13 16:50:44.404739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.001 [2024-10-13 16:50:44.404753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.404975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.404990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.002 [2024-10-13 16:50:44.405828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.002 [2024-10-13 16:50:44.405843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.405871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.405899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.405927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.405956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.405985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.405998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.406013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.406026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.406130] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5c8300 was disconnected and freed. reset controller. 00:26:19.003 [2024-10-13 16:50:44.407294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.407978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.407993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.003 [2024-10-13 16:50:44.408194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.003 [2024-10-13 16:50:44.408207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.408982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.408998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.004 [2024-10-13 16:50:44.409192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.004 [2024-10-13 16:50:44.409207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5caec0 is same with the state(5) to be set 00:26:19.004 [2024-10-13 16:50:44.409281] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5caec0 was disconnected and freed. reset controller. 00:26:19.004 [2024-10-13 16:50:44.410348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:19.004 [2024-10-13 16:50:44.410451] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.004 [2024-10-13 16:50:44.410491] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.004 [2024-10-13 16:50:44.410513] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.004 [2024-10-13 16:50:44.410539] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.004 [2024-10-13 16:50:44.410571] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.005 [2024-10-13 16:50:44.412961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.412989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.413725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.413740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.414574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5cc4a0 is same with the state(5) to be set 00:26:19.005 [2024-10-13 16:50:44.414658] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5cc4a0 was disconnected and freed. reset controller. 00:26:19.005 [2024-10-13 16:50:44.414676] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.005 [2024-10-13 16:50:44.415605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:26:19.005 [2024-10-13 16:50:44.415637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:26:19.005 [2024-10-13 16:50:44.415824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.005 [2024-10-13 16:50:44.415937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.005 [2024-10-13 16:50:44.415963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x604200 with addr=10.0.0.2, port=4420 00:26:19.005 [2024-10-13 16:50:44.415980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x604200 is same with the state(5) to be set 00:26:19.005 [2024-10-13 16:50:44.417187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.005 [2024-10-13 16:50:44.417475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.005 [2024-10-13 16:50:44.417494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.417915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.417931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.418757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5cda80 is same with the state(5) to be set 00:26:19.006 [2024-10-13 16:50:44.419937] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5cda80 was disconnected and freed. reset controller. 00:26:19.006 [2024-10-13 16:50:44.419961] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.006 [2024-10-13 16:50:44.420025] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:26:19.006 [2024-10-13 16:50:44.420086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:26:19.006 [2024-10-13 16:50:44.420209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.006 [2024-10-13 16:50:44.420305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.006 [2024-10-13 16:50:44.420330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x602710 with addr=10.0.0.2, port=4420 00:26:19.006 [2024-10-13 16:50:44.420346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x602710 is same with the state(5) to be set 00:26:19.006 [2024-10-13 16:50:44.420426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.006 [2024-10-13 16:50:44.420533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.006 [2024-10-13 16:50:44.420557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x781980 with addr=10.0.0.2, port=4420 00:26:19.006 [2024-10-13 16:50:44.420573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x781980 is same with the state(5) to be set 00:26:19.006 [2024-10-13 16:50:44.420596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x604200 (9): Bad file descriptor 00:26:19.006 [2024-10-13 16:50:44.420660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.420981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.420997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.006 [2024-10-13 16:50:44.421202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.006 [2024-10-13 16:50:44.421216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.421986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.421999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.007 [2024-10-13 16:50:44.422285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.007 [2024-10-13 16:50:44.422299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.422489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.422501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.424973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.424988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.008 [2024-10-13 16:50:44.425537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.008 [2024-10-13 16:50:44.425550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.425981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.425996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:19.009 [2024-10-13 16:50:44.426509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:19.009 [2024-10-13 16:50:44.426524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5cf060 is same with the state(5) to be set 00:26:19.009 [2024-10-13 16:50:44.428165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:26:19.010 [2024-10-13 16:50:44.428195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:19.010 [2024-10-13 16:50:44.428215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:26:19.010 [2024-10-13 16:50:44.428233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:26:19.010 [2024-10-13 16:50:44.428251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:26:19.010 [2024-10-13 16:50:44.428457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.428548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.428572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x62f4f0 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.428588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x62f4f0 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.428613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x602710 (9): Bad file descriptor 00:26:19.010 [2024-10-13 16:50:44.428633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x781980 (9): Bad file descriptor 00:26:19.010 [2024-10-13 16:50:44.428649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:26:19.010 [2024-10-13 16:50:44.428662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:26:19.010 [2024-10-13 16:50:44.428678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:19.010 [2024-10-13 16:50:44.428715] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.010 [2024-10-13 16:50:44.428749] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.010 [2024-10-13 16:50:44.428792] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.010 [2024-10-13 16:50:44.428815] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.010 task offset: 34816 on job bdev=Nvme2n1 fails 00:26:19.010 00:26:19.010 Latency(us) 00:26:19.010 [2024-10-13T14:50:44.511Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme1n1 ended in about 0.72 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme1n1 : 0.72 291.97 18.25 88.56 0.00 167066.05 23787.14 176316.11 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme2n1 ended in about 0.70 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme2n1 : 0.70 358.09 22.38 91.31 0.00 139873.01 52817.16 119615.34 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme3n1 ended in about 0.70 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme3n1 : 0.70 357.52 22.35 91.16 0.00 138584.95 45632.47 118061.89 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme4n1 ended in about 0.70 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme4n1 : 0.70 356.97 22.31 91.02 0.00 137273.45 38447.79 116508.44 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme5n1 ended in about 0.71 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme5n1 : 0.71 354.50 22.16 90.03 0.00 136910.02 21456.97 131266.18 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme6n1 ended in about 0.71 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme6n1 : 0.71 355.35 22.21 90.61 0.00 134880.41 32622.36 117285.17 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme7n1 ended in about 0.71 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme7n1 : 0.71 352.55 22.03 89.89 0.00 134545.14 12184.84 119615.34 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme8n1 ended in about 0.71 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme8n1 : 0.71 351.72 21.98 29.43 0.00 153946.20 3543.80 128159.29 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme9n1 ended in about 0.72 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme9n1 : 0.72 349.67 21.85 29.26 0.00 153353.06 2378.71 124275.67 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:19.010 [2024-10-13T14:50:44.511Z] Job: Nvme10n1 ended in about 0.73 seconds with error 00:26:19.010 Verification LBA range: start 0x0 length 0x400 00:26:19.010 Nvme10n1 : 0.73 286.23 17.89 88.07 0.00 154138.82 96313.65 125052.40 00:26:19.010 [2024-10-13T14:50:44.511Z] =================================================================================================================== 00:26:19.010 [2024-10-13T14:50:44.511Z] Total : 3414.57 213.41 779.33 0.00 144380.39 2378.71 176316.11 00:26:19.010 [2024-10-13 16:50:44.457735] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:26:19.010 [2024-10-13 16:50:44.457816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:26:19.010 [2024-10-13 16:50:44.457868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.010 [2024-10-13 16:50:44.458084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x623190 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.458237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x623190 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.458330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d7fe0 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.458462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d7fe0 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.458551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7a5e80 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.458675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a5e80 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.458759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.458952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x79f960 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.458968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x79f960 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.459045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.459123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.010 [2024-10-13 16:50:44.459146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x629c00 with addr=10.0.0.2, port=4420 00:26:19.010 [2024-10-13 16:50:44.459161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x629c00 is same with the state(5) to be set 00:26:19.010 [2024-10-13 16:50:44.459187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x62f4f0 (9): Bad file descriptor 00:26:19.010 [2024-10-13 16:50:44.459208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:26:19.010 [2024-10-13 16:50:44.459221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:26:19.010 [2024-10-13 16:50:44.459236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:26:19.010 [2024-10-13 16:50:44.459264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.459277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.459290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:26:19.011 [2024-10-13 16:50:44.459968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.459993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.460119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.460223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.460254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x79f240 with addr=10.0.0.2, port=4420 00:26:19.011 [2024-10-13 16:50:44.460270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x79f240 is same with the state(5) to be set 00:26:19.011 [2024-10-13 16:50:44.460289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x623190 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d7fe0 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7a5e80 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x79f960 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x629c00 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460446] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460516] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460539] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460557] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460575] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460593] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:19.011 [2024-10-13 16:50:44.460670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.460715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x79f240 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.460734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.460919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.460931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:26:19.011 [2024-10-13 16:50:44.460992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:19.011 [2024-10-13 16:50:44.461015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:26:19.011 [2024-10-13 16:50:44.461030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:26:19.011 [2024-10-13 16:50:44.461045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.461125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.461137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:26:19.011 [2024-10-13 16:50:44.461164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.461275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x604200 with addr=10.0.0.2, port=4420 00:26:19.011 [2024-10-13 16:50:44.461391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x604200 is same with the state(5) to be set 00:26:19.011 [2024-10-13 16:50:44.461489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x781980 with addr=10.0.0.2, port=4420 00:26:19.011 [2024-10-13 16:50:44.461610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x781980 is same with the state(5) to be set 00:26:19.011 [2024-10-13 16:50:44.461682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:19.011 [2024-10-13 16:50:44.461794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x602710 with addr=10.0.0.2, port=4420 00:26:19.011 [2024-10-13 16:50:44.461810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x602710 is same with the state(5) to be set 00:26:19.011 [2024-10-13 16:50:44.461856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x604200 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.461880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x781980 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.461897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x602710 (9): Bad file descriptor 00:26:19.011 [2024-10-13 16:50:44.461936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.461959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.461973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:19.011 [2024-10-13 16:50:44.461989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.462002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.462014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:26:19.011 [2024-10-13 16:50:44.462028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:26:19.011 [2024-10-13 16:50:44.462041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:26:19.011 [2024-10-13 16:50:44.462054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:26:19.011 [2024-10-13 16:50:44.462095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.462112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.011 [2024-10-13 16:50:44.462123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:19.578 16:50:44 -- target/shutdown.sh@135 -- # nvmfpid= 00:26:19.578 16:50:44 -- target/shutdown.sh@138 -- # sleep 1 00:26:20.518 16:50:45 -- target/shutdown.sh@141 -- # kill -9 1276770 00:26:20.518 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1276770) - No such process 00:26:20.518 16:50:45 -- target/shutdown.sh@141 -- # true 00:26:20.518 16:50:45 -- target/shutdown.sh@143 -- # stoptarget 00:26:20.518 16:50:45 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:20.518 16:50:45 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:20.518 16:50:45 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:20.518 16:50:45 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:20.518 16:50:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:20.518 16:50:45 -- nvmf/common.sh@116 -- # sync 00:26:20.518 16:50:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:20.518 16:50:45 -- nvmf/common.sh@119 -- # set +e 00:26:20.518 16:50:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:20.518 16:50:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:20.518 rmmod nvme_tcp 00:26:20.518 rmmod nvme_fabrics 00:26:20.518 rmmod nvme_keyring 00:26:20.518 16:50:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:20.518 16:50:45 -- nvmf/common.sh@123 -- # set -e 00:26:20.518 16:50:45 -- nvmf/common.sh@124 -- # return 0 00:26:20.518 16:50:45 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:26:20.518 16:50:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:20.518 16:50:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:20.518 16:50:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:20.518 16:50:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:20.518 16:50:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:20.518 16:50:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:20.518 16:50:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:20.518 16:50:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:23.057 16:50:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:23.057 00:26:23.057 real 0m7.652s 00:26:23.057 user 0m19.260s 00:26:23.057 sys 0m1.427s 00:26:23.057 16:50:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:23.057 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:26:23.057 ************************************ 00:26:23.057 END TEST nvmf_shutdown_tc3 00:26:23.057 ************************************ 00:26:23.057 16:50:48 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:26:23.057 00:26:23.057 real 0m28.464s 00:26:23.057 user 1m23.017s 00:26:23.057 sys 0m6.192s 00:26:23.057 16:50:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:23.057 16:50:48 -- common/autotest_common.sh@10 -- # set +x 00:26:23.057 ************************************ 00:26:23.057 END TEST nvmf_shutdown 00:26:23.057 ************************************ 00:26:23.057 16:50:48 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:26:23.057 16:50:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:23.057 16:50:48 -- common/autotest_common.sh@10 -- # set +x 00:26:23.057 16:50:48 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:26:23.057 16:50:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:23.057 16:50:48 -- common/autotest_common.sh@10 -- # set +x 00:26:23.057 16:50:48 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:26:23.057 16:50:48 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:23.057 16:50:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:23.057 16:50:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:23.057 16:50:48 -- common/autotest_common.sh@10 -- # set +x 00:26:23.057 ************************************ 00:26:23.057 START TEST nvmf_multicontroller 00:26:23.057 ************************************ 00:26:23.057 16:50:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:23.057 * Looking for test storage... 00:26:23.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:23.057 16:50:48 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:23.057 16:50:48 -- nvmf/common.sh@7 -- # uname -s 00:26:23.057 16:50:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:23.057 16:50:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:23.057 16:50:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:23.057 16:50:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:23.057 16:50:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:23.057 16:50:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:23.057 16:50:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:23.057 16:50:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:23.057 16:50:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:23.057 16:50:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:23.057 16:50:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:23.057 16:50:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:23.057 16:50:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:23.057 16:50:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:23.057 16:50:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:23.057 16:50:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:23.057 16:50:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:23.057 16:50:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:23.057 16:50:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:23.057 16:50:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.057 16:50:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.057 16:50:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.057 16:50:48 -- paths/export.sh@5 -- # export PATH 00:26:23.057 16:50:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.057 16:50:48 -- nvmf/common.sh@46 -- # : 0 00:26:23.057 16:50:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:23.057 16:50:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:23.057 16:50:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:23.057 16:50:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:23.057 16:50:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:23.057 16:50:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:23.057 16:50:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:23.057 16:50:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:23.057 16:50:48 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:23.057 16:50:48 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:23.057 16:50:48 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:26:23.057 16:50:48 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:26:23.058 16:50:48 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:23.058 16:50:48 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:26:23.058 16:50:48 -- host/multicontroller.sh@23 -- # nvmftestinit 00:26:23.058 16:50:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:23.058 16:50:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:23.058 16:50:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:23.058 16:50:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:23.058 16:50:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:23.058 16:50:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:23.058 16:50:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:23.058 16:50:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:23.058 16:50:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:23.058 16:50:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:23.058 16:50:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:23.058 16:50:48 -- common/autotest_common.sh@10 -- # set +x 00:26:25.008 16:50:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:25.008 16:50:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:25.008 16:50:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:25.008 16:50:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:25.008 16:50:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:25.008 16:50:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:25.008 16:50:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:25.008 16:50:50 -- nvmf/common.sh@294 -- # net_devs=() 00:26:25.008 16:50:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:25.008 16:50:50 -- nvmf/common.sh@295 -- # e810=() 00:26:25.008 16:50:50 -- nvmf/common.sh@295 -- # local -ga e810 00:26:25.008 16:50:50 -- nvmf/common.sh@296 -- # x722=() 00:26:25.008 16:50:50 -- nvmf/common.sh@296 -- # local -ga x722 00:26:25.008 16:50:50 -- nvmf/common.sh@297 -- # mlx=() 00:26:25.008 16:50:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:25.008 16:50:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:25.008 16:50:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:25.008 16:50:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:25.008 16:50:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:25.008 16:50:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:25.008 16:50:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:25.008 16:50:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:25.008 16:50:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:25.009 16:50:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:25.009 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:25.009 16:50:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:25.009 16:50:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:25.009 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:25.009 16:50:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:25.009 16:50:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:25.009 16:50:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:25.009 16:50:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:25.009 16:50:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:25.009 16:50:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:25.009 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:25.009 16:50:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:25.009 16:50:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:25.009 16:50:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:25.009 16:50:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:25.009 16:50:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:25.009 16:50:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:25.009 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:25.009 16:50:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:25.009 16:50:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:25.009 16:50:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:25.009 16:50:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:25.009 16:50:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:25.009 16:50:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:25.009 16:50:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:25.009 16:50:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:25.009 16:50:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:25.009 16:50:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:25.009 16:50:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:25.009 16:50:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:25.009 16:50:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:25.009 16:50:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:25.009 16:50:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:25.009 16:50:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:25.009 16:50:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:25.009 16:50:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:25.009 16:50:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:25.009 16:50:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:25.009 16:50:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:25.009 16:50:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:25.009 16:50:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:25.009 16:50:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:25.009 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:25.009 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:26:25.009 00:26:25.009 --- 10.0.0.2 ping statistics --- 00:26:25.009 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:25.009 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:26:25.009 16:50:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:25.009 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:25.009 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:26:25.009 00:26:25.009 --- 10.0.0.1 ping statistics --- 00:26:25.009 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:25.009 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:26:25.009 16:50:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:25.009 16:50:50 -- nvmf/common.sh@410 -- # return 0 00:26:25.009 16:50:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:25.009 16:50:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:25.009 16:50:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:25.009 16:50:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:25.009 16:50:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:25.009 16:50:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:25.009 16:50:50 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:26:25.009 16:50:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:25.009 16:50:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:25.009 16:50:50 -- common/autotest_common.sh@10 -- # set +x 00:26:25.009 16:50:50 -- nvmf/common.sh@469 -- # nvmfpid=1279188 00:26:25.009 16:50:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:25.009 16:50:50 -- nvmf/common.sh@470 -- # waitforlisten 1279188 00:26:25.009 16:50:50 -- common/autotest_common.sh@819 -- # '[' -z 1279188 ']' 00:26:25.009 16:50:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:25.009 16:50:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:25.009 16:50:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:25.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:25.009 16:50:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:25.009 16:50:50 -- common/autotest_common.sh@10 -- # set +x 00:26:25.009 [2024-10-13 16:50:50.373583] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:25.009 [2024-10-13 16:50:50.373667] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:25.009 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.009 [2024-10-13 16:50:50.446984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:25.299 [2024-10-13 16:50:50.540717] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:25.299 [2024-10-13 16:50:50.540855] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:25.299 [2024-10-13 16:50:50.540873] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:25.299 [2024-10-13 16:50:50.540885] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:25.299 [2024-10-13 16:50:50.540935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:25.299 [2024-10-13 16:50:50.540972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:25.299 [2024-10-13 16:50:50.540975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:25.865 16:50:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:25.865 16:50:51 -- common/autotest_common.sh@852 -- # return 0 00:26:25.865 16:50:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:25.865 16:50:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:25.865 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:26.124 16:50:51 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 [2024-10-13 16:50:51.380090] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 Malloc0 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 [2024-10-13 16:50:51.446875] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 [2024-10-13 16:50:51.454725] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 Malloc1 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:26:26.124 16:50:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.124 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:26.124 16:50:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.124 16:50:51 -- host/multicontroller.sh@44 -- # bdevperf_pid=1279356 00:26:26.124 16:50:51 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:26.124 16:50:51 -- host/multicontroller.sh@47 -- # waitforlisten 1279356 /var/tmp/bdevperf.sock 00:26:26.124 16:50:51 -- common/autotest_common.sh@819 -- # '[' -z 1279356 ']' 00:26:26.125 16:50:51 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:26:26.125 16:50:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:26.125 16:50:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:26.125 16:50:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:26.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:26.125 16:50:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:26.125 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:26:27.058 16:50:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:27.058 16:50:52 -- common/autotest_common.sh@852 -- # return 0 00:26:27.058 16:50:52 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:27.058 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.058 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.321 NVMe0n1 00:26:27.321 16:50:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.321 16:50:52 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:27.321 16:50:52 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:26:27.321 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.321 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.321 16:50:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.321 1 00:26:27.321 16:50:52 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:27.321 16:50:52 -- common/autotest_common.sh@640 -- # local es=0 00:26:27.321 16:50:52 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:27.321 16:50:52 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:27.321 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.321 16:50:52 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:27.321 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.321 16:50:52 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:27.321 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.321 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.321 request: 00:26:27.321 { 00:26:27.321 "name": "NVMe0", 00:26:27.321 "trtype": "tcp", 00:26:27.321 "traddr": "10.0.0.2", 00:26:27.321 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:26:27.321 "hostaddr": "10.0.0.2", 00:26:27.321 "hostsvcid": "60000", 00:26:27.321 "adrfam": "ipv4", 00:26:27.321 "trsvcid": "4420", 00:26:27.321 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:27.321 "method": "bdev_nvme_attach_controller", 00:26:27.321 "req_id": 1 00:26:27.322 } 00:26:27.322 Got JSON-RPC error response 00:26:27.322 response: 00:26:27.322 { 00:26:27.322 "code": -114, 00:26:27.322 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:27.322 } 00:26:27.322 16:50:52 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # es=1 00:26:27.322 16:50:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:27.322 16:50:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:27.322 16:50:52 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:27.322 16:50:52 -- common/autotest_common.sh@640 -- # local es=0 00:26:27.322 16:50:52 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:27.322 16:50:52 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:27.322 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.322 request: 00:26:27.322 { 00:26:27.322 "name": "NVMe0", 00:26:27.322 "trtype": "tcp", 00:26:27.322 "traddr": "10.0.0.2", 00:26:27.322 "hostaddr": "10.0.0.2", 00:26:27.322 "hostsvcid": "60000", 00:26:27.322 "adrfam": "ipv4", 00:26:27.322 "trsvcid": "4420", 00:26:27.322 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:27.322 "method": "bdev_nvme_attach_controller", 00:26:27.322 "req_id": 1 00:26:27.322 } 00:26:27.322 Got JSON-RPC error response 00:26:27.322 response: 00:26:27.322 { 00:26:27.322 "code": -114, 00:26:27.322 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:27.322 } 00:26:27.322 16:50:52 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # es=1 00:26:27.322 16:50:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:27.322 16:50:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:27.322 16:50:52 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@640 -- # local es=0 00:26:27.322 16:50:52 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.322 request: 00:26:27.322 { 00:26:27.322 "name": "NVMe0", 00:26:27.322 "trtype": "tcp", 00:26:27.322 "traddr": "10.0.0.2", 00:26:27.322 "hostaddr": "10.0.0.2", 00:26:27.322 "hostsvcid": "60000", 00:26:27.322 "adrfam": "ipv4", 00:26:27.322 "trsvcid": "4420", 00:26:27.322 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:27.322 "multipath": "disable", 00:26:27.322 "method": "bdev_nvme_attach_controller", 00:26:27.322 "req_id": 1 00:26:27.322 } 00:26:27.322 Got JSON-RPC error response 00:26:27.322 response: 00:26:27.322 { 00:26:27.322 "code": -114, 00:26:27.322 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:26:27.322 } 00:26:27.322 16:50:52 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # es=1 00:26:27.322 16:50:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:27.322 16:50:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:27.322 16:50:52 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:27.322 16:50:52 -- common/autotest_common.sh@640 -- # local es=0 00:26:27.322 16:50:52 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:27.322 16:50:52 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:27.322 16:50:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:27.322 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.322 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.322 request: 00:26:27.322 { 00:26:27.322 "name": "NVMe0", 00:26:27.322 "trtype": "tcp", 00:26:27.322 "traddr": "10.0.0.2", 00:26:27.322 "hostaddr": "10.0.0.2", 00:26:27.322 "hostsvcid": "60000", 00:26:27.322 "adrfam": "ipv4", 00:26:27.322 "trsvcid": "4420", 00:26:27.322 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:27.322 "multipath": "failover", 00:26:27.322 "method": "bdev_nvme_attach_controller", 00:26:27.322 "req_id": 1 00:26:27.322 } 00:26:27.322 Got JSON-RPC error response 00:26:27.322 response: 00:26:27.322 { 00:26:27.322 "code": -114, 00:26:27.322 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:27.322 } 00:26:27.322 16:50:52 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@643 -- # es=1 00:26:27.322 16:50:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:27.322 16:50:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:27.322 16:50:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:27.323 16:50:52 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:27.323 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.323 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.581 00:26:27.581 16:50:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.581 16:50:52 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:27.581 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.581 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.581 16:50:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.581 16:50:52 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:27.581 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.581 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.581 00:26:27.581 16:50:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.581 16:50:52 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:27.581 16:50:52 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:26:27.581 16:50:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:27.581 16:50:52 -- common/autotest_common.sh@10 -- # set +x 00:26:27.581 16:50:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:27.581 16:50:53 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:26:27.581 16:50:53 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:28.957 0 00:26:28.957 16:50:54 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:26:28.957 16:50:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:28.957 16:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.957 16:50:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:28.957 16:50:54 -- host/multicontroller.sh@100 -- # killprocess 1279356 00:26:28.958 16:50:54 -- common/autotest_common.sh@926 -- # '[' -z 1279356 ']' 00:26:28.958 16:50:54 -- common/autotest_common.sh@930 -- # kill -0 1279356 00:26:28.958 16:50:54 -- common/autotest_common.sh@931 -- # uname 00:26:28.958 16:50:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:28.958 16:50:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1279356 00:26:28.958 16:50:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:28.958 16:50:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:28.958 16:50:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1279356' 00:26:28.958 killing process with pid 1279356 00:26:28.958 16:50:54 -- common/autotest_common.sh@945 -- # kill 1279356 00:26:28.958 16:50:54 -- common/autotest_common.sh@950 -- # wait 1279356 00:26:28.958 16:50:54 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:28.958 16:50:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:28.958 16:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.958 16:50:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:28.958 16:50:54 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:28.958 16:50:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:28.958 16:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:28.958 16:50:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:28.958 16:50:54 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:26:28.958 16:50:54 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:28.958 16:50:54 -- common/autotest_common.sh@1597 -- # read -r file 00:26:28.958 16:50:54 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:26:28.958 16:50:54 -- common/autotest_common.sh@1596 -- # sort -u 00:26:28.958 16:50:54 -- common/autotest_common.sh@1598 -- # cat 00:26:28.958 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:28.958 [2024-10-13 16:50:51.556472] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:28.958 [2024-10-13 16:50:51.556555] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1279356 ] 00:26:28.958 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.958 [2024-10-13 16:50:51.614359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:28.958 [2024-10-13 16:50:51.697972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:28.958 [2024-10-13 16:50:52.988286] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name dec6e39b-9f5a-4577-a10c-a0ab6d583aa6 already exists 00:26:28.958 [2024-10-13 16:50:52.988323] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:dec6e39b-9f5a-4577-a10c-a0ab6d583aa6 alias for bdev NVMe1n1 00:26:28.958 [2024-10-13 16:50:52.988355] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:26:28.958 Running I/O for 1 seconds... 00:26:28.958 00:26:28.958 Latency(us) 00:26:28.958 [2024-10-13T14:50:54.459Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.958 [2024-10-13T14:50:54.459Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:26:28.958 NVMe0n1 : 1.00 19823.88 77.44 0.00 0.00 6448.28 1966.08 11602.30 00:26:28.958 [2024-10-13T14:50:54.459Z] =================================================================================================================== 00:26:28.958 [2024-10-13T14:50:54.459Z] Total : 19823.88 77.44 0.00 0.00 6448.28 1966.08 11602.30 00:26:28.958 Received shutdown signal, test time was about 1.000000 seconds 00:26:28.958 00:26:28.958 Latency(us) 00:26:28.958 [2024-10-13T14:50:54.459Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.958 [2024-10-13T14:50:54.459Z] =================================================================================================================== 00:26:28.958 [2024-10-13T14:50:54.459Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:28.958 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:28.958 16:50:54 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:28.958 16:50:54 -- common/autotest_common.sh@1597 -- # read -r file 00:26:28.958 16:50:54 -- host/multicontroller.sh@108 -- # nvmftestfini 00:26:28.958 16:50:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:28.958 16:50:54 -- nvmf/common.sh@116 -- # sync 00:26:28.958 16:50:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:28.958 16:50:54 -- nvmf/common.sh@119 -- # set +e 00:26:28.958 16:50:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:28.958 16:50:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:28.958 rmmod nvme_tcp 00:26:28.958 rmmod nvme_fabrics 00:26:28.958 rmmod nvme_keyring 00:26:29.217 16:50:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:29.217 16:50:54 -- nvmf/common.sh@123 -- # set -e 00:26:29.217 16:50:54 -- nvmf/common.sh@124 -- # return 0 00:26:29.217 16:50:54 -- nvmf/common.sh@477 -- # '[' -n 1279188 ']' 00:26:29.217 16:50:54 -- nvmf/common.sh@478 -- # killprocess 1279188 00:26:29.217 16:50:54 -- common/autotest_common.sh@926 -- # '[' -z 1279188 ']' 00:26:29.217 16:50:54 -- common/autotest_common.sh@930 -- # kill -0 1279188 00:26:29.217 16:50:54 -- common/autotest_common.sh@931 -- # uname 00:26:29.217 16:50:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:29.217 16:50:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1279188 00:26:29.217 16:50:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:29.217 16:50:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:29.217 16:50:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1279188' 00:26:29.217 killing process with pid 1279188 00:26:29.217 16:50:54 -- common/autotest_common.sh@945 -- # kill 1279188 00:26:29.217 16:50:54 -- common/autotest_common.sh@950 -- # wait 1279188 00:26:29.477 16:50:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:29.477 16:50:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:29.477 16:50:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:29.477 16:50:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:29.477 16:50:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:29.477 16:50:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:29.477 16:50:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:29.477 16:50:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:31.386 16:50:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:31.386 00:26:31.386 real 0m8.759s 00:26:31.386 user 0m16.695s 00:26:31.386 sys 0m2.342s 00:26:31.386 16:50:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:31.386 16:50:56 -- common/autotest_common.sh@10 -- # set +x 00:26:31.386 ************************************ 00:26:31.386 END TEST nvmf_multicontroller 00:26:31.386 ************************************ 00:26:31.386 16:50:56 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:31.386 16:50:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:31.386 16:50:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:31.386 16:50:56 -- common/autotest_common.sh@10 -- # set +x 00:26:31.386 ************************************ 00:26:31.386 START TEST nvmf_aer 00:26:31.386 ************************************ 00:26:31.386 16:50:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:31.646 * Looking for test storage... 00:26:31.646 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:31.646 16:50:56 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:31.646 16:50:56 -- nvmf/common.sh@7 -- # uname -s 00:26:31.646 16:50:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:31.646 16:50:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:31.646 16:50:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:31.646 16:50:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:31.646 16:50:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:31.646 16:50:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:31.646 16:50:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:31.646 16:50:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:31.646 16:50:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:31.646 16:50:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:31.646 16:50:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:31.646 16:50:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:31.646 16:50:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:31.646 16:50:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:31.646 16:50:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:31.646 16:50:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:31.646 16:50:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:31.646 16:50:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:31.646 16:50:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:31.646 16:50:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:31.646 16:50:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:31.646 16:50:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:31.646 16:50:56 -- paths/export.sh@5 -- # export PATH 00:26:31.646 16:50:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:31.646 16:50:56 -- nvmf/common.sh@46 -- # : 0 00:26:31.646 16:50:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:31.646 16:50:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:31.646 16:50:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:31.646 16:50:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:31.646 16:50:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:31.646 16:50:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:31.646 16:50:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:31.646 16:50:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:31.646 16:50:56 -- host/aer.sh@11 -- # nvmftestinit 00:26:31.646 16:50:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:31.646 16:50:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:31.646 16:50:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:31.646 16:50:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:31.646 16:50:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:31.646 16:50:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:31.646 16:50:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:31.646 16:50:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:31.646 16:50:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:31.646 16:50:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:31.646 16:50:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:31.646 16:50:56 -- common/autotest_common.sh@10 -- # set +x 00:26:33.550 16:50:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:33.550 16:50:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:33.550 16:50:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:33.550 16:50:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:33.550 16:50:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:33.550 16:50:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:33.550 16:50:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:33.550 16:50:58 -- nvmf/common.sh@294 -- # net_devs=() 00:26:33.550 16:50:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:33.550 16:50:58 -- nvmf/common.sh@295 -- # e810=() 00:26:33.550 16:50:58 -- nvmf/common.sh@295 -- # local -ga e810 00:26:33.550 16:50:58 -- nvmf/common.sh@296 -- # x722=() 00:26:33.550 16:50:58 -- nvmf/common.sh@296 -- # local -ga x722 00:26:33.550 16:50:58 -- nvmf/common.sh@297 -- # mlx=() 00:26:33.550 16:50:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:33.550 16:50:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:33.550 16:50:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:33.550 16:50:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:33.550 16:50:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:33.550 16:50:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:33.550 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:33.550 16:50:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:33.550 16:50:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:33.550 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:33.550 16:50:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:33.550 16:50:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:33.550 16:50:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:33.550 16:50:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:33.550 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:33.550 16:50:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:33.550 16:50:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:33.550 16:50:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:33.550 16:50:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:33.550 16:50:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:33.550 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:33.550 16:50:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:33.550 16:50:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:33.550 16:50:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:33.550 16:50:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:33.550 16:50:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:33.550 16:50:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:33.550 16:50:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:33.550 16:50:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:33.550 16:50:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:33.550 16:50:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:33.550 16:50:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:33.550 16:50:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:33.550 16:50:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:33.550 16:50:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:33.550 16:50:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:33.550 16:50:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:33.550 16:50:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:33.550 16:50:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:33.550 16:50:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:33.550 16:50:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:33.550 16:50:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:33.550 16:50:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:33.550 16:50:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:33.550 16:50:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:33.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:33.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:26:33.550 00:26:33.550 --- 10.0.0.2 ping statistics --- 00:26:33.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:33.550 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:26:33.550 16:50:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:33.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:33.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:26:33.550 00:26:33.551 --- 10.0.0.1 ping statistics --- 00:26:33.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:33.551 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:26:33.551 16:50:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:33.551 16:50:58 -- nvmf/common.sh@410 -- # return 0 00:26:33.551 16:50:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:33.551 16:50:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:33.551 16:50:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:33.551 16:50:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:33.551 16:50:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:33.551 16:50:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:33.551 16:50:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:33.551 16:50:59 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:33.551 16:50:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:33.551 16:50:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:33.551 16:50:59 -- common/autotest_common.sh@10 -- # set +x 00:26:33.551 16:50:59 -- nvmf/common.sh@469 -- # nvmfpid=1281706 00:26:33.551 16:50:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:33.551 16:50:59 -- nvmf/common.sh@470 -- # waitforlisten 1281706 00:26:33.551 16:50:59 -- common/autotest_common.sh@819 -- # '[' -z 1281706 ']' 00:26:33.551 16:50:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:33.551 16:50:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:33.551 16:50:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:33.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:33.551 16:50:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:33.551 16:50:59 -- common/autotest_common.sh@10 -- # set +x 00:26:33.810 [2024-10-13 16:50:59.052044] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:33.810 [2024-10-13 16:50:59.052124] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:33.810 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.810 [2024-10-13 16:50:59.121324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:33.810 [2024-10-13 16:50:59.213626] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:33.810 [2024-10-13 16:50:59.213796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:33.810 [2024-10-13 16:50:59.213830] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:33.810 [2024-10-13 16:50:59.213843] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:33.810 [2024-10-13 16:50:59.213900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:33.810 [2024-10-13 16:50:59.214028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:33.810 [2024-10-13 16:50:59.214078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:33.810 [2024-10-13 16:50:59.214080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:34.744 16:51:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:34.744 16:51:00 -- common/autotest_common.sh@852 -- # return 0 00:26:34.744 16:51:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:34.744 16:51:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 16:51:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:34.744 16:51:00 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 [2024-10-13 16:51:00.057154] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 Malloc0 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 [2024-10-13 16:51:00.110478] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:34.744 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.744 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:34.744 [2024-10-13 16:51:00.118133] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:34.744 [ 00:26:34.744 { 00:26:34.744 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:34.744 "subtype": "Discovery", 00:26:34.744 "listen_addresses": [], 00:26:34.744 "allow_any_host": true, 00:26:34.744 "hosts": [] 00:26:34.744 }, 00:26:34.744 { 00:26:34.744 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:34.744 "subtype": "NVMe", 00:26:34.744 "listen_addresses": [ 00:26:34.744 { 00:26:34.744 "transport": "TCP", 00:26:34.744 "trtype": "TCP", 00:26:34.744 "adrfam": "IPv4", 00:26:34.744 "traddr": "10.0.0.2", 00:26:34.744 "trsvcid": "4420" 00:26:34.744 } 00:26:34.744 ], 00:26:34.744 "allow_any_host": true, 00:26:34.744 "hosts": [], 00:26:34.744 "serial_number": "SPDK00000000000001", 00:26:34.744 "model_number": "SPDK bdev Controller", 00:26:34.744 "max_namespaces": 2, 00:26:34.744 "min_cntlid": 1, 00:26:34.744 "max_cntlid": 65519, 00:26:34.744 "namespaces": [ 00:26:34.744 { 00:26:34.744 "nsid": 1, 00:26:34.744 "bdev_name": "Malloc0", 00:26:34.744 "name": "Malloc0", 00:26:34.744 "nguid": "B9FBF87B10854517A9EE4CA4ABB42DA3", 00:26:34.744 "uuid": "b9fbf87b-1085-4517-a9ee-4ca4abb42da3" 00:26:34.744 } 00:26:34.744 ] 00:26:34.744 } 00:26:34.744 ] 00:26:34.744 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.744 16:51:00 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:34.744 16:51:00 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:34.744 16:51:00 -- host/aer.sh@33 -- # aerpid=1281887 00:26:34.744 16:51:00 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:34.744 16:51:00 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:34.744 16:51:00 -- common/autotest_common.sh@1244 -- # local i=0 00:26:34.744 16:51:00 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:34.744 16:51:00 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:26:34.744 16:51:00 -- common/autotest_common.sh@1247 -- # i=1 00:26:34.744 16:51:00 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:26:34.744 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.744 16:51:00 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:34.744 16:51:00 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:26:34.744 16:51:00 -- common/autotest_common.sh@1247 -- # i=2 00:26:34.744 16:51:00 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:26:35.002 16:51:00 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:35.003 16:51:00 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:35.003 16:51:00 -- common/autotest_common.sh@1255 -- # return 0 00:26:35.003 16:51:00 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 Malloc1 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 Asynchronous Event Request test 00:26:35.003 Attaching to 10.0.0.2 00:26:35.003 Attached to 10.0.0.2 00:26:35.003 Registering asynchronous event callbacks... 00:26:35.003 Starting namespace attribute notice tests for all controllers... 00:26:35.003 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:35.003 aer_cb - Changed Namespace 00:26:35.003 Cleaning up... 00:26:35.003 [ 00:26:35.003 { 00:26:35.003 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:35.003 "subtype": "Discovery", 00:26:35.003 "listen_addresses": [], 00:26:35.003 "allow_any_host": true, 00:26:35.003 "hosts": [] 00:26:35.003 }, 00:26:35.003 { 00:26:35.003 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:35.003 "subtype": "NVMe", 00:26:35.003 "listen_addresses": [ 00:26:35.003 { 00:26:35.003 "transport": "TCP", 00:26:35.003 "trtype": "TCP", 00:26:35.003 "adrfam": "IPv4", 00:26:35.003 "traddr": "10.0.0.2", 00:26:35.003 "trsvcid": "4420" 00:26:35.003 } 00:26:35.003 ], 00:26:35.003 "allow_any_host": true, 00:26:35.003 "hosts": [], 00:26:35.003 "serial_number": "SPDK00000000000001", 00:26:35.003 "model_number": "SPDK bdev Controller", 00:26:35.003 "max_namespaces": 2, 00:26:35.003 "min_cntlid": 1, 00:26:35.003 "max_cntlid": 65519, 00:26:35.003 "namespaces": [ 00:26:35.003 { 00:26:35.003 "nsid": 1, 00:26:35.003 "bdev_name": "Malloc0", 00:26:35.003 "name": "Malloc0", 00:26:35.003 "nguid": "B9FBF87B10854517A9EE4CA4ABB42DA3", 00:26:35.003 "uuid": "b9fbf87b-1085-4517-a9ee-4ca4abb42da3" 00:26:35.003 }, 00:26:35.003 { 00:26:35.003 "nsid": 2, 00:26:35.003 "bdev_name": "Malloc1", 00:26:35.003 "name": "Malloc1", 00:26:35.003 "nguid": "89C569C4017D43EC8FDF05A077D1B43A", 00:26:35.003 "uuid": "89c569c4-017d-43ec-8fdf-05a077d1b43a" 00:26:35.003 } 00:26:35.003 ] 00:26:35.003 } 00:26:35.003 ] 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@43 -- # wait 1281887 00:26:35.003 16:51:00 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:35.003 16:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.003 16:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:35.003 16:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.003 16:51:00 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:35.003 16:51:00 -- host/aer.sh@51 -- # nvmftestfini 00:26:35.003 16:51:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:35.003 16:51:00 -- nvmf/common.sh@116 -- # sync 00:26:35.003 16:51:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:35.003 16:51:00 -- nvmf/common.sh@119 -- # set +e 00:26:35.003 16:51:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:35.003 16:51:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:35.003 rmmod nvme_tcp 00:26:35.261 rmmod nvme_fabrics 00:26:35.261 rmmod nvme_keyring 00:26:35.261 16:51:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:35.261 16:51:00 -- nvmf/common.sh@123 -- # set -e 00:26:35.261 16:51:00 -- nvmf/common.sh@124 -- # return 0 00:26:35.261 16:51:00 -- nvmf/common.sh@477 -- # '[' -n 1281706 ']' 00:26:35.261 16:51:00 -- nvmf/common.sh@478 -- # killprocess 1281706 00:26:35.261 16:51:00 -- common/autotest_common.sh@926 -- # '[' -z 1281706 ']' 00:26:35.261 16:51:00 -- common/autotest_common.sh@930 -- # kill -0 1281706 00:26:35.261 16:51:00 -- common/autotest_common.sh@931 -- # uname 00:26:35.262 16:51:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:35.262 16:51:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1281706 00:26:35.262 16:51:00 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:35.262 16:51:00 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:35.262 16:51:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1281706' 00:26:35.262 killing process with pid 1281706 00:26:35.262 16:51:00 -- common/autotest_common.sh@945 -- # kill 1281706 00:26:35.262 [2024-10-13 16:51:00.585302] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:35.262 16:51:00 -- common/autotest_common.sh@950 -- # wait 1281706 00:26:35.520 16:51:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:35.520 16:51:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:35.520 16:51:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:35.520 16:51:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:35.520 16:51:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:35.520 16:51:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:35.520 16:51:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:35.520 16:51:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.423 16:51:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:37.423 00:26:37.423 real 0m6.002s 00:26:37.423 user 0m7.239s 00:26:37.423 sys 0m1.860s 00:26:37.423 16:51:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:37.423 16:51:02 -- common/autotest_common.sh@10 -- # set +x 00:26:37.424 ************************************ 00:26:37.424 END TEST nvmf_aer 00:26:37.424 ************************************ 00:26:37.424 16:51:02 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:37.424 16:51:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:37.424 16:51:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:37.424 16:51:02 -- common/autotest_common.sh@10 -- # set +x 00:26:37.424 ************************************ 00:26:37.424 START TEST nvmf_async_init 00:26:37.424 ************************************ 00:26:37.424 16:51:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:37.682 * Looking for test storage... 00:26:37.682 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:37.682 16:51:02 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:37.682 16:51:02 -- nvmf/common.sh@7 -- # uname -s 00:26:37.682 16:51:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:37.682 16:51:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:37.682 16:51:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:37.682 16:51:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:37.682 16:51:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:37.682 16:51:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:37.682 16:51:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:37.682 16:51:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:37.682 16:51:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:37.682 16:51:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:37.682 16:51:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.682 16:51:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.682 16:51:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:37.682 16:51:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:37.682 16:51:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:37.682 16:51:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:37.682 16:51:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:37.682 16:51:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:37.682 16:51:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:37.682 16:51:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.682 16:51:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.682 16:51:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.682 16:51:02 -- paths/export.sh@5 -- # export PATH 00:26:37.682 16:51:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.682 16:51:02 -- nvmf/common.sh@46 -- # : 0 00:26:37.682 16:51:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:37.682 16:51:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:37.682 16:51:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:37.682 16:51:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:37.682 16:51:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:37.682 16:51:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:37.682 16:51:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:37.682 16:51:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:37.682 16:51:02 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:37.682 16:51:02 -- host/async_init.sh@14 -- # null_block_size=512 00:26:37.682 16:51:02 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:37.682 16:51:02 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:37.682 16:51:02 -- host/async_init.sh@20 -- # uuidgen 00:26:37.682 16:51:02 -- host/async_init.sh@20 -- # tr -d - 00:26:37.682 16:51:02 -- host/async_init.sh@20 -- # nguid=0a8bd6c5506e411dafdf116b5d41c79f 00:26:37.682 16:51:02 -- host/async_init.sh@22 -- # nvmftestinit 00:26:37.682 16:51:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:37.682 16:51:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:37.682 16:51:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:37.682 16:51:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:37.683 16:51:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:37.683 16:51:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.683 16:51:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.683 16:51:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.683 16:51:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:37.683 16:51:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:37.683 16:51:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:37.683 16:51:02 -- common/autotest_common.sh@10 -- # set +x 00:26:39.584 16:51:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:39.584 16:51:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:39.584 16:51:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:39.584 16:51:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:39.584 16:51:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:39.584 16:51:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:39.584 16:51:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:39.584 16:51:04 -- nvmf/common.sh@294 -- # net_devs=() 00:26:39.584 16:51:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:39.584 16:51:04 -- nvmf/common.sh@295 -- # e810=() 00:26:39.584 16:51:04 -- nvmf/common.sh@295 -- # local -ga e810 00:26:39.584 16:51:04 -- nvmf/common.sh@296 -- # x722=() 00:26:39.584 16:51:04 -- nvmf/common.sh@296 -- # local -ga x722 00:26:39.584 16:51:04 -- nvmf/common.sh@297 -- # mlx=() 00:26:39.584 16:51:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:39.584 16:51:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:39.584 16:51:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:39.584 16:51:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:39.584 16:51:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.584 16:51:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:39.584 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:39.584 16:51:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.584 16:51:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:39.584 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:39.584 16:51:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.584 16:51:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.584 16:51:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.584 16:51:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:39.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:39.584 16:51:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.584 16:51:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.584 16:51:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.584 16:51:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.584 16:51:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:39.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:39.584 16:51:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.584 16:51:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:39.584 16:51:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:39.584 16:51:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:39.584 16:51:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:39.584 16:51:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:39.584 16:51:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:39.584 16:51:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:39.584 16:51:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:39.584 16:51:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:39.584 16:51:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:39.584 16:51:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:39.584 16:51:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:39.584 16:51:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:39.584 16:51:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:39.585 16:51:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:39.585 16:51:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:39.585 16:51:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:39.585 16:51:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:39.585 16:51:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:39.585 16:51:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:39.585 16:51:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:39.585 16:51:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:39.585 16:51:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:39.585 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:39.585 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:26:39.585 00:26:39.585 --- 10.0.0.2 ping statistics --- 00:26:39.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.585 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:26:39.585 16:51:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:39.585 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:39.585 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:26:39.585 00:26:39.585 --- 10.0.0.1 ping statistics --- 00:26:39.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.585 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:26:39.585 16:51:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:39.585 16:51:05 -- nvmf/common.sh@410 -- # return 0 00:26:39.585 16:51:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:39.585 16:51:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:39.585 16:51:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:39.585 16:51:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:39.585 16:51:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:39.585 16:51:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:39.585 16:51:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:39.585 16:51:05 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:39.585 16:51:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:39.585 16:51:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:39.585 16:51:05 -- common/autotest_common.sh@10 -- # set +x 00:26:39.585 16:51:05 -- nvmf/common.sh@469 -- # nvmfpid=1283925 00:26:39.585 16:51:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:39.585 16:51:05 -- nvmf/common.sh@470 -- # waitforlisten 1283925 00:26:39.585 16:51:05 -- common/autotest_common.sh@819 -- # '[' -z 1283925 ']' 00:26:39.585 16:51:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:39.585 16:51:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:39.585 16:51:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:39.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:39.585 16:51:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:39.585 16:51:05 -- common/autotest_common.sh@10 -- # set +x 00:26:39.843 [2024-10-13 16:51:05.100463] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:39.843 [2024-10-13 16:51:05.100545] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:39.843 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.843 [2024-10-13 16:51:05.164249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:39.843 [2024-10-13 16:51:05.247209] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:39.843 [2024-10-13 16:51:05.247370] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:39.843 [2024-10-13 16:51:05.247404] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:39.843 [2024-10-13 16:51:05.247435] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:39.843 [2024-10-13 16:51:05.247476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.777 16:51:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:40.777 16:51:06 -- common/autotest_common.sh@852 -- # return 0 00:26:40.777 16:51:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:40.777 16:51:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 16:51:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.777 16:51:06 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 [2024-10-13 16:51:06.096837] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 null0 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 0a8bd6c5506e411dafdf116b5d41c79f 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:40.777 [2024-10-13 16:51:06.137110] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.777 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.777 16:51:06 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:40.777 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:40.777 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.035 nvme0n1 00:26:41.035 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.035 16:51:06 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:41.035 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.035 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.035 [ 00:26:41.035 { 00:26:41.035 "name": "nvme0n1", 00:26:41.035 "aliases": [ 00:26:41.035 "0a8bd6c5-506e-411d-afdf-116b5d41c79f" 00:26:41.035 ], 00:26:41.035 "product_name": "NVMe disk", 00:26:41.035 "block_size": 512, 00:26:41.035 "num_blocks": 2097152, 00:26:41.035 "uuid": "0a8bd6c5-506e-411d-afdf-116b5d41c79f", 00:26:41.035 "assigned_rate_limits": { 00:26:41.035 "rw_ios_per_sec": 0, 00:26:41.035 "rw_mbytes_per_sec": 0, 00:26:41.035 "r_mbytes_per_sec": 0, 00:26:41.035 "w_mbytes_per_sec": 0 00:26:41.035 }, 00:26:41.035 "claimed": false, 00:26:41.035 "zoned": false, 00:26:41.035 "supported_io_types": { 00:26:41.035 "read": true, 00:26:41.035 "write": true, 00:26:41.035 "unmap": false, 00:26:41.035 "write_zeroes": true, 00:26:41.035 "flush": true, 00:26:41.035 "reset": true, 00:26:41.035 "compare": true, 00:26:41.035 "compare_and_write": true, 00:26:41.035 "abort": true, 00:26:41.035 "nvme_admin": true, 00:26:41.035 "nvme_io": true 00:26:41.035 }, 00:26:41.035 "driver_specific": { 00:26:41.035 "nvme": [ 00:26:41.035 { 00:26:41.035 "trid": { 00:26:41.035 "trtype": "TCP", 00:26:41.035 "adrfam": "IPv4", 00:26:41.035 "traddr": "10.0.0.2", 00:26:41.035 "trsvcid": "4420", 00:26:41.035 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:41.035 }, 00:26:41.035 "ctrlr_data": { 00:26:41.035 "cntlid": 1, 00:26:41.035 "vendor_id": "0x8086", 00:26:41.035 "model_number": "SPDK bdev Controller", 00:26:41.035 "serial_number": "00000000000000000000", 00:26:41.035 "firmware_revision": "24.01.1", 00:26:41.035 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:41.035 "oacs": { 00:26:41.035 "security": 0, 00:26:41.035 "format": 0, 00:26:41.035 "firmware": 0, 00:26:41.035 "ns_manage": 0 00:26:41.035 }, 00:26:41.035 "multi_ctrlr": true, 00:26:41.035 "ana_reporting": false 00:26:41.035 }, 00:26:41.035 "vs": { 00:26:41.035 "nvme_version": "1.3" 00:26:41.035 }, 00:26:41.035 "ns_data": { 00:26:41.035 "id": 1, 00:26:41.035 "can_share": true 00:26:41.035 } 00:26:41.035 } 00:26:41.035 ], 00:26:41.035 "mp_policy": "active_passive" 00:26:41.035 } 00:26:41.035 } 00:26:41.035 ] 00:26:41.035 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.035 16:51:06 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:41.035 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.035 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.035 [2024-10-13 16:51:06.385848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:41.035 [2024-10-13 16:51:06.385935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1323ba0 (9): Bad file descriptor 00:26:41.035 [2024-10-13 16:51:06.518546] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:41.035 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.035 16:51:06 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:41.035 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.035 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.035 [ 00:26:41.035 { 00:26:41.035 "name": "nvme0n1", 00:26:41.035 "aliases": [ 00:26:41.035 "0a8bd6c5-506e-411d-afdf-116b5d41c79f" 00:26:41.035 ], 00:26:41.035 "product_name": "NVMe disk", 00:26:41.035 "block_size": 512, 00:26:41.036 "num_blocks": 2097152, 00:26:41.036 "uuid": "0a8bd6c5-506e-411d-afdf-116b5d41c79f", 00:26:41.036 "assigned_rate_limits": { 00:26:41.036 "rw_ios_per_sec": 0, 00:26:41.036 "rw_mbytes_per_sec": 0, 00:26:41.036 "r_mbytes_per_sec": 0, 00:26:41.036 "w_mbytes_per_sec": 0 00:26:41.036 }, 00:26:41.036 "claimed": false, 00:26:41.036 "zoned": false, 00:26:41.036 "supported_io_types": { 00:26:41.036 "read": true, 00:26:41.036 "write": true, 00:26:41.036 "unmap": false, 00:26:41.036 "write_zeroes": true, 00:26:41.036 "flush": true, 00:26:41.036 "reset": true, 00:26:41.036 "compare": true, 00:26:41.036 "compare_and_write": true, 00:26:41.036 "abort": true, 00:26:41.036 "nvme_admin": true, 00:26:41.036 "nvme_io": true 00:26:41.036 }, 00:26:41.036 "driver_specific": { 00:26:41.036 "nvme": [ 00:26:41.036 { 00:26:41.036 "trid": { 00:26:41.036 "trtype": "TCP", 00:26:41.036 "adrfam": "IPv4", 00:26:41.036 "traddr": "10.0.0.2", 00:26:41.036 "trsvcid": "4420", 00:26:41.036 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:41.036 }, 00:26:41.036 "ctrlr_data": { 00:26:41.036 "cntlid": 2, 00:26:41.036 "vendor_id": "0x8086", 00:26:41.036 "model_number": "SPDK bdev Controller", 00:26:41.036 "serial_number": "00000000000000000000", 00:26:41.036 "firmware_revision": "24.01.1", 00:26:41.036 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:41.036 "oacs": { 00:26:41.036 "security": 0, 00:26:41.036 "format": 0, 00:26:41.036 "firmware": 0, 00:26:41.036 "ns_manage": 0 00:26:41.036 }, 00:26:41.036 "multi_ctrlr": true, 00:26:41.036 "ana_reporting": false 00:26:41.036 }, 00:26:41.036 "vs": { 00:26:41.036 "nvme_version": "1.3" 00:26:41.036 }, 00:26:41.036 "ns_data": { 00:26:41.036 "id": 1, 00:26:41.036 "can_share": true 00:26:41.036 } 00:26:41.036 } 00:26:41.036 ], 00:26:41.036 "mp_policy": "active_passive" 00:26:41.036 } 00:26:41.036 } 00:26:41.036 ] 00:26:41.036 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@53 -- # mktemp 00:26:41.294 16:51:06 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.yYjqG2kjEB 00:26:41.294 16:51:06 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:41.294 16:51:06 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.yYjqG2kjEB 00:26:41.294 16:51:06 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 [2024-10-13 16:51:06.566462] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:41.294 [2024-10-13 16:51:06.566592] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yYjqG2kjEB 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yYjqG2kjEB 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 [2024-10-13 16:51:06.582488] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:41.294 nvme0n1 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 [ 00:26:41.294 { 00:26:41.294 "name": "nvme0n1", 00:26:41.294 "aliases": [ 00:26:41.294 "0a8bd6c5-506e-411d-afdf-116b5d41c79f" 00:26:41.294 ], 00:26:41.294 "product_name": "NVMe disk", 00:26:41.294 "block_size": 512, 00:26:41.294 "num_blocks": 2097152, 00:26:41.294 "uuid": "0a8bd6c5-506e-411d-afdf-116b5d41c79f", 00:26:41.294 "assigned_rate_limits": { 00:26:41.294 "rw_ios_per_sec": 0, 00:26:41.294 "rw_mbytes_per_sec": 0, 00:26:41.294 "r_mbytes_per_sec": 0, 00:26:41.294 "w_mbytes_per_sec": 0 00:26:41.294 }, 00:26:41.294 "claimed": false, 00:26:41.294 "zoned": false, 00:26:41.294 "supported_io_types": { 00:26:41.294 "read": true, 00:26:41.294 "write": true, 00:26:41.294 "unmap": false, 00:26:41.294 "write_zeroes": true, 00:26:41.294 "flush": true, 00:26:41.294 "reset": true, 00:26:41.294 "compare": true, 00:26:41.294 "compare_and_write": true, 00:26:41.294 "abort": true, 00:26:41.294 "nvme_admin": true, 00:26:41.294 "nvme_io": true 00:26:41.294 }, 00:26:41.294 "driver_specific": { 00:26:41.294 "nvme": [ 00:26:41.294 { 00:26:41.294 "trid": { 00:26:41.294 "trtype": "TCP", 00:26:41.294 "adrfam": "IPv4", 00:26:41.294 "traddr": "10.0.0.2", 00:26:41.294 "trsvcid": "4421", 00:26:41.294 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:41.294 }, 00:26:41.294 "ctrlr_data": { 00:26:41.294 "cntlid": 3, 00:26:41.294 "vendor_id": "0x8086", 00:26:41.294 "model_number": "SPDK bdev Controller", 00:26:41.294 "serial_number": "00000000000000000000", 00:26:41.294 "firmware_revision": "24.01.1", 00:26:41.294 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:41.294 "oacs": { 00:26:41.294 "security": 0, 00:26:41.294 "format": 0, 00:26:41.294 "firmware": 0, 00:26:41.294 "ns_manage": 0 00:26:41.294 }, 00:26:41.294 "multi_ctrlr": true, 00:26:41.294 "ana_reporting": false 00:26:41.294 }, 00:26:41.294 "vs": { 00:26:41.294 "nvme_version": "1.3" 00:26:41.294 }, 00:26:41.294 "ns_data": { 00:26:41.294 "id": 1, 00:26:41.294 "can_share": true 00:26:41.294 } 00:26:41.294 } 00:26:41.294 ], 00:26:41.294 "mp_policy": "active_passive" 00:26:41.294 } 00:26:41.294 } 00:26:41.294 ] 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:41.294 16:51:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.294 16:51:06 -- common/autotest_common.sh@10 -- # set +x 00:26:41.294 16:51:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.294 16:51:06 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.yYjqG2kjEB 00:26:41.294 16:51:06 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:41.294 16:51:06 -- host/async_init.sh@78 -- # nvmftestfini 00:26:41.294 16:51:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:41.294 16:51:06 -- nvmf/common.sh@116 -- # sync 00:26:41.294 16:51:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:41.294 16:51:06 -- nvmf/common.sh@119 -- # set +e 00:26:41.294 16:51:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:41.294 16:51:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:41.294 rmmod nvme_tcp 00:26:41.294 rmmod nvme_fabrics 00:26:41.294 rmmod nvme_keyring 00:26:41.294 16:51:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:41.294 16:51:06 -- nvmf/common.sh@123 -- # set -e 00:26:41.294 16:51:06 -- nvmf/common.sh@124 -- # return 0 00:26:41.294 16:51:06 -- nvmf/common.sh@477 -- # '[' -n 1283925 ']' 00:26:41.294 16:51:06 -- nvmf/common.sh@478 -- # killprocess 1283925 00:26:41.294 16:51:06 -- common/autotest_common.sh@926 -- # '[' -z 1283925 ']' 00:26:41.294 16:51:06 -- common/autotest_common.sh@930 -- # kill -0 1283925 00:26:41.294 16:51:06 -- common/autotest_common.sh@931 -- # uname 00:26:41.295 16:51:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:41.295 16:51:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1283925 00:26:41.295 16:51:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:41.295 16:51:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:41.295 16:51:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1283925' 00:26:41.295 killing process with pid 1283925 00:26:41.295 16:51:06 -- common/autotest_common.sh@945 -- # kill 1283925 00:26:41.295 16:51:06 -- common/autotest_common.sh@950 -- # wait 1283925 00:26:41.554 16:51:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:41.554 16:51:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:41.554 16:51:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:41.554 16:51:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:41.554 16:51:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:41.554 16:51:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:41.554 16:51:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:41.554 16:51:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.088 16:51:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:44.088 00:26:44.088 real 0m6.137s 00:26:44.088 user 0m2.954s 00:26:44.088 sys 0m1.810s 00:26:44.088 16:51:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:44.088 16:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:44.088 ************************************ 00:26:44.088 END TEST nvmf_async_init 00:26:44.088 ************************************ 00:26:44.088 16:51:09 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:44.088 16:51:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:44.088 16:51:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:44.088 16:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:44.088 ************************************ 00:26:44.088 START TEST dma 00:26:44.088 ************************************ 00:26:44.088 16:51:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:44.088 * Looking for test storage... 00:26:44.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:44.088 16:51:09 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:44.088 16:51:09 -- nvmf/common.sh@7 -- # uname -s 00:26:44.088 16:51:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:44.088 16:51:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:44.088 16:51:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:44.088 16:51:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:44.088 16:51:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:44.088 16:51:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:44.088 16:51:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:44.088 16:51:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:44.088 16:51:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:44.088 16:51:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:44.088 16:51:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:44.088 16:51:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:44.088 16:51:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:44.088 16:51:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:44.088 16:51:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:44.088 16:51:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:44.088 16:51:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:44.088 16:51:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:44.088 16:51:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:44.088 16:51:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@5 -- # export PATH 00:26:44.088 16:51:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- nvmf/common.sh@46 -- # : 0 00:26:44.088 16:51:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:44.088 16:51:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:44.088 16:51:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:44.088 16:51:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:44.088 16:51:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:44.088 16:51:09 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:44.088 16:51:09 -- host/dma.sh@13 -- # exit 0 00:26:44.088 00:26:44.088 real 0m0.063s 00:26:44.088 user 0m0.027s 00:26:44.088 sys 0m0.042s 00:26:44.088 16:51:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:44.088 16:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:44.088 ************************************ 00:26:44.088 END TEST dma 00:26:44.088 ************************************ 00:26:44.088 16:51:09 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:44.088 16:51:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:44.088 16:51:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:44.088 16:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:44.088 ************************************ 00:26:44.088 START TEST nvmf_identify 00:26:44.088 ************************************ 00:26:44.088 16:51:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:44.088 * Looking for test storage... 00:26:44.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:44.088 16:51:09 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:44.088 16:51:09 -- nvmf/common.sh@7 -- # uname -s 00:26:44.088 16:51:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:44.088 16:51:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:44.088 16:51:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:44.088 16:51:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:44.088 16:51:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:44.088 16:51:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:44.088 16:51:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:44.088 16:51:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:44.088 16:51:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:44.088 16:51:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:44.088 16:51:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:44.088 16:51:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:44.088 16:51:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:44.088 16:51:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:44.088 16:51:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:44.088 16:51:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:44.088 16:51:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:44.088 16:51:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:44.088 16:51:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:44.088 16:51:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- paths/export.sh@5 -- # export PATH 00:26:44.088 16:51:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.088 16:51:09 -- nvmf/common.sh@46 -- # : 0 00:26:44.088 16:51:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:44.088 16:51:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:44.088 16:51:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:44.088 16:51:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:44.088 16:51:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:44.088 16:51:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:44.088 16:51:09 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:44.089 16:51:09 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:44.089 16:51:09 -- host/identify.sh@14 -- # nvmftestinit 00:26:44.089 16:51:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:44.089 16:51:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:44.089 16:51:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:44.089 16:51:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:44.089 16:51:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:44.089 16:51:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.089 16:51:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.089 16:51:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.089 16:51:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:44.089 16:51:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:44.089 16:51:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:44.089 16:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:45.990 16:51:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:45.990 16:51:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:45.990 16:51:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:45.990 16:51:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:45.990 16:51:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:45.990 16:51:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:45.990 16:51:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:45.990 16:51:11 -- nvmf/common.sh@294 -- # net_devs=() 00:26:45.990 16:51:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:45.990 16:51:11 -- nvmf/common.sh@295 -- # e810=() 00:26:45.990 16:51:11 -- nvmf/common.sh@295 -- # local -ga e810 00:26:45.990 16:51:11 -- nvmf/common.sh@296 -- # x722=() 00:26:45.990 16:51:11 -- nvmf/common.sh@296 -- # local -ga x722 00:26:45.990 16:51:11 -- nvmf/common.sh@297 -- # mlx=() 00:26:45.990 16:51:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:45.990 16:51:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:45.990 16:51:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:45.990 16:51:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:45.990 16:51:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:45.990 16:51:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:45.990 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:45.990 16:51:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:45.990 16:51:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:45.990 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:45.990 16:51:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:45.990 16:51:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.990 16:51:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.990 16:51:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:45.990 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:45.990 16:51:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.990 16:51:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:45.990 16:51:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.990 16:51:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.990 16:51:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:45.990 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:45.990 16:51:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.990 16:51:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:45.990 16:51:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:45.990 16:51:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:45.990 16:51:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:45.990 16:51:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:45.990 16:51:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:45.990 16:51:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:45.990 16:51:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:45.990 16:51:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:45.990 16:51:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:45.990 16:51:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:45.990 16:51:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:45.990 16:51:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:45.990 16:51:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:45.990 16:51:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:45.990 16:51:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:45.990 16:51:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:45.990 16:51:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:45.990 16:51:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:45.990 16:51:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:45.990 16:51:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:45.990 16:51:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:45.990 16:51:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:45.990 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:45.990 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.366 ms 00:26:45.990 00:26:45.990 --- 10.0.0.2 ping statistics --- 00:26:45.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.990 rtt min/avg/max/mdev = 0.366/0.366/0.366/0.000 ms 00:26:45.990 16:51:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:45.990 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:45.991 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:26:45.991 00:26:45.991 --- 10.0.0.1 ping statistics --- 00:26:45.991 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.991 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:26:45.991 16:51:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:45.991 16:51:11 -- nvmf/common.sh@410 -- # return 0 00:26:45.991 16:51:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:45.991 16:51:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:45.991 16:51:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:45.991 16:51:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:45.991 16:51:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:45.991 16:51:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:45.991 16:51:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:45.991 16:51:11 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:45.991 16:51:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:45.991 16:51:11 -- common/autotest_common.sh@10 -- # set +x 00:26:45.991 16:51:11 -- host/identify.sh@19 -- # nvmfpid=1286697 00:26:45.991 16:51:11 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:45.991 16:51:11 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:45.991 16:51:11 -- host/identify.sh@23 -- # waitforlisten 1286697 00:26:45.991 16:51:11 -- common/autotest_common.sh@819 -- # '[' -z 1286697 ']' 00:26:45.991 16:51:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:45.991 16:51:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:45.991 16:51:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:45.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:45.991 16:51:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:45.991 16:51:11 -- common/autotest_common.sh@10 -- # set +x 00:26:45.991 [2024-10-13 16:51:11.420300] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:45.991 [2024-10-13 16:51:11.420404] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:45.991 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.991 [2024-10-13 16:51:11.486819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:46.249 [2024-10-13 16:51:11.577429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:46.249 [2024-10-13 16:51:11.577586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:46.249 [2024-10-13 16:51:11.577620] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:46.249 [2024-10-13 16:51:11.577632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:46.249 [2024-10-13 16:51:11.577688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:46.249 [2024-10-13 16:51:11.577755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:46.249 [2024-10-13 16:51:11.577811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:46.249 [2024-10-13 16:51:11.577814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:47.183 16:51:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:47.183 16:51:12 -- common/autotest_common.sh@852 -- # return 0 00:26:47.183 16:51:12 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:47.183 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 [2024-10-13 16:51:12.413018] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:47.183 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.183 16:51:12 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:47.183 16:51:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 16:51:12 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:47.183 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 Malloc0 00:26:47.183 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.183 16:51:12 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:47.183 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.183 16:51:12 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:47.183 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.183 16:51:12 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:47.183 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.183 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.183 [2024-10-13 16:51:12.484120] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:47.183 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.184 16:51:12 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:47.184 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.184 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.184 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.184 16:51:12 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:47.184 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.184 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.184 [2024-10-13 16:51:12.499904] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:47.184 [ 00:26:47.184 { 00:26:47.184 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:47.184 "subtype": "Discovery", 00:26:47.184 "listen_addresses": [ 00:26:47.184 { 00:26:47.184 "transport": "TCP", 00:26:47.184 "trtype": "TCP", 00:26:47.184 "adrfam": "IPv4", 00:26:47.184 "traddr": "10.0.0.2", 00:26:47.184 "trsvcid": "4420" 00:26:47.184 } 00:26:47.184 ], 00:26:47.184 "allow_any_host": true, 00:26:47.184 "hosts": [] 00:26:47.184 }, 00:26:47.184 { 00:26:47.184 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:47.184 "subtype": "NVMe", 00:26:47.184 "listen_addresses": [ 00:26:47.184 { 00:26:47.184 "transport": "TCP", 00:26:47.184 "trtype": "TCP", 00:26:47.184 "adrfam": "IPv4", 00:26:47.184 "traddr": "10.0.0.2", 00:26:47.184 "trsvcid": "4420" 00:26:47.184 } 00:26:47.184 ], 00:26:47.184 "allow_any_host": true, 00:26:47.184 "hosts": [], 00:26:47.184 "serial_number": "SPDK00000000000001", 00:26:47.184 "model_number": "SPDK bdev Controller", 00:26:47.184 "max_namespaces": 32, 00:26:47.184 "min_cntlid": 1, 00:26:47.184 "max_cntlid": 65519, 00:26:47.184 "namespaces": [ 00:26:47.184 { 00:26:47.184 "nsid": 1, 00:26:47.184 "bdev_name": "Malloc0", 00:26:47.184 "name": "Malloc0", 00:26:47.184 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:47.184 "eui64": "ABCDEF0123456789", 00:26:47.184 "uuid": "20f82ae2-60a4-4f10-b437-b61cf7112b92" 00:26:47.184 } 00:26:47.184 ] 00:26:47.184 } 00:26:47.184 ] 00:26:47.184 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.184 16:51:12 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:47.184 [2024-10-13 16:51:12.520749] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:47.184 [2024-10-13 16:51:12.520788] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286858 ] 00:26:47.184 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.184 [2024-10-13 16:51:12.552760] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:47.184 [2024-10-13 16:51:12.552814] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:47.184 [2024-10-13 16:51:12.552824] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:47.184 [2024-10-13 16:51:12.552838] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:47.184 [2024-10-13 16:51:12.552850] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:47.184 [2024-10-13 16:51:12.553127] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:47.184 [2024-10-13 16:51:12.553186] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x7d92f0 0 00:26:47.184 [2024-10-13 16:51:12.563411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:47.184 [2024-10-13 16:51:12.563431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:47.184 [2024-10-13 16:51:12.563455] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:47.184 [2024-10-13 16:51:12.563461] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:47.184 [2024-10-13 16:51:12.563510] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.563523] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.563530] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.563546] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:47.184 [2024-10-13 16:51:12.563583] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.574425] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.574443] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.574451] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.184 [2024-10-13 16:51:12.574475] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:47.184 [2024-10-13 16:51:12.574500] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:47.184 [2024-10-13 16:51:12.574509] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:47.184 [2024-10-13 16:51:12.574528] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574543] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.574554] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.184 [2024-10-13 16:51:12.574582] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.574723] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.574737] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.574744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574751] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.184 [2024-10-13 16:51:12.574759] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:47.184 [2024-10-13 16:51:12.574772] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:47.184 [2024-10-13 16:51:12.574784] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574791] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574798] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.574808] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.184 [2024-10-13 16:51:12.574829] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.574904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.574918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.574924] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574931] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.184 [2024-10-13 16:51:12.574940] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:47.184 [2024-10-13 16:51:12.574953] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:47.184 [2024-10-13 16:51:12.574964] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574972] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.574978] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.574988] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.184 [2024-10-13 16:51:12.575008] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.575089] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.575100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.575107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575113] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.184 [2024-10-13 16:51:12.575121] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:47.184 [2024-10-13 16:51:12.575137] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575145] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575152] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.575162] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.184 [2024-10-13 16:51:12.575181] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.575261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.575276] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.575284] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575290] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.184 [2024-10-13 16:51:12.575298] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:47.184 [2024-10-13 16:51:12.575306] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:47.184 [2024-10-13 16:51:12.575318] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:47.184 [2024-10-13 16:51:12.575428] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:47.184 [2024-10-13 16:51:12.575438] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:47.184 [2024-10-13 16:51:12.575452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575460] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575466] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.184 [2024-10-13 16:51:12.575476] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.184 [2024-10-13 16:51:12.575497] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.184 [2024-10-13 16:51:12.575604] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.184 [2024-10-13 16:51:12.575616] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.184 [2024-10-13 16:51:12.575622] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.184 [2024-10-13 16:51:12.575629] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.575637] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:47.185 [2024-10-13 16:51:12.575651] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.575660] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.575666] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.575677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.185 [2024-10-13 16:51:12.575696] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.185 [2024-10-13 16:51:12.575772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.185 [2024-10-13 16:51:12.575786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.185 [2024-10-13 16:51:12.575793] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.575799] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.575806] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:47.185 [2024-10-13 16:51:12.575814] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.575827] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:47.185 [2024-10-13 16:51:12.575841] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.575859] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.575867] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.575874] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.575884] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.185 [2024-10-13 16:51:12.575905] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.185 [2024-10-13 16:51:12.576027] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.185 [2024-10-13 16:51:12.576039] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.185 [2024-10-13 16:51:12.576045] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576052] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7d92f0): datao=0, datal=4096, cccid=0 00:26:47.185 [2024-10-13 16:51:12.576059] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x831ec0) on tqpair(0x7d92f0): expected_datao=0, payload_size=4096 00:26:47.185 [2024-10-13 16:51:12.576071] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576079] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576091] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.185 [2024-10-13 16:51:12.576100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.185 [2024-10-13 16:51:12.576106] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.576123] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:47.185 [2024-10-13 16:51:12.576132] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:47.185 [2024-10-13 16:51:12.576140] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:47.185 [2024-10-13 16:51:12.576148] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:47.185 [2024-10-13 16:51:12.576156] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:47.185 [2024-10-13 16:51:12.576164] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.576182] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.576195] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576202] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576208] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576219] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:47.185 [2024-10-13 16:51:12.576239] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.185 [2024-10-13 16:51:12.576332] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.185 [2024-10-13 16:51:12.576346] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.185 [2024-10-13 16:51:12.576353] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576359] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x831ec0) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.576370] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576378] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576387] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.185 [2024-10-13 16:51:12.576418] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576425] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.185 [2024-10-13 16:51:12.576448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576461] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.185 [2024-10-13 16:51:12.576478] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576499] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.185 [2024-10-13 16:51:12.576507] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.576525] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:47.185 [2024-10-13 16:51:12.576538] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576545] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576551] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576561] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.185 [2024-10-13 16:51:12.576583] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x831ec0, cid 0, qid 0 00:26:47.185 [2024-10-13 16:51:12.576594] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832020, cid 1, qid 0 00:26:47.185 [2024-10-13 16:51:12.576602] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832180, cid 2, qid 0 00:26:47.185 [2024-10-13 16:51:12.576609] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.185 [2024-10-13 16:51:12.576616] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832440, cid 4, qid 0 00:26:47.185 [2024-10-13 16:51:12.576761] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.185 [2024-10-13 16:51:12.576773] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.185 [2024-10-13 16:51:12.576779] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576786] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x832440) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.576794] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:47.185 [2024-10-13 16:51:12.576802] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:47.185 [2024-10-13 16:51:12.576818] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576827] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.576833] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.576847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.185 [2024-10-13 16:51:12.576868] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832440, cid 4, qid 0 00:26:47.185 [2024-10-13 16:51:12.576973] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.185 [2024-10-13 16:51:12.576988] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.185 [2024-10-13 16:51:12.576994] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.577001] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7d92f0): datao=0, datal=4096, cccid=4 00:26:47.185 [2024-10-13 16:51:12.577008] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x832440) on tqpair(0x7d92f0): expected_datao=0, payload_size=4096 00:26:47.185 [2024-10-13 16:51:12.577025] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.577033] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619421] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.185 [2024-10-13 16:51:12.619448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.185 [2024-10-13 16:51:12.619456] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x832440) on tqpair=0x7d92f0 00:26:47.185 [2024-10-13 16:51:12.619482] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:47.185 [2024-10-13 16:51:12.619519] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619530] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619537] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.619548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.185 [2024-10-13 16:51:12.619559] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619566] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.185 [2024-10-13 16:51:12.619572] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x7d92f0) 00:26:47.185 [2024-10-13 16:51:12.619581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.185 [2024-10-13 16:51:12.619609] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832440, cid 4, qid 0 00:26:47.186 [2024-10-13 16:51:12.619621] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8325a0, cid 5, qid 0 00:26:47.186 [2024-10-13 16:51:12.619810] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.186 [2024-10-13 16:51:12.619822] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.186 [2024-10-13 16:51:12.619828] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.619834] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7d92f0): datao=0, datal=1024, cccid=4 00:26:47.186 [2024-10-13 16:51:12.619842] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x832440) on tqpair(0x7d92f0): expected_datao=0, payload_size=1024 00:26:47.186 [2024-10-13 16:51:12.619852] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.619859] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.619867] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.186 [2024-10-13 16:51:12.619876] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.186 [2024-10-13 16:51:12.619882] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.619888] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8325a0) on tqpair=0x7d92f0 00:26:47.186 [2024-10-13 16:51:12.660501] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.186 [2024-10-13 16:51:12.660520] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.186 [2024-10-13 16:51:12.660527] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660534] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x832440) on tqpair=0x7d92f0 00:26:47.186 [2024-10-13 16:51:12.660551] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660560] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660567] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7d92f0) 00:26:47.186 [2024-10-13 16:51:12.660577] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.186 [2024-10-13 16:51:12.660607] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832440, cid 4, qid 0 00:26:47.186 [2024-10-13 16:51:12.660714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.186 [2024-10-13 16:51:12.660729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.186 [2024-10-13 16:51:12.660736] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660742] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7d92f0): datao=0, datal=3072, cccid=4 00:26:47.186 [2024-10-13 16:51:12.660749] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x832440) on tqpair(0x7d92f0): expected_datao=0, payload_size=3072 00:26:47.186 [2024-10-13 16:51:12.660760] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660767] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660779] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.186 [2024-10-13 16:51:12.660788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.186 [2024-10-13 16:51:12.660794] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660801] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x832440) on tqpair=0x7d92f0 00:26:47.186 [2024-10-13 16:51:12.660815] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660824] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660830] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x7d92f0) 00:26:47.186 [2024-10-13 16:51:12.660840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.186 [2024-10-13 16:51:12.660867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x832440, cid 4, qid 0 00:26:47.186 [2024-10-13 16:51:12.660960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.186 [2024-10-13 16:51:12.660972] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.186 [2024-10-13 16:51:12.660978] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.660984] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x7d92f0): datao=0, datal=8, cccid=4 00:26:47.186 [2024-10-13 16:51:12.660991] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x832440) on tqpair(0x7d92f0): expected_datao=0, payload_size=8 00:26:47.186 [2024-10-13 16:51:12.661002] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.186 [2024-10-13 16:51:12.661008] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.447 [2024-10-13 16:51:12.701496] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.447 [2024-10-13 16:51:12.701515] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.447 [2024-10-13 16:51:12.701522] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.447 [2024-10-13 16:51:12.701528] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x832440) on tqpair=0x7d92f0 00:26:47.447 ===================================================== 00:26:47.447 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:47.447 ===================================================== 00:26:47.447 Controller Capabilities/Features 00:26:47.447 ================================ 00:26:47.447 Vendor ID: 0000 00:26:47.448 Subsystem Vendor ID: 0000 00:26:47.448 Serial Number: .................... 00:26:47.448 Model Number: ........................................ 00:26:47.448 Firmware Version: 24.01.1 00:26:47.448 Recommended Arb Burst: 0 00:26:47.448 IEEE OUI Identifier: 00 00 00 00:26:47.448 Multi-path I/O 00:26:47.448 May have multiple subsystem ports: No 00:26:47.448 May have multiple controllers: No 00:26:47.448 Associated with SR-IOV VF: No 00:26:47.448 Max Data Transfer Size: 131072 00:26:47.448 Max Number of Namespaces: 0 00:26:47.448 Max Number of I/O Queues: 1024 00:26:47.448 NVMe Specification Version (VS): 1.3 00:26:47.448 NVMe Specification Version (Identify): 1.3 00:26:47.448 Maximum Queue Entries: 128 00:26:47.448 Contiguous Queues Required: Yes 00:26:47.448 Arbitration Mechanisms Supported 00:26:47.448 Weighted Round Robin: Not Supported 00:26:47.448 Vendor Specific: Not Supported 00:26:47.448 Reset Timeout: 15000 ms 00:26:47.448 Doorbell Stride: 4 bytes 00:26:47.448 NVM Subsystem Reset: Not Supported 00:26:47.448 Command Sets Supported 00:26:47.448 NVM Command Set: Supported 00:26:47.448 Boot Partition: Not Supported 00:26:47.448 Memory Page Size Minimum: 4096 bytes 00:26:47.448 Memory Page Size Maximum: 4096 bytes 00:26:47.448 Persistent Memory Region: Not Supported 00:26:47.448 Optional Asynchronous Events Supported 00:26:47.448 Namespace Attribute Notices: Not Supported 00:26:47.448 Firmware Activation Notices: Not Supported 00:26:47.448 ANA Change Notices: Not Supported 00:26:47.448 PLE Aggregate Log Change Notices: Not Supported 00:26:47.448 LBA Status Info Alert Notices: Not Supported 00:26:47.448 EGE Aggregate Log Change Notices: Not Supported 00:26:47.448 Normal NVM Subsystem Shutdown event: Not Supported 00:26:47.448 Zone Descriptor Change Notices: Not Supported 00:26:47.448 Discovery Log Change Notices: Supported 00:26:47.448 Controller Attributes 00:26:47.448 128-bit Host Identifier: Not Supported 00:26:47.448 Non-Operational Permissive Mode: Not Supported 00:26:47.448 NVM Sets: Not Supported 00:26:47.448 Read Recovery Levels: Not Supported 00:26:47.448 Endurance Groups: Not Supported 00:26:47.448 Predictable Latency Mode: Not Supported 00:26:47.448 Traffic Based Keep ALive: Not Supported 00:26:47.448 Namespace Granularity: Not Supported 00:26:47.448 SQ Associations: Not Supported 00:26:47.448 UUID List: Not Supported 00:26:47.448 Multi-Domain Subsystem: Not Supported 00:26:47.448 Fixed Capacity Management: Not Supported 00:26:47.448 Variable Capacity Management: Not Supported 00:26:47.448 Delete Endurance Group: Not Supported 00:26:47.448 Delete NVM Set: Not Supported 00:26:47.448 Extended LBA Formats Supported: Not Supported 00:26:47.448 Flexible Data Placement Supported: Not Supported 00:26:47.448 00:26:47.448 Controller Memory Buffer Support 00:26:47.448 ================================ 00:26:47.448 Supported: No 00:26:47.448 00:26:47.448 Persistent Memory Region Support 00:26:47.448 ================================ 00:26:47.448 Supported: No 00:26:47.448 00:26:47.448 Admin Command Set Attributes 00:26:47.448 ============================ 00:26:47.448 Security Send/Receive: Not Supported 00:26:47.448 Format NVM: Not Supported 00:26:47.448 Firmware Activate/Download: Not Supported 00:26:47.448 Namespace Management: Not Supported 00:26:47.448 Device Self-Test: Not Supported 00:26:47.448 Directives: Not Supported 00:26:47.448 NVMe-MI: Not Supported 00:26:47.448 Virtualization Management: Not Supported 00:26:47.448 Doorbell Buffer Config: Not Supported 00:26:47.448 Get LBA Status Capability: Not Supported 00:26:47.448 Command & Feature Lockdown Capability: Not Supported 00:26:47.448 Abort Command Limit: 1 00:26:47.448 Async Event Request Limit: 4 00:26:47.448 Number of Firmware Slots: N/A 00:26:47.448 Firmware Slot 1 Read-Only: N/A 00:26:47.448 Firmware Activation Without Reset: N/A 00:26:47.448 Multiple Update Detection Support: N/A 00:26:47.448 Firmware Update Granularity: No Information Provided 00:26:47.448 Per-Namespace SMART Log: No 00:26:47.448 Asymmetric Namespace Access Log Page: Not Supported 00:26:47.448 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:47.448 Command Effects Log Page: Not Supported 00:26:47.448 Get Log Page Extended Data: Supported 00:26:47.448 Telemetry Log Pages: Not Supported 00:26:47.448 Persistent Event Log Pages: Not Supported 00:26:47.448 Supported Log Pages Log Page: May Support 00:26:47.448 Commands Supported & Effects Log Page: Not Supported 00:26:47.448 Feature Identifiers & Effects Log Page:May Support 00:26:47.448 NVMe-MI Commands & Effects Log Page: May Support 00:26:47.448 Data Area 4 for Telemetry Log: Not Supported 00:26:47.448 Error Log Page Entries Supported: 128 00:26:47.448 Keep Alive: Not Supported 00:26:47.448 00:26:47.448 NVM Command Set Attributes 00:26:47.448 ========================== 00:26:47.448 Submission Queue Entry Size 00:26:47.448 Max: 1 00:26:47.448 Min: 1 00:26:47.448 Completion Queue Entry Size 00:26:47.448 Max: 1 00:26:47.448 Min: 1 00:26:47.448 Number of Namespaces: 0 00:26:47.448 Compare Command: Not Supported 00:26:47.448 Write Uncorrectable Command: Not Supported 00:26:47.448 Dataset Management Command: Not Supported 00:26:47.448 Write Zeroes Command: Not Supported 00:26:47.448 Set Features Save Field: Not Supported 00:26:47.448 Reservations: Not Supported 00:26:47.448 Timestamp: Not Supported 00:26:47.448 Copy: Not Supported 00:26:47.448 Volatile Write Cache: Not Present 00:26:47.448 Atomic Write Unit (Normal): 1 00:26:47.448 Atomic Write Unit (PFail): 1 00:26:47.448 Atomic Compare & Write Unit: 1 00:26:47.448 Fused Compare & Write: Supported 00:26:47.448 Scatter-Gather List 00:26:47.448 SGL Command Set: Supported 00:26:47.448 SGL Keyed: Supported 00:26:47.448 SGL Bit Bucket Descriptor: Not Supported 00:26:47.448 SGL Metadata Pointer: Not Supported 00:26:47.448 Oversized SGL: Not Supported 00:26:47.448 SGL Metadata Address: Not Supported 00:26:47.448 SGL Offset: Supported 00:26:47.448 Transport SGL Data Block: Not Supported 00:26:47.448 Replay Protected Memory Block: Not Supported 00:26:47.448 00:26:47.448 Firmware Slot Information 00:26:47.448 ========================= 00:26:47.448 Active slot: 0 00:26:47.448 00:26:47.448 00:26:47.448 Error Log 00:26:47.448 ========= 00:26:47.448 00:26:47.448 Active Namespaces 00:26:47.448 ================= 00:26:47.448 Discovery Log Page 00:26:47.448 ================== 00:26:47.448 Generation Counter: 2 00:26:47.448 Number of Records: 2 00:26:47.448 Record Format: 0 00:26:47.448 00:26:47.448 Discovery Log Entry 0 00:26:47.448 ---------------------- 00:26:47.448 Transport Type: 3 (TCP) 00:26:47.448 Address Family: 1 (IPv4) 00:26:47.448 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:47.448 Entry Flags: 00:26:47.448 Duplicate Returned Information: 1 00:26:47.448 Explicit Persistent Connection Support for Discovery: 1 00:26:47.448 Transport Requirements: 00:26:47.448 Secure Channel: Not Required 00:26:47.448 Port ID: 0 (0x0000) 00:26:47.448 Controller ID: 65535 (0xffff) 00:26:47.448 Admin Max SQ Size: 128 00:26:47.448 Transport Service Identifier: 4420 00:26:47.448 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:47.448 Transport Address: 10.0.0.2 00:26:47.448 Discovery Log Entry 1 00:26:47.448 ---------------------- 00:26:47.448 Transport Type: 3 (TCP) 00:26:47.448 Address Family: 1 (IPv4) 00:26:47.448 Subsystem Type: 2 (NVM Subsystem) 00:26:47.448 Entry Flags: 00:26:47.448 Duplicate Returned Information: 0 00:26:47.448 Explicit Persistent Connection Support for Discovery: 0 00:26:47.448 Transport Requirements: 00:26:47.448 Secure Channel: Not Required 00:26:47.448 Port ID: 0 (0x0000) 00:26:47.448 Controller ID: 65535 (0xffff) 00:26:47.448 Admin Max SQ Size: 128 00:26:47.448 Transport Service Identifier: 4420 00:26:47.448 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:47.448 Transport Address: 10.0.0.2 [2024-10-13 16:51:12.701639] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:47.448 [2024-10-13 16:51:12.701666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.448 [2024-10-13 16:51:12.701679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.448 [2024-10-13 16:51:12.701689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.448 [2024-10-13 16:51:12.701698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.448 [2024-10-13 16:51:12.701721] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.448 [2024-10-13 16:51:12.701729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.448 [2024-10-13 16:51:12.701735] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.448 [2024-10-13 16:51:12.701746] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.448 [2024-10-13 16:51:12.701771] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.448 [2024-10-13 16:51:12.701887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.701901] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.701908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.701914] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.701926] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.701934] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.701940] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.701950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.701976] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702087] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702101] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.702122] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:47.449 [2024-10-13 16:51:12.702130] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:47.449 [2024-10-13 16:51:12.702145] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702153] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702160] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.702170] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.702190] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702284] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702291] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702297] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.702313] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702326] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702333] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.702343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.702364] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702466] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702481] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702488] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.702510] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702525] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.702535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.702556] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702666] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.702682] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702691] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702697] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.702707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.702727] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702806] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702817] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702824] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702830] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.702845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702854] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.702860] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.702870] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.702890] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.702980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.702991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.702997] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703004] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.703019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703027] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703038] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.703049] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.703068] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.703161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.703175] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.703181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703187] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.703203] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703212] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703218] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.703228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.703248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.703322] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.703334] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.703340] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.703361] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703370] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.703376] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x7d92f0) 00:26:47.449 [2024-10-13 16:51:12.703386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.449 [2024-10-13 16:51:12.707421] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8322e0, cid 3, qid 0 00:26:47.449 [2024-10-13 16:51:12.707551] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.449 [2024-10-13 16:51:12.707566] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.449 [2024-10-13 16:51:12.707572] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.707579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8322e0) on tqpair=0x7d92f0 00:26:47.449 [2024-10-13 16:51:12.707592] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:26:47.449 00:26:47.449 16:51:12 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:47.449 [2024-10-13 16:51:12.740600] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:47.449 [2024-10-13 16:51:12.740638] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286867 ] 00:26:47.449 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.449 [2024-10-13 16:51:12.774436] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:47.449 [2024-10-13 16:51:12.774483] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:47.449 [2024-10-13 16:51:12.774497] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:47.449 [2024-10-13 16:51:12.774513] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:47.449 [2024-10-13 16:51:12.774525] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:47.449 [2024-10-13 16:51:12.774692] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:47.449 [2024-10-13 16:51:12.774735] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x16ea2f0 0 00:26:47.449 [2024-10-13 16:51:12.785422] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:47.449 [2024-10-13 16:51:12.785440] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:47.449 [2024-10-13 16:51:12.785448] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:47.449 [2024-10-13 16:51:12.785454] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:47.449 [2024-10-13 16:51:12.785506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.785519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.449 [2024-10-13 16:51:12.785526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.449 [2024-10-13 16:51:12.785540] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:47.449 [2024-10-13 16:51:12.785566] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.449 [2024-10-13 16:51:12.793423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.793440] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.793448] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793454] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.793469] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:47.450 [2024-10-13 16:51:12.793480] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:47.450 [2024-10-13 16:51:12.793488] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:47.450 [2024-10-13 16:51:12.793505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793514] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793520] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.793531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.793554] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.793671] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.793684] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.793690] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793696] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.793705] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:47.450 [2024-10-13 16:51:12.793718] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:47.450 [2024-10-13 16:51:12.793730] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793738] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793744] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.793754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.793779] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.793851] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.793863] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.793869] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793876] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.793885] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:47.450 [2024-10-13 16:51:12.793898] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.793910] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793917] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.793923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.793934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.793953] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.794027] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.794039] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.794046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794052] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.794061] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.794076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.794102] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.794121] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.794196] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.794210] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.794216] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794223] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.794231] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:47.450 [2024-10-13 16:51:12.794239] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.794252] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.794362] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:47.450 [2024-10-13 16:51:12.794369] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.794380] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794388] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.794418] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.794440] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.794554] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.794567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.794574] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794580] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.794589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:47.450 [2024-10-13 16:51:12.794605] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794614] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794620] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.794631] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.794651] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.794728] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.794740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.794746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.794761] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:47.450 [2024-10-13 16:51:12.794769] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:47.450 [2024-10-13 16:51:12.794781] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:47.450 [2024-10-13 16:51:12.794795] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:47.450 [2024-10-13 16:51:12.794808] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.794822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.794833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.450 [2024-10-13 16:51:12.794853] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.794986] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.450 [2024-10-13 16:51:12.795000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.450 [2024-10-13 16:51:12.795007] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.795013] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=4096, cccid=0 00:26:47.450 [2024-10-13 16:51:12.795021] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1742ec0) on tqpair(0x16ea2f0): expected_datao=0, payload_size=4096 00:26:47.450 [2024-10-13 16:51:12.795038] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.795047] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.835492] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.835511] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.835518] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.835525] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.450 [2024-10-13 16:51:12.835537] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:47.450 [2024-10-13 16:51:12.835545] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:47.450 [2024-10-13 16:51:12.835553] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:47.450 [2024-10-13 16:51:12.835559] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:47.450 [2024-10-13 16:51:12.835566] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:47.450 [2024-10-13 16:51:12.835574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:47.450 [2024-10-13 16:51:12.835593] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:47.450 [2024-10-13 16:51:12.835607] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.835615] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.450 [2024-10-13 16:51:12.835621] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.450 [2024-10-13 16:51:12.835632] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:47.450 [2024-10-13 16:51:12.835655] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.450 [2024-10-13 16:51:12.835735] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.450 [2024-10-13 16:51:12.835747] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.450 [2024-10-13 16:51:12.835754] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835760] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1742ec0) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.835771] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835784] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.835794] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.451 [2024-10-13 16:51:12.835804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835810] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835816] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.835825] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.451 [2024-10-13 16:51:12.835834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835840] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835846] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.835855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.451 [2024-10-13 16:51:12.835864] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.835890] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.451 [2024-10-13 16:51:12.835899] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.835916] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.835929] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835935] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.835942] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.835952] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.451 [2024-10-13 16:51:12.835974] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1742ec0, cid 0, qid 0 00:26:47.451 [2024-10-13 16:51:12.835985] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743020, cid 1, qid 0 00:26:47.451 [2024-10-13 16:51:12.835992] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743180, cid 2, qid 0 00:26:47.451 [2024-10-13 16:51:12.836000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17432e0, cid 3, qid 0 00:26:47.451 [2024-10-13 16:51:12.836007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.451 [2024-10-13 16:51:12.836144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.451 [2024-10-13 16:51:12.836158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.451 [2024-10-13 16:51:12.836164] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836171] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.836180] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:47.451 [2024-10-13 16:51:12.836188] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.836201] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.836216] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.836228] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836235] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836241] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.836251] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:47.451 [2024-10-13 16:51:12.836272] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.451 [2024-10-13 16:51:12.836380] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.451 [2024-10-13 16:51:12.836401] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.451 [2024-10-13 16:51:12.836410] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836416] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.836481] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.836499] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.836517] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836525] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836531] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.836542] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.451 [2024-10-13 16:51:12.836563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.451 [2024-10-13 16:51:12.836672] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.451 [2024-10-13 16:51:12.836686] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.451 [2024-10-13 16:51:12.836693] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836699] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=4096, cccid=4 00:26:47.451 [2024-10-13 16:51:12.836707] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743440) on tqpair(0x16ea2f0): expected_datao=0, payload_size=4096 00:26:47.451 [2024-10-13 16:51:12.836717] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.836724] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881419] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.451 [2024-10-13 16:51:12.881437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.451 [2024-10-13 16:51:12.881445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.881472] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:47.451 [2024-10-13 16:51:12.881491] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.881509] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.881538] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881546] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881552] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.881563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.451 [2024-10-13 16:51:12.881587] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.451 [2024-10-13 16:51:12.881720] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.451 [2024-10-13 16:51:12.881735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.451 [2024-10-13 16:51:12.881741] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881748] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=4096, cccid=4 00:26:47.451 [2024-10-13 16:51:12.881755] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743440) on tqpair(0x16ea2f0): expected_datao=0, payload_size=4096 00:26:47.451 [2024-10-13 16:51:12.881773] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.881782] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922497] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.451 [2024-10-13 16:51:12.922515] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.451 [2024-10-13 16:51:12.922522] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922529] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.922557] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.922576] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.922591] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922598] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922605] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.451 [2024-10-13 16:51:12.922616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.451 [2024-10-13 16:51:12.922638] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.451 [2024-10-13 16:51:12.922738] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.451 [2024-10-13 16:51:12.922752] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.451 [2024-10-13 16:51:12.922759] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922765] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=4096, cccid=4 00:26:47.451 [2024-10-13 16:51:12.922773] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743440) on tqpair(0x16ea2f0): expected_datao=0, payload_size=4096 00:26:47.451 [2024-10-13 16:51:12.922783] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922790] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922802] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.451 [2024-10-13 16:51:12.922812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.451 [2024-10-13 16:51:12.922818] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.451 [2024-10-13 16:51:12.922824] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.451 [2024-10-13 16:51:12.922838] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.922853] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:47.451 [2024-10-13 16:51:12.922868] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:47.452 [2024-10-13 16:51:12.922879] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:47.452 [2024-10-13 16:51:12.922887] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:47.452 [2024-10-13 16:51:12.922895] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:47.452 [2024-10-13 16:51:12.922903] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:47.452 [2024-10-13 16:51:12.922911] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:47.452 [2024-10-13 16:51:12.922929] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.922938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.922944] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.922955] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.922965] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.922972] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.922982] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.922991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.452 [2024-10-13 16:51:12.923016] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.452 [2024-10-13 16:51:12.923028] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17435a0, cid 5, qid 0 00:26:47.452 [2024-10-13 16:51:12.923150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.452 [2024-10-13 16:51:12.923164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.452 [2024-10-13 16:51:12.923171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.452 [2024-10-13 16:51:12.923188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.452 [2024-10-13 16:51:12.923197] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.452 [2024-10-13 16:51:12.923203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923209] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17435a0) on tqpair=0x16ea2f0 00:26:47.452 [2024-10-13 16:51:12.923226] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923234] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923241] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923251] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923271] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17435a0, cid 5, qid 0 00:26:47.452 [2024-10-13 16:51:12.923360] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.452 [2024-10-13 16:51:12.923373] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.452 [2024-10-13 16:51:12.923380] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923386] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17435a0) on tqpair=0x16ea2f0 00:26:47.452 [2024-10-13 16:51:12.923410] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923420] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923436] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923456] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17435a0, cid 5, qid 0 00:26:47.452 [2024-10-13 16:51:12.923537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.452 [2024-10-13 16:51:12.923549] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.452 [2024-10-13 16:51:12.923555] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923562] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17435a0) on tqpair=0x16ea2f0 00:26:47.452 [2024-10-13 16:51:12.923578] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923586] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923592] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923602] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923622] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17435a0, cid 5, qid 0 00:26:47.452 [2024-10-13 16:51:12.923715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.452 [2024-10-13 16:51:12.923733] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.452 [2024-10-13 16:51:12.923740] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923746] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17435a0) on tqpair=0x16ea2f0 00:26:47.452 [2024-10-13 16:51:12.923766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923776] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923792] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923817] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923827] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923838] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923845] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923851] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.923885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16ea2f0) 00:26:47.452 [2024-10-13 16:51:12.923894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.452 [2024-10-13 16:51:12.923916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17435a0, cid 5, qid 0 00:26:47.452 [2024-10-13 16:51:12.923927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743440, cid 4, qid 0 00:26:47.452 [2024-10-13 16:51:12.923934] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743700, cid 6, qid 0 00:26:47.452 [2024-10-13 16:51:12.923941] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743860, cid 7, qid 0 00:26:47.452 [2024-10-13 16:51:12.924127] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.452 [2024-10-13 16:51:12.924141] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.452 [2024-10-13 16:51:12.924148] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924154] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=8192, cccid=5 00:26:47.452 [2024-10-13 16:51:12.924162] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17435a0) on tqpair(0x16ea2f0): expected_datao=0, payload_size=8192 00:26:47.452 [2024-10-13 16:51:12.924180] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924189] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.452 [2024-10-13 16:51:12.924211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.452 [2024-10-13 16:51:12.924217] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924223] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=512, cccid=4 00:26:47.452 [2024-10-13 16:51:12.924235] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743440) on tqpair(0x16ea2f0): expected_datao=0, payload_size=512 00:26:47.452 [2024-10-13 16:51:12.924245] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924252] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924260] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.452 [2024-10-13 16:51:12.924269] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.452 [2024-10-13 16:51:12.924275] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.452 [2024-10-13 16:51:12.924281] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=512, cccid=6 00:26:47.452 [2024-10-13 16:51:12.924288] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743700) on tqpair(0x16ea2f0): expected_datao=0, payload_size=512 00:26:47.453 [2024-10-13 16:51:12.924298] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924304] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924313] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:47.453 [2024-10-13 16:51:12.924321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:47.453 [2024-10-13 16:51:12.924327] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924333] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16ea2f0): datao=0, datal=4096, cccid=7 00:26:47.453 [2024-10-13 16:51:12.924340] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1743860) on tqpair(0x16ea2f0): expected_datao=0, payload_size=4096 00:26:47.453 [2024-10-13 16:51:12.924350] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924357] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924368] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.453 [2024-10-13 16:51:12.924378] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.453 [2024-10-13 16:51:12.924384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17435a0) on tqpair=0x16ea2f0 00:26:47.453 [2024-10-13 16:51:12.924419] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.453 [2024-10-13 16:51:12.924431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.453 [2024-10-13 16:51:12.924437] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924444] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743440) on tqpair=0x16ea2f0 00:26:47.453 [2024-10-13 16:51:12.924458] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.453 [2024-10-13 16:51:12.924468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.453 [2024-10-13 16:51:12.924475] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924481] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743700) on tqpair=0x16ea2f0 00:26:47.453 [2024-10-13 16:51:12.924492] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.453 [2024-10-13 16:51:12.924501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.453 [2024-10-13 16:51:12.924507] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.453 [2024-10-13 16:51:12.924514] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743860) on tqpair=0x16ea2f0 00:26:47.453 ===================================================== 00:26:47.453 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:47.453 ===================================================== 00:26:47.453 Controller Capabilities/Features 00:26:47.453 ================================ 00:26:47.453 Vendor ID: 8086 00:26:47.453 Subsystem Vendor ID: 8086 00:26:47.453 Serial Number: SPDK00000000000001 00:26:47.453 Model Number: SPDK bdev Controller 00:26:47.453 Firmware Version: 24.01.1 00:26:47.453 Recommended Arb Burst: 6 00:26:47.453 IEEE OUI Identifier: e4 d2 5c 00:26:47.453 Multi-path I/O 00:26:47.453 May have multiple subsystem ports: Yes 00:26:47.453 May have multiple controllers: Yes 00:26:47.453 Associated with SR-IOV VF: No 00:26:47.453 Max Data Transfer Size: 131072 00:26:47.453 Max Number of Namespaces: 32 00:26:47.453 Max Number of I/O Queues: 127 00:26:47.453 NVMe Specification Version (VS): 1.3 00:26:47.453 NVMe Specification Version (Identify): 1.3 00:26:47.453 Maximum Queue Entries: 128 00:26:47.453 Contiguous Queues Required: Yes 00:26:47.453 Arbitration Mechanisms Supported 00:26:47.453 Weighted Round Robin: Not Supported 00:26:47.453 Vendor Specific: Not Supported 00:26:47.453 Reset Timeout: 15000 ms 00:26:47.453 Doorbell Stride: 4 bytes 00:26:47.453 NVM Subsystem Reset: Not Supported 00:26:47.453 Command Sets Supported 00:26:47.453 NVM Command Set: Supported 00:26:47.453 Boot Partition: Not Supported 00:26:47.453 Memory Page Size Minimum: 4096 bytes 00:26:47.453 Memory Page Size Maximum: 4096 bytes 00:26:47.453 Persistent Memory Region: Not Supported 00:26:47.453 Optional Asynchronous Events Supported 00:26:47.453 Namespace Attribute Notices: Supported 00:26:47.453 Firmware Activation Notices: Not Supported 00:26:47.453 ANA Change Notices: Not Supported 00:26:47.453 PLE Aggregate Log Change Notices: Not Supported 00:26:47.453 LBA Status Info Alert Notices: Not Supported 00:26:47.453 EGE Aggregate Log Change Notices: Not Supported 00:26:47.453 Normal NVM Subsystem Shutdown event: Not Supported 00:26:47.453 Zone Descriptor Change Notices: Not Supported 00:26:47.453 Discovery Log Change Notices: Not Supported 00:26:47.453 Controller Attributes 00:26:47.453 128-bit Host Identifier: Supported 00:26:47.453 Non-Operational Permissive Mode: Not Supported 00:26:47.453 NVM Sets: Not Supported 00:26:47.453 Read Recovery Levels: Not Supported 00:26:47.453 Endurance Groups: Not Supported 00:26:47.453 Predictable Latency Mode: Not Supported 00:26:47.453 Traffic Based Keep ALive: Not Supported 00:26:47.453 Namespace Granularity: Not Supported 00:26:47.453 SQ Associations: Not Supported 00:26:47.453 UUID List: Not Supported 00:26:47.453 Multi-Domain Subsystem: Not Supported 00:26:47.453 Fixed Capacity Management: Not Supported 00:26:47.453 Variable Capacity Management: Not Supported 00:26:47.453 Delete Endurance Group: Not Supported 00:26:47.453 Delete NVM Set: Not Supported 00:26:47.453 Extended LBA Formats Supported: Not Supported 00:26:47.453 Flexible Data Placement Supported: Not Supported 00:26:47.453 00:26:47.453 Controller Memory Buffer Support 00:26:47.453 ================================ 00:26:47.453 Supported: No 00:26:47.453 00:26:47.453 Persistent Memory Region Support 00:26:47.453 ================================ 00:26:47.453 Supported: No 00:26:47.453 00:26:47.453 Admin Command Set Attributes 00:26:47.453 ============================ 00:26:47.453 Security Send/Receive: Not Supported 00:26:47.453 Format NVM: Not Supported 00:26:47.453 Firmware Activate/Download: Not Supported 00:26:47.453 Namespace Management: Not Supported 00:26:47.453 Device Self-Test: Not Supported 00:26:47.453 Directives: Not Supported 00:26:47.453 NVMe-MI: Not Supported 00:26:47.453 Virtualization Management: Not Supported 00:26:47.453 Doorbell Buffer Config: Not Supported 00:26:47.453 Get LBA Status Capability: Not Supported 00:26:47.453 Command & Feature Lockdown Capability: Not Supported 00:26:47.453 Abort Command Limit: 4 00:26:47.453 Async Event Request Limit: 4 00:26:47.453 Number of Firmware Slots: N/A 00:26:47.453 Firmware Slot 1 Read-Only: N/A 00:26:47.453 Firmware Activation Without Reset: N/A 00:26:47.453 Multiple Update Detection Support: N/A 00:26:47.453 Firmware Update Granularity: No Information Provided 00:26:47.453 Per-Namespace SMART Log: No 00:26:47.453 Asymmetric Namespace Access Log Page: Not Supported 00:26:47.453 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:47.453 Command Effects Log Page: Supported 00:26:47.453 Get Log Page Extended Data: Supported 00:26:47.453 Telemetry Log Pages: Not Supported 00:26:47.453 Persistent Event Log Pages: Not Supported 00:26:47.453 Supported Log Pages Log Page: May Support 00:26:47.453 Commands Supported & Effects Log Page: Not Supported 00:26:47.453 Feature Identifiers & Effects Log Page:May Support 00:26:47.453 NVMe-MI Commands & Effects Log Page: May Support 00:26:47.453 Data Area 4 for Telemetry Log: Not Supported 00:26:47.453 Error Log Page Entries Supported: 128 00:26:47.453 Keep Alive: Supported 00:26:47.453 Keep Alive Granularity: 10000 ms 00:26:47.453 00:26:47.453 NVM Command Set Attributes 00:26:47.453 ========================== 00:26:47.453 Submission Queue Entry Size 00:26:47.453 Max: 64 00:26:47.453 Min: 64 00:26:47.453 Completion Queue Entry Size 00:26:47.453 Max: 16 00:26:47.453 Min: 16 00:26:47.453 Number of Namespaces: 32 00:26:47.453 Compare Command: Supported 00:26:47.453 Write Uncorrectable Command: Not Supported 00:26:47.453 Dataset Management Command: Supported 00:26:47.453 Write Zeroes Command: Supported 00:26:47.453 Set Features Save Field: Not Supported 00:26:47.453 Reservations: Supported 00:26:47.453 Timestamp: Not Supported 00:26:47.453 Copy: Supported 00:26:47.453 Volatile Write Cache: Present 00:26:47.453 Atomic Write Unit (Normal): 1 00:26:47.453 Atomic Write Unit (PFail): 1 00:26:47.453 Atomic Compare & Write Unit: 1 00:26:47.453 Fused Compare & Write: Supported 00:26:47.453 Scatter-Gather List 00:26:47.453 SGL Command Set: Supported 00:26:47.453 SGL Keyed: Supported 00:26:47.453 SGL Bit Bucket Descriptor: Not Supported 00:26:47.453 SGL Metadata Pointer: Not Supported 00:26:47.453 Oversized SGL: Not Supported 00:26:47.453 SGL Metadata Address: Not Supported 00:26:47.453 SGL Offset: Supported 00:26:47.453 Transport SGL Data Block: Not Supported 00:26:47.453 Replay Protected Memory Block: Not Supported 00:26:47.453 00:26:47.453 Firmware Slot Information 00:26:47.453 ========================= 00:26:47.453 Active slot: 1 00:26:47.453 Slot 1 Firmware Revision: 24.01.1 00:26:47.453 00:26:47.453 00:26:47.453 Commands Supported and Effects 00:26:47.453 ============================== 00:26:47.453 Admin Commands 00:26:47.453 -------------- 00:26:47.453 Get Log Page (02h): Supported 00:26:47.453 Identify (06h): Supported 00:26:47.453 Abort (08h): Supported 00:26:47.453 Set Features (09h): Supported 00:26:47.453 Get Features (0Ah): Supported 00:26:47.453 Asynchronous Event Request (0Ch): Supported 00:26:47.453 Keep Alive (18h): Supported 00:26:47.453 I/O Commands 00:26:47.453 ------------ 00:26:47.453 Flush (00h): Supported LBA-Change 00:26:47.453 Write (01h): Supported LBA-Change 00:26:47.453 Read (02h): Supported 00:26:47.453 Compare (05h): Supported 00:26:47.453 Write Zeroes (08h): Supported LBA-Change 00:26:47.453 Dataset Management (09h): Supported LBA-Change 00:26:47.453 Copy (19h): Supported LBA-Change 00:26:47.453 Unknown (79h): Supported LBA-Change 00:26:47.454 Unknown (7Ah): Supported 00:26:47.454 00:26:47.454 Error Log 00:26:47.454 ========= 00:26:47.454 00:26:47.454 Arbitration 00:26:47.454 =========== 00:26:47.454 Arbitration Burst: 1 00:26:47.454 00:26:47.454 Power Management 00:26:47.454 ================ 00:26:47.454 Number of Power States: 1 00:26:47.454 Current Power State: Power State #0 00:26:47.454 Power State #0: 00:26:47.454 Max Power: 0.00 W 00:26:47.454 Non-Operational State: Operational 00:26:47.454 Entry Latency: Not Reported 00:26:47.454 Exit Latency: Not Reported 00:26:47.454 Relative Read Throughput: 0 00:26:47.454 Relative Read Latency: 0 00:26:47.454 Relative Write Throughput: 0 00:26:47.454 Relative Write Latency: 0 00:26:47.454 Idle Power: Not Reported 00:26:47.454 Active Power: Not Reported 00:26:47.454 Non-Operational Permissive Mode: Not Supported 00:26:47.454 00:26:47.454 Health Information 00:26:47.454 ================== 00:26:47.454 Critical Warnings: 00:26:47.454 Available Spare Space: OK 00:26:47.454 Temperature: OK 00:26:47.454 Device Reliability: OK 00:26:47.454 Read Only: No 00:26:47.454 Volatile Memory Backup: OK 00:26:47.454 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:47.454 Temperature Threshold: [2024-10-13 16:51:12.924635] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.924647] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.924653] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16ea2f0) 00:26:47.454 [2024-10-13 16:51:12.924664] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.454 [2024-10-13 16:51:12.924686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1743860, cid 7, qid 0 00:26:47.454 [2024-10-13 16:51:12.924798] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.454 [2024-10-13 16:51:12.924812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.454 [2024-10-13 16:51:12.924818] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.924825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1743860) on tqpair=0x16ea2f0 00:26:47.454 [2024-10-13 16:51:12.924863] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:47.454 [2024-10-13 16:51:12.924884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.454 [2024-10-13 16:51:12.924896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.454 [2024-10-13 16:51:12.924905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.454 [2024-10-13 16:51:12.924914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.454 [2024-10-13 16:51:12.924927] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.924935] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.924941] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16ea2f0) 00:26:47.454 [2024-10-13 16:51:12.924951] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.454 [2024-10-13 16:51:12.924973] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17432e0, cid 3, qid 0 00:26:47.454 [2024-10-13 16:51:12.925083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.454 [2024-10-13 16:51:12.925095] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.454 [2024-10-13 16:51:12.925101] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925108] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17432e0) on tqpair=0x16ea2f0 00:26:47.454 [2024-10-13 16:51:12.925119] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925133] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16ea2f0) 00:26:47.454 [2024-10-13 16:51:12.925143] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.454 [2024-10-13 16:51:12.925168] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17432e0, cid 3, qid 0 00:26:47.454 [2024-10-13 16:51:12.925254] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.454 [2024-10-13 16:51:12.925266] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.454 [2024-10-13 16:51:12.925272] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925278] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17432e0) on tqpair=0x16ea2f0 00:26:47.454 [2024-10-13 16:51:12.925287] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:47.454 [2024-10-13 16:51:12.925294] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:47.454 [2024-10-13 16:51:12.925309] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925318] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.925325] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16ea2f0) 00:26:47.454 [2024-10-13 16:51:12.925335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.454 [2024-10-13 16:51:12.925354] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17432e0, cid 3, qid 0 00:26:47.454 [2024-10-13 16:51:12.929410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.454 [2024-10-13 16:51:12.929426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.454 [2024-10-13 16:51:12.929434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.929440] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17432e0) on tqpair=0x16ea2f0 00:26:47.454 [2024-10-13 16:51:12.929458] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.929468] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.929474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16ea2f0) 00:26:47.454 [2024-10-13 16:51:12.929485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.454 [2024-10-13 16:51:12.929506] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17432e0, cid 3, qid 0 00:26:47.454 [2024-10-13 16:51:12.929619] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:47.454 [2024-10-13 16:51:12.929630] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:47.454 [2024-10-13 16:51:12.929637] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:47.454 [2024-10-13 16:51:12.929643] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17432e0) on tqpair=0x16ea2f0 00:26:47.454 [2024-10-13 16:51:12.929656] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:26:47.454 0 Kelvin (-273 Celsius) 00:26:47.454 Available Spare: 0% 00:26:47.454 Available Spare Threshold: 0% 00:26:47.454 Life Percentage Used: 0% 00:26:47.454 Data Units Read: 0 00:26:47.454 Data Units Written: 0 00:26:47.454 Host Read Commands: 0 00:26:47.454 Host Write Commands: 0 00:26:47.454 Controller Busy Time: 0 minutes 00:26:47.454 Power Cycles: 0 00:26:47.454 Power On Hours: 0 hours 00:26:47.454 Unsafe Shutdowns: 0 00:26:47.454 Unrecoverable Media Errors: 0 00:26:47.454 Lifetime Error Log Entries: 0 00:26:47.454 Warning Temperature Time: 0 minutes 00:26:47.454 Critical Temperature Time: 0 minutes 00:26:47.454 00:26:47.454 Number of Queues 00:26:47.454 ================ 00:26:47.454 Number of I/O Submission Queues: 127 00:26:47.454 Number of I/O Completion Queues: 127 00:26:47.454 00:26:47.454 Active Namespaces 00:26:47.454 ================= 00:26:47.454 Namespace ID:1 00:26:47.454 Error Recovery Timeout: Unlimited 00:26:47.454 Command Set Identifier: NVM (00h) 00:26:47.454 Deallocate: Supported 00:26:47.454 Deallocated/Unwritten Error: Not Supported 00:26:47.454 Deallocated Read Value: Unknown 00:26:47.454 Deallocate in Write Zeroes: Not Supported 00:26:47.454 Deallocated Guard Field: 0xFFFF 00:26:47.454 Flush: Supported 00:26:47.454 Reservation: Supported 00:26:47.454 Namespace Sharing Capabilities: Multiple Controllers 00:26:47.454 Size (in LBAs): 131072 (0GiB) 00:26:47.454 Capacity (in LBAs): 131072 (0GiB) 00:26:47.454 Utilization (in LBAs): 131072 (0GiB) 00:26:47.454 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:47.454 EUI64: ABCDEF0123456789 00:26:47.454 UUID: 20f82ae2-60a4-4f10-b437-b61cf7112b92 00:26:47.454 Thin Provisioning: Not Supported 00:26:47.454 Per-NS Atomic Units: Yes 00:26:47.454 Atomic Boundary Size (Normal): 0 00:26:47.454 Atomic Boundary Size (PFail): 0 00:26:47.454 Atomic Boundary Offset: 0 00:26:47.454 Maximum Single Source Range Length: 65535 00:26:47.454 Maximum Copy Length: 65535 00:26:47.454 Maximum Source Range Count: 1 00:26:47.454 NGUID/EUI64 Never Reused: No 00:26:47.454 Namespace Write Protected: No 00:26:47.454 Number of LBA Formats: 1 00:26:47.454 Current LBA Format: LBA Format #00 00:26:47.454 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:47.454 00:26:47.454 16:51:12 -- host/identify.sh@51 -- # sync 00:26:47.454 16:51:12 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:47.454 16:51:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.454 16:51:12 -- common/autotest_common.sh@10 -- # set +x 00:26:47.713 16:51:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.713 16:51:12 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:47.713 16:51:12 -- host/identify.sh@56 -- # nvmftestfini 00:26:47.713 16:51:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:47.713 16:51:12 -- nvmf/common.sh@116 -- # sync 00:26:47.713 16:51:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:47.713 16:51:12 -- nvmf/common.sh@119 -- # set +e 00:26:47.713 16:51:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:47.713 16:51:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:47.713 rmmod nvme_tcp 00:26:47.713 rmmod nvme_fabrics 00:26:47.713 rmmod nvme_keyring 00:26:47.713 16:51:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:47.713 16:51:13 -- nvmf/common.sh@123 -- # set -e 00:26:47.713 16:51:13 -- nvmf/common.sh@124 -- # return 0 00:26:47.713 16:51:13 -- nvmf/common.sh@477 -- # '[' -n 1286697 ']' 00:26:47.713 16:51:13 -- nvmf/common.sh@478 -- # killprocess 1286697 00:26:47.713 16:51:13 -- common/autotest_common.sh@926 -- # '[' -z 1286697 ']' 00:26:47.713 16:51:13 -- common/autotest_common.sh@930 -- # kill -0 1286697 00:26:47.713 16:51:13 -- common/autotest_common.sh@931 -- # uname 00:26:47.713 16:51:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:47.713 16:51:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286697 00:26:47.713 16:51:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:47.713 16:51:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:47.713 16:51:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286697' 00:26:47.713 killing process with pid 1286697 00:26:47.713 16:51:13 -- common/autotest_common.sh@945 -- # kill 1286697 00:26:47.713 [2024-10-13 16:51:13.058573] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:47.713 16:51:13 -- common/autotest_common.sh@950 -- # wait 1286697 00:26:47.971 16:51:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:47.971 16:51:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:47.971 16:51:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:47.971 16:51:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:47.971 16:51:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:47.971 16:51:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:47.971 16:51:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:47.971 16:51:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:49.875 16:51:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:49.875 00:26:49.875 real 0m6.225s 00:26:49.875 user 0m7.789s 00:26:49.875 sys 0m1.946s 00:26:49.875 16:51:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:49.875 16:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:49.875 ************************************ 00:26:49.875 END TEST nvmf_identify 00:26:49.875 ************************************ 00:26:50.134 16:51:15 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:50.134 16:51:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:50.134 16:51:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:50.134 16:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:50.134 ************************************ 00:26:50.134 START TEST nvmf_perf 00:26:50.134 ************************************ 00:26:50.134 16:51:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:50.134 * Looking for test storage... 00:26:50.134 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:50.134 16:51:15 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:50.134 16:51:15 -- nvmf/common.sh@7 -- # uname -s 00:26:50.134 16:51:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:50.134 16:51:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:50.134 16:51:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:50.134 16:51:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:50.134 16:51:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:50.134 16:51:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:50.134 16:51:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:50.134 16:51:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:50.134 16:51:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:50.134 16:51:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:50.134 16:51:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.134 16:51:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.134 16:51:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:50.134 16:51:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:50.134 16:51:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:50.134 16:51:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:50.134 16:51:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:50.134 16:51:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:50.134 16:51:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:50.134 16:51:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.134 16:51:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.134 16:51:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.134 16:51:15 -- paths/export.sh@5 -- # export PATH 00:26:50.134 16:51:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.134 16:51:15 -- nvmf/common.sh@46 -- # : 0 00:26:50.134 16:51:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:50.134 16:51:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:50.134 16:51:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:50.134 16:51:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:50.134 16:51:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:50.134 16:51:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:50.134 16:51:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:50.134 16:51:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:50.134 16:51:15 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:50.134 16:51:15 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:50.134 16:51:15 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:50.134 16:51:15 -- host/perf.sh@17 -- # nvmftestinit 00:26:50.134 16:51:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:50.134 16:51:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:50.134 16:51:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:50.134 16:51:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:50.134 16:51:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:50.134 16:51:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.134 16:51:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.134 16:51:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:50.134 16:51:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:50.134 16:51:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:50.134 16:51:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:50.134 16:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:52.036 16:51:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:52.036 16:51:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:52.036 16:51:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:52.036 16:51:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:52.036 16:51:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:52.036 16:51:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:52.036 16:51:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:52.036 16:51:17 -- nvmf/common.sh@294 -- # net_devs=() 00:26:52.036 16:51:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:52.036 16:51:17 -- nvmf/common.sh@295 -- # e810=() 00:26:52.036 16:51:17 -- nvmf/common.sh@295 -- # local -ga e810 00:26:52.036 16:51:17 -- nvmf/common.sh@296 -- # x722=() 00:26:52.036 16:51:17 -- nvmf/common.sh@296 -- # local -ga x722 00:26:52.036 16:51:17 -- nvmf/common.sh@297 -- # mlx=() 00:26:52.036 16:51:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:52.036 16:51:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:52.036 16:51:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:52.036 16:51:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:52.036 16:51:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.036 16:51:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:52.036 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:52.036 16:51:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.036 16:51:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:52.036 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:52.036 16:51:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.036 16:51:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.036 16:51:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.036 16:51:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:52.036 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:52.036 16:51:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.036 16:51:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.036 16:51:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.036 16:51:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.036 16:51:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:52.036 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:52.036 16:51:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.036 16:51:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:52.036 16:51:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:52.036 16:51:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:52.036 16:51:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:52.036 16:51:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:52.036 16:51:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:52.036 16:51:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:52.036 16:51:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:52.036 16:51:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:52.037 16:51:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:52.037 16:51:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:52.037 16:51:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:52.037 16:51:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:52.037 16:51:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:52.037 16:51:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:52.037 16:51:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:52.037 16:51:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:52.037 16:51:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:52.037 16:51:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:52.037 16:51:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:52.037 16:51:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:52.037 16:51:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:52.037 16:51:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:52.037 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:52.037 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:26:52.037 00:26:52.037 --- 10.0.0.2 ping statistics --- 00:26:52.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.037 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:26:52.037 16:51:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:52.037 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:52.037 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:26:52.037 00:26:52.037 --- 10.0.0.1 ping statistics --- 00:26:52.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.037 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:26:52.037 16:51:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:52.037 16:51:17 -- nvmf/common.sh@410 -- # return 0 00:26:52.037 16:51:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:52.037 16:51:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:52.037 16:51:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:52.037 16:51:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:52.037 16:51:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:52.037 16:51:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:52.037 16:51:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:52.037 16:51:17 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:52.037 16:51:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:52.037 16:51:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:52.037 16:51:17 -- common/autotest_common.sh@10 -- # set +x 00:26:52.037 16:51:17 -- nvmf/common.sh@469 -- # nvmfpid=1288801 00:26:52.037 16:51:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:52.037 16:51:17 -- nvmf/common.sh@470 -- # waitforlisten 1288801 00:26:52.037 16:51:17 -- common/autotest_common.sh@819 -- # '[' -z 1288801 ']' 00:26:52.037 16:51:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:52.037 16:51:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:52.037 16:51:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:52.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:52.037 16:51:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:52.037 16:51:17 -- common/autotest_common.sh@10 -- # set +x 00:26:52.296 [2024-10-13 16:51:17.568079] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:26:52.296 [2024-10-13 16:51:17.568150] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:52.296 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.296 [2024-10-13 16:51:17.630746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:52.296 [2024-10-13 16:51:17.714819] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:52.296 [2024-10-13 16:51:17.714972] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:52.296 [2024-10-13 16:51:17.714988] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:52.296 [2024-10-13 16:51:17.715001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:52.296 [2024-10-13 16:51:17.715055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:52.296 [2024-10-13 16:51:17.715118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:52.296 [2024-10-13 16:51:17.715183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:52.296 [2024-10-13 16:51:17.715186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:53.229 16:51:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:53.229 16:51:18 -- common/autotest_common.sh@852 -- # return 0 00:26:53.229 16:51:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:53.229 16:51:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:53.229 16:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:53.229 16:51:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:53.229 16:51:18 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:53.229 16:51:18 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:56.511 16:51:21 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:56.511 16:51:21 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:56.768 16:51:22 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:56.768 16:51:22 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:57.027 16:51:22 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:57.027 16:51:22 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:57.027 16:51:22 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:57.027 16:51:22 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:57.027 16:51:22 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:57.284 [2024-10-13 16:51:22.596328] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:57.284 16:51:22 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:57.542 16:51:22 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:57.542 16:51:22 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:57.799 16:51:23 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:57.799 16:51:23 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:58.057 16:51:23 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:58.315 [2024-10-13 16:51:23.608137] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:58.315 16:51:23 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:58.573 16:51:23 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:58.573 16:51:23 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:58.573 16:51:23 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:58.573 16:51:23 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:59.946 Initializing NVMe Controllers 00:26:59.946 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:59.946 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:59.946 Initialization complete. Launching workers. 00:26:59.946 ======================================================== 00:26:59.946 Latency(us) 00:26:59.946 Device Information : IOPS MiB/s Average min max 00:26:59.946 PCIE (0000:88:00.0) NSID 1 from core 0: 86254.36 336.93 370.50 21.61 7247.74 00:26:59.946 ======================================================== 00:26:59.946 Total : 86254.36 336.93 370.50 21.61 7247.74 00:26:59.946 00:26:59.946 16:51:25 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:59.946 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.941 Initializing NVMe Controllers 00:27:00.941 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:00.941 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:00.941 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:00.941 Initialization complete. Launching workers. 00:27:00.941 ======================================================== 00:27:00.941 Latency(us) 00:27:00.941 Device Information : IOPS MiB/s Average min max 00:27:00.941 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 52.81 0.21 19406.29 138.03 45093.61 00:27:00.941 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 55.80 0.22 17919.57 7953.78 47922.35 00:27:00.941 ======================================================== 00:27:00.941 Total : 108.62 0.42 18642.47 138.03 47922.35 00:27:00.941 00:27:00.941 16:51:26 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:00.941 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.316 Initializing NVMe Controllers 00:27:02.316 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:02.316 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:02.316 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:02.316 Initialization complete. Launching workers. 00:27:02.316 ======================================================== 00:27:02.316 Latency(us) 00:27:02.316 Device Information : IOPS MiB/s Average min max 00:27:02.316 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8501.02 33.21 3764.72 517.34 10410.08 00:27:02.316 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3921.24 15.32 8185.43 6318.38 16368.25 00:27:02.316 ======================================================== 00:27:02.316 Total : 12422.27 48.52 5160.18 517.34 16368.25 00:27:02.316 00:27:02.316 16:51:27 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:27:02.316 16:51:27 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:27:02.316 16:51:27 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:02.316 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.842 Initializing NVMe Controllers 00:27:04.842 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:04.842 Controller IO queue size 128, less than required. 00:27:04.842 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:04.842 Controller IO queue size 128, less than required. 00:27:04.842 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:04.842 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:04.842 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:04.842 Initialization complete. Launching workers. 00:27:04.842 ======================================================== 00:27:04.842 Latency(us) 00:27:04.842 Device Information : IOPS MiB/s Average min max 00:27:04.842 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1661.24 415.31 78206.61 56812.12 121321.26 00:27:04.842 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 605.63 151.41 218824.75 79405.78 332652.21 00:27:04.842 ======================================================== 00:27:04.842 Total : 2266.87 566.72 115774.92 56812.12 332652.21 00:27:04.842 00:27:04.842 16:51:30 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:27:04.842 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.100 No valid NVMe controllers or AIO or URING devices found 00:27:05.100 Initializing NVMe Controllers 00:27:05.100 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:05.100 Controller IO queue size 128, less than required. 00:27:05.100 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:05.100 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:27:05.100 Controller IO queue size 128, less than required. 00:27:05.100 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:05.100 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:27:05.100 WARNING: Some requested NVMe devices were skipped 00:27:05.100 16:51:30 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:27:05.100 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.380 Initializing NVMe Controllers 00:27:08.380 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:08.380 Controller IO queue size 128, less than required. 00:27:08.380 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:08.380 Controller IO queue size 128, less than required. 00:27:08.380 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:08.380 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:08.380 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:08.380 Initialization complete. Launching workers. 00:27:08.380 00:27:08.380 ==================== 00:27:08.380 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:27:08.380 TCP transport: 00:27:08.380 polls: 9069 00:27:08.380 idle_polls: 5787 00:27:08.380 sock_completions: 3282 00:27:08.380 nvme_completions: 6012 00:27:08.380 submitted_requests: 9189 00:27:08.380 queued_requests: 1 00:27:08.380 00:27:08.380 ==================== 00:27:08.380 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:27:08.380 TCP transport: 00:27:08.380 polls: 12297 00:27:08.380 idle_polls: 9289 00:27:08.380 sock_completions: 3008 00:27:08.380 nvme_completions: 5589 00:27:08.380 submitted_requests: 8560 00:27:08.380 queued_requests: 1 00:27:08.380 ======================================================== 00:27:08.380 Latency(us) 00:27:08.380 Device Information : IOPS MiB/s Average min max 00:27:08.380 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1566.46 391.62 84035.86 59825.40 135326.76 00:27:08.380 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1460.97 365.24 88689.22 42965.71 153696.53 00:27:08.380 ======================================================== 00:27:08.380 Total : 3027.43 756.86 86281.46 42965.71 153696.53 00:27:08.380 00:27:08.380 16:51:33 -- host/perf.sh@66 -- # sync 00:27:08.380 16:51:33 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:08.380 16:51:33 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:27:08.380 16:51:33 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:27:08.380 16:51:33 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:27:11.656 16:51:36 -- host/perf.sh@72 -- # ls_guid=045433d5-c388-44d6-bcf0-38f6c179b42e 00:27:11.656 16:51:36 -- host/perf.sh@73 -- # get_lvs_free_mb 045433d5-c388-44d6-bcf0-38f6c179b42e 00:27:11.656 16:51:36 -- common/autotest_common.sh@1343 -- # local lvs_uuid=045433d5-c388-44d6-bcf0-38f6c179b42e 00:27:11.656 16:51:36 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:11.656 16:51:36 -- common/autotest_common.sh@1345 -- # local fc 00:27:11.656 16:51:36 -- common/autotest_common.sh@1346 -- # local cs 00:27:11.656 16:51:36 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:11.656 16:51:36 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:11.656 { 00:27:11.656 "uuid": "045433d5-c388-44d6-bcf0-38f6c179b42e", 00:27:11.656 "name": "lvs_0", 00:27:11.656 "base_bdev": "Nvme0n1", 00:27:11.656 "total_data_clusters": 238234, 00:27:11.656 "free_clusters": 238234, 00:27:11.656 "block_size": 512, 00:27:11.656 "cluster_size": 4194304 00:27:11.656 } 00:27:11.656 ]' 00:27:11.656 16:51:36 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="045433d5-c388-44d6-bcf0-38f6c179b42e") .free_clusters' 00:27:11.656 16:51:36 -- common/autotest_common.sh@1348 -- # fc=238234 00:27:11.656 16:51:36 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="045433d5-c388-44d6-bcf0-38f6c179b42e") .cluster_size' 00:27:11.656 16:51:36 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:11.656 16:51:36 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:27:11.656 16:51:36 -- common/autotest_common.sh@1353 -- # echo 952936 00:27:11.656 952936 00:27:11.656 16:51:37 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:27:11.656 16:51:37 -- host/perf.sh@78 -- # free_mb=20480 00:27:11.656 16:51:37 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 045433d5-c388-44d6-bcf0-38f6c179b42e lbd_0 20480 00:27:12.221 16:51:37 -- host/perf.sh@80 -- # lb_guid=e1a04255-4ce2-4bf8-a930-3d219d128136 00:27:12.221 16:51:37 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore e1a04255-4ce2-4bf8-a930-3d219d128136 lvs_n_0 00:27:13.152 16:51:38 -- host/perf.sh@83 -- # ls_nested_guid=73d914d4-8497-4f1c-9774-40106d99e3de 00:27:13.152 16:51:38 -- host/perf.sh@84 -- # get_lvs_free_mb 73d914d4-8497-4f1c-9774-40106d99e3de 00:27:13.152 16:51:38 -- common/autotest_common.sh@1343 -- # local lvs_uuid=73d914d4-8497-4f1c-9774-40106d99e3de 00:27:13.152 16:51:38 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:13.152 16:51:38 -- common/autotest_common.sh@1345 -- # local fc 00:27:13.152 16:51:38 -- common/autotest_common.sh@1346 -- # local cs 00:27:13.152 16:51:38 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:13.152 16:51:38 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:13.152 { 00:27:13.152 "uuid": "045433d5-c388-44d6-bcf0-38f6c179b42e", 00:27:13.152 "name": "lvs_0", 00:27:13.152 "base_bdev": "Nvme0n1", 00:27:13.152 "total_data_clusters": 238234, 00:27:13.152 "free_clusters": 233114, 00:27:13.152 "block_size": 512, 00:27:13.153 "cluster_size": 4194304 00:27:13.153 }, 00:27:13.153 { 00:27:13.153 "uuid": "73d914d4-8497-4f1c-9774-40106d99e3de", 00:27:13.153 "name": "lvs_n_0", 00:27:13.153 "base_bdev": "e1a04255-4ce2-4bf8-a930-3d219d128136", 00:27:13.153 "total_data_clusters": 5114, 00:27:13.153 "free_clusters": 5114, 00:27:13.153 "block_size": 512, 00:27:13.153 "cluster_size": 4194304 00:27:13.153 } 00:27:13.153 ]' 00:27:13.153 16:51:38 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="73d914d4-8497-4f1c-9774-40106d99e3de") .free_clusters' 00:27:13.153 16:51:38 -- common/autotest_common.sh@1348 -- # fc=5114 00:27:13.153 16:51:38 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="73d914d4-8497-4f1c-9774-40106d99e3de") .cluster_size' 00:27:13.410 16:51:38 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:13.410 16:51:38 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:27:13.410 16:51:38 -- common/autotest_common.sh@1353 -- # echo 20456 00:27:13.410 20456 00:27:13.410 16:51:38 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:27:13.410 16:51:38 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 73d914d4-8497-4f1c-9774-40106d99e3de lbd_nest_0 20456 00:27:13.668 16:51:38 -- host/perf.sh@88 -- # lb_nested_guid=be3ec86d-8223-40a0-b734-b02a83c5bc5f 00:27:13.668 16:51:38 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:13.926 16:51:39 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:27:13.926 16:51:39 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 be3ec86d-8223-40a0-b734-b02a83c5bc5f 00:27:14.184 16:51:39 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:14.442 16:51:39 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:27:14.442 16:51:39 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:27:14.442 16:51:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:14.442 16:51:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:14.442 16:51:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:14.442 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.641 Initializing NVMe Controllers 00:27:26.641 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.642 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.642 Initialization complete. Launching workers. 00:27:26.642 ======================================================== 00:27:26.642 Latency(us) 00:27:26.642 Device Information : IOPS MiB/s Average min max 00:27:26.642 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.99 0.02 20492.22 168.49 45779.87 00:27:26.642 ======================================================== 00:27:26.642 Total : 48.99 0.02 20492.22 168.49 45779.87 00:27:26.642 00:27:26.642 16:51:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:26.642 16:51:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:26.642 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.606 Initializing NVMe Controllers 00:27:36.606 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:36.606 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:36.606 Initialization complete. Launching workers. 00:27:36.606 ======================================================== 00:27:36.606 Latency(us) 00:27:36.606 Device Information : IOPS MiB/s Average min max 00:27:36.606 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 79.57 9.95 12586.72 6985.05 47903.91 00:27:36.606 ======================================================== 00:27:36.606 Total : 79.57 9.95 12586.72 6985.05 47903.91 00:27:36.606 00:27:36.606 16:52:00 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:36.606 16:52:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:36.606 16:52:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:36.606 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.567 [2024-10-13 16:52:10.673756] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120efa0 is same with the state(5) to be set 00:27:46.567 Initializing NVMe Controllers 00:27:46.567 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:46.567 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:46.567 Initialization complete. Launching workers. 00:27:46.567 ======================================================== 00:27:46.567 Latency(us) 00:27:46.567 Device Information : IOPS MiB/s Average min max 00:27:46.567 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7875.70 3.85 4063.19 283.85 10046.52 00:27:46.567 ======================================================== 00:27:46.567 Total : 7875.70 3.85 4063.19 283.85 10046.52 00:27:46.567 00:27:46.568 16:52:10 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:46.568 16:52:10 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:46.568 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.530 Initializing NVMe Controllers 00:27:56.530 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:56.530 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:56.530 Initialization complete. Launching workers. 00:27:56.530 ======================================================== 00:27:56.530 Latency(us) 00:27:56.530 Device Information : IOPS MiB/s Average min max 00:27:56.530 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4077.20 509.65 7849.33 538.74 15920.06 00:27:56.530 ======================================================== 00:27:56.530 Total : 4077.20 509.65 7849.33 538.74 15920.06 00:27:56.530 00:27:56.530 16:52:21 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:56.530 16:52:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:56.530 16:52:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:56.530 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.491 Initializing NVMe Controllers 00:28:06.491 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:06.491 Controller IO queue size 128, less than required. 00:28:06.491 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:06.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:06.491 Initialization complete. Launching workers. 00:28:06.491 ======================================================== 00:28:06.491 Latency(us) 00:28:06.491 Device Information : IOPS MiB/s Average min max 00:28:06.491 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12068.84 5.89 10605.50 1819.21 25060.48 00:28:06.491 ======================================================== 00:28:06.491 Total : 12068.84 5.89 10605.50 1819.21 25060.48 00:28:06.491 00:28:06.491 16:52:31 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:06.491 16:52:31 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:06.491 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.552 Initializing NVMe Controllers 00:28:16.552 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:16.552 Controller IO queue size 128, less than required. 00:28:16.553 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:16.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:16.553 Initialization complete. Launching workers. 00:28:16.553 ======================================================== 00:28:16.553 Latency(us) 00:28:16.553 Device Information : IOPS MiB/s Average min max 00:28:16.553 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1191.12 148.89 108064.99 15719.97 228386.00 00:28:16.553 ======================================================== 00:28:16.553 Total : 1191.12 148.89 108064.99 15719.97 228386.00 00:28:16.553 00:28:16.553 16:52:41 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:16.810 16:52:42 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete be3ec86d-8223-40a0-b734-b02a83c5bc5f 00:28:17.742 16:52:42 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:17.742 16:52:43 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e1a04255-4ce2-4bf8-a930-3d219d128136 00:28:18.000 16:52:43 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:18.258 16:52:43 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:28:18.258 16:52:43 -- host/perf.sh@114 -- # nvmftestfini 00:28:18.258 16:52:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:18.258 16:52:43 -- nvmf/common.sh@116 -- # sync 00:28:18.258 16:52:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:18.258 16:52:43 -- nvmf/common.sh@119 -- # set +e 00:28:18.258 16:52:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:18.258 16:52:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:18.515 rmmod nvme_tcp 00:28:18.515 rmmod nvme_fabrics 00:28:18.515 rmmod nvme_keyring 00:28:18.515 16:52:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:18.515 16:52:43 -- nvmf/common.sh@123 -- # set -e 00:28:18.515 16:52:43 -- nvmf/common.sh@124 -- # return 0 00:28:18.515 16:52:43 -- nvmf/common.sh@477 -- # '[' -n 1288801 ']' 00:28:18.515 16:52:43 -- nvmf/common.sh@478 -- # killprocess 1288801 00:28:18.515 16:52:43 -- common/autotest_common.sh@926 -- # '[' -z 1288801 ']' 00:28:18.515 16:52:43 -- common/autotest_common.sh@930 -- # kill -0 1288801 00:28:18.515 16:52:43 -- common/autotest_common.sh@931 -- # uname 00:28:18.515 16:52:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:18.515 16:52:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1288801 00:28:18.515 16:52:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:18.515 16:52:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:18.515 16:52:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1288801' 00:28:18.515 killing process with pid 1288801 00:28:18.515 16:52:43 -- common/autotest_common.sh@945 -- # kill 1288801 00:28:18.515 16:52:43 -- common/autotest_common.sh@950 -- # wait 1288801 00:28:20.414 16:52:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:20.414 16:52:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:20.414 16:52:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:20.414 16:52:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:20.414 16:52:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:20.414 16:52:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:20.414 16:52:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:20.414 16:52:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.318 16:52:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:22.318 00:28:22.318 real 1m32.083s 00:28:22.318 user 5m41.936s 00:28:22.318 sys 0m15.472s 00:28:22.318 16:52:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:22.318 16:52:47 -- common/autotest_common.sh@10 -- # set +x 00:28:22.318 ************************************ 00:28:22.318 END TEST nvmf_perf 00:28:22.318 ************************************ 00:28:22.318 16:52:47 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:22.318 16:52:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:22.318 16:52:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:22.318 16:52:47 -- common/autotest_common.sh@10 -- # set +x 00:28:22.318 ************************************ 00:28:22.318 START TEST nvmf_fio_host 00:28:22.318 ************************************ 00:28:22.318 16:52:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:22.318 * Looking for test storage... 00:28:22.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:22.318 16:52:47 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.318 16:52:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.318 16:52:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.318 16:52:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.318 16:52:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.318 16:52:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- paths/export.sh@5 -- # export PATH 00:28:22.319 16:52:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:22.319 16:52:47 -- nvmf/common.sh@7 -- # uname -s 00:28:22.319 16:52:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:22.319 16:52:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:22.319 16:52:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:22.319 16:52:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:22.319 16:52:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:22.319 16:52:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:22.319 16:52:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:22.319 16:52:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:22.319 16:52:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:22.319 16:52:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:22.319 16:52:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:22.319 16:52:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:22.319 16:52:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:22.319 16:52:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:22.319 16:52:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:22.319 16:52:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.319 16:52:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.319 16:52:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.319 16:52:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.319 16:52:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- paths/export.sh@5 -- # export PATH 00:28:22.319 16:52:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.319 16:52:47 -- nvmf/common.sh@46 -- # : 0 00:28:22.319 16:52:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:22.319 16:52:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:22.319 16:52:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:22.319 16:52:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:22.319 16:52:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:22.319 16:52:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:22.319 16:52:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:22.319 16:52:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:22.319 16:52:47 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:22.319 16:52:47 -- host/fio.sh@14 -- # nvmftestinit 00:28:22.319 16:52:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:22.319 16:52:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:22.319 16:52:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:22.319 16:52:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:22.319 16:52:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:22.319 16:52:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:22.319 16:52:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:22.319 16:52:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.319 16:52:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:22.319 16:52:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:22.319 16:52:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:22.319 16:52:47 -- common/autotest_common.sh@10 -- # set +x 00:28:24.218 16:52:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:24.218 16:52:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:24.218 16:52:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:24.218 16:52:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:24.218 16:52:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:24.218 16:52:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:24.218 16:52:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:24.218 16:52:49 -- nvmf/common.sh@294 -- # net_devs=() 00:28:24.218 16:52:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:24.218 16:52:49 -- nvmf/common.sh@295 -- # e810=() 00:28:24.218 16:52:49 -- nvmf/common.sh@295 -- # local -ga e810 00:28:24.218 16:52:49 -- nvmf/common.sh@296 -- # x722=() 00:28:24.218 16:52:49 -- nvmf/common.sh@296 -- # local -ga x722 00:28:24.218 16:52:49 -- nvmf/common.sh@297 -- # mlx=() 00:28:24.218 16:52:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:24.218 16:52:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:24.218 16:52:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.218 16:52:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:24.218 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:24.218 16:52:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.218 16:52:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:24.218 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:24.218 16:52:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.218 16:52:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.218 16:52:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.218 16:52:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:24.218 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:24.218 16:52:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.218 16:52:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.218 16:52:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.218 16:52:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:24.218 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:24.218 16:52:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:24.218 16:52:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:24.218 16:52:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:24.218 16:52:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:24.218 16:52:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:24.218 16:52:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:24.218 16:52:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:24.218 16:52:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:24.218 16:52:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:24.218 16:52:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:24.218 16:52:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:24.218 16:52:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:24.218 16:52:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:24.218 16:52:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:24.218 16:52:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:24.218 16:52:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:24.218 16:52:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:24.218 16:52:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:24.218 16:52:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:24.218 16:52:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:24.218 16:52:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:24.218 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:24.218 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:28:24.218 00:28:24.218 --- 10.0.0.2 ping statistics --- 00:28:24.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.218 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:28:24.218 16:52:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:24.218 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:24.218 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:28:24.218 00:28:24.218 --- 10.0.0.1 ping statistics --- 00:28:24.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.218 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:28:24.218 16:52:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:24.218 16:52:49 -- nvmf/common.sh@410 -- # return 0 00:28:24.218 16:52:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:24.218 16:52:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:24.218 16:52:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:24.218 16:52:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:24.218 16:52:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:24.218 16:52:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:24.218 16:52:49 -- host/fio.sh@16 -- # [[ y != y ]] 00:28:24.218 16:52:49 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:28:24.218 16:52:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:24.218 16:52:49 -- common/autotest_common.sh@10 -- # set +x 00:28:24.476 16:52:49 -- host/fio.sh@24 -- # nvmfpid=1301255 00:28:24.476 16:52:49 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:24.476 16:52:49 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:24.476 16:52:49 -- host/fio.sh@28 -- # waitforlisten 1301255 00:28:24.476 16:52:49 -- common/autotest_common.sh@819 -- # '[' -z 1301255 ']' 00:28:24.476 16:52:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:24.476 16:52:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:24.476 16:52:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:24.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:24.476 16:52:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:24.476 16:52:49 -- common/autotest_common.sh@10 -- # set +x 00:28:24.476 [2024-10-13 16:52:49.763012] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:28:24.476 [2024-10-13 16:52:49.763097] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:24.476 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.476 [2024-10-13 16:52:49.831008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:24.476 [2024-10-13 16:52:49.925985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:24.476 [2024-10-13 16:52:49.926151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:24.476 [2024-10-13 16:52:49.926170] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:24.476 [2024-10-13 16:52:49.926198] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:24.476 [2024-10-13 16:52:49.929421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:24.476 [2024-10-13 16:52:49.929474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:24.476 [2024-10-13 16:52:49.929562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.476 [2024-10-13 16:52:49.929566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:25.408 16:52:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:25.408 16:52:50 -- common/autotest_common.sh@852 -- # return 0 00:28:25.408 16:52:50 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:25.665 [2024-10-13 16:52:51.061140] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:25.665 16:52:51 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:28:25.665 16:52:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:25.665 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:28:25.665 16:52:51 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:28:25.923 Malloc1 00:28:25.923 16:52:51 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:26.180 16:52:51 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:28:26.438 16:52:51 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:26.695 [2024-10-13 16:52:52.091523] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:26.695 16:52:52 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:26.953 16:52:52 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:28:26.953 16:52:52 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:26.953 16:52:52 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:26.953 16:52:52 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:26.953 16:52:52 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:26.953 16:52:52 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:26.953 16:52:52 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:26.953 16:52:52 -- common/autotest_common.sh@1320 -- # shift 00:28:26.953 16:52:52 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:26.953 16:52:52 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:26.953 16:52:52 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:26.953 16:52:52 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:26.953 16:52:52 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:26.953 16:52:52 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:26.953 16:52:52 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:26.953 16:52:52 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:27.210 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:27.210 fio-3.35 00:28:27.210 Starting 1 thread 00:28:27.210 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.736 00:28:29.736 test: (groupid=0, jobs=1): err= 0: pid=1301754: Sun Oct 13 16:52:54 2024 00:28:29.736 read: IOPS=8937, BW=34.9MiB/s (36.6MB/s)(70.0MiB/2006msec) 00:28:29.736 slat (nsec): min=1858, max=98312, avg=2331.01, stdev=1369.62 00:28:29.736 clat (usec): min=2411, max=12943, avg=7847.35, stdev=645.17 00:28:29.736 lat (usec): min=2431, max=12945, avg=7849.68, stdev=645.11 00:28:29.736 clat percentiles (usec): 00:28:29.736 | 1.00th=[ 6390], 5.00th=[ 6849], 10.00th=[ 7046], 20.00th=[ 7373], 00:28:29.736 | 30.00th=[ 7570], 40.00th=[ 7701], 50.00th=[ 7832], 60.00th=[ 8029], 00:28:29.736 | 70.00th=[ 8160], 80.00th=[ 8356], 90.00th=[ 8586], 95.00th=[ 8848], 00:28:29.736 | 99.00th=[ 9241], 99.50th=[ 9503], 99.90th=[11338], 99.95th=[12125], 00:28:29.736 | 99.99th=[12911] 00:28:29.736 bw ( KiB/s): min=33891, max=36760, per=99.96%, avg=35736.75, stdev=1265.73, samples=4 00:28:29.736 iops : min= 8472, max= 9190, avg=8934.00, stdev=316.80, samples=4 00:28:29.736 write: IOPS=8952, BW=35.0MiB/s (36.7MB/s)(70.1MiB/2006msec); 0 zone resets 00:28:29.736 slat (nsec): min=1952, max=91831, avg=2421.83, stdev=1171.54 00:28:29.736 clat (usec): min=904, max=11639, avg=6399.04, stdev=542.18 00:28:29.736 lat (usec): min=911, max=11641, avg=6401.46, stdev=542.15 00:28:29.736 clat percentiles (usec): 00:28:29.736 | 1.00th=[ 5211], 5.00th=[ 5604], 10.00th=[ 5800], 20.00th=[ 5997], 00:28:29.736 | 30.00th=[ 6128], 40.00th=[ 6259], 50.00th=[ 6390], 60.00th=[ 6521], 00:28:29.736 | 70.00th=[ 6652], 80.00th=[ 6783], 90.00th=[ 7046], 95.00th=[ 7177], 00:28:29.736 | 99.00th=[ 7570], 99.50th=[ 7832], 99.90th=[10814], 99.95th=[11207], 00:28:29.736 | 99.99th=[11469] 00:28:29.736 bw ( KiB/s): min=34901, max=36232, per=100.00%, avg=35813.25, stdev=626.63, samples=4 00:28:29.736 iops : min= 8725, max= 9058, avg=8953.25, stdev=156.78, samples=4 00:28:29.736 lat (usec) : 1000=0.01% 00:28:29.736 lat (msec) : 2=0.02%, 4=0.11%, 10=99.68%, 20=0.18% 00:28:29.736 cpu : usr=66.53%, sys=31.72%, ctx=98, majf=0, minf=36 00:28:29.736 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:29.736 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:29.736 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:29.736 issued rwts: total=17928,17958,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:29.736 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:29.736 00:28:29.736 Run status group 0 (all jobs): 00:28:29.736 READ: bw=34.9MiB/s (36.6MB/s), 34.9MiB/s-34.9MiB/s (36.6MB/s-36.6MB/s), io=70.0MiB (73.4MB), run=2006-2006msec 00:28:29.736 WRITE: bw=35.0MiB/s (36.7MB/s), 35.0MiB/s-35.0MiB/s (36.7MB/s-36.7MB/s), io=70.1MiB (73.6MB), run=2006-2006msec 00:28:29.736 16:52:54 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:29.736 16:52:54 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:29.736 16:52:54 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:29.736 16:52:54 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:29.736 16:52:54 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:29.736 16:52:54 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:29.736 16:52:54 -- common/autotest_common.sh@1320 -- # shift 00:28:29.736 16:52:54 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:29.736 16:52:54 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:29.736 16:52:54 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:29.736 16:52:54 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:29.736 16:52:54 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:29.736 16:52:54 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:29.736 16:52:54 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:29.736 16:52:54 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:29.736 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:28:29.736 fio-3.35 00:28:29.736 Starting 1 thread 00:28:29.736 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.260 00:28:32.260 test: (groupid=0, jobs=1): err= 0: pid=1302098: Sun Oct 13 16:52:57 2024 00:28:32.260 read: IOPS=8808, BW=138MiB/s (144MB/s)(276MiB/2006msec) 00:28:32.260 slat (usec): min=2, max=116, avg= 3.62, stdev= 1.91 00:28:32.260 clat (usec): min=900, max=16749, avg=8514.16, stdev=2088.67 00:28:32.260 lat (usec): min=904, max=16752, avg=8517.78, stdev=2088.77 00:28:32.260 clat percentiles (usec): 00:28:32.260 | 1.00th=[ 4293], 5.00th=[ 5145], 10.00th=[ 5800], 20.00th=[ 6718], 00:28:32.260 | 30.00th=[ 7308], 40.00th=[ 7898], 50.00th=[ 8455], 60.00th=[ 9110], 00:28:32.260 | 70.00th=[ 9634], 80.00th=[10159], 90.00th=[11076], 95.00th=[11994], 00:28:32.260 | 99.00th=[14091], 99.50th=[14484], 99.90th=[15270], 99.95th=[15664], 00:28:32.260 | 99.99th=[16712] 00:28:32.260 bw ( KiB/s): min=67392, max=74208, per=49.99%, avg=70448.00, stdev=3305.62, samples=4 00:28:32.260 iops : min= 4212, max= 4638, avg=4403.00, stdev=206.60, samples=4 00:28:32.260 write: IOPS=5073, BW=79.3MiB/s (83.1MB/s)(143MiB/1809msec); 0 zone resets 00:28:32.260 slat (usec): min=30, max=217, avg=34.10, stdev= 6.60 00:28:32.260 clat (usec): min=4714, max=19807, avg=10800.95, stdev=2070.02 00:28:32.261 lat (usec): min=4746, max=19838, avg=10835.06, stdev=2070.76 00:28:32.261 clat percentiles (usec): 00:28:32.261 | 1.00th=[ 7046], 5.00th=[ 7832], 10.00th=[ 8356], 20.00th=[ 8979], 00:28:32.261 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10552], 60.00th=[11076], 00:28:32.261 | 70.00th=[11731], 80.00th=[12649], 90.00th=[13829], 95.00th=[14484], 00:28:32.261 | 99.00th=[15926], 99.50th=[16450], 99.90th=[19268], 99.95th=[19530], 00:28:32.261 | 99.99th=[19792] 00:28:32.261 bw ( KiB/s): min=69984, max=77472, per=90.45%, avg=73424.00, stdev=3764.46, samples=4 00:28:32.261 iops : min= 4374, max= 4842, avg=4589.00, stdev=235.28, samples=4 00:28:32.261 lat (usec) : 1000=0.01% 00:28:32.261 lat (msec) : 2=0.03%, 4=0.31%, 10=64.23%, 20=35.42% 00:28:32.261 cpu : usr=79.55%, sys=19.30%, ctx=32, majf=0, minf=54 00:28:32.261 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:28:32.261 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:32.261 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:32.261 issued rwts: total=17669,9178,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:32.261 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:32.261 00:28:32.261 Run status group 0 (all jobs): 00:28:32.261 READ: bw=138MiB/s (144MB/s), 138MiB/s-138MiB/s (144MB/s-144MB/s), io=276MiB (289MB), run=2006-2006msec 00:28:32.261 WRITE: bw=79.3MiB/s (83.1MB/s), 79.3MiB/s-79.3MiB/s (83.1MB/s-83.1MB/s), io=143MiB (150MB), run=1809-1809msec 00:28:32.261 16:52:57 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:32.261 16:52:57 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:28:32.261 16:52:57 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:28:32.261 16:52:57 -- host/fio.sh@51 -- # get_nvme_bdfs 00:28:32.261 16:52:57 -- common/autotest_common.sh@1498 -- # bdfs=() 00:28:32.261 16:52:57 -- common/autotest_common.sh@1498 -- # local bdfs 00:28:32.261 16:52:57 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:32.261 16:52:57 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:32.261 16:52:57 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:28:32.261 16:52:57 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:28:32.261 16:52:57 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:28:32.261 16:52:57 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:28:35.537 Nvme0n1 00:28:35.537 16:53:00 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:38.820 16:53:03 -- host/fio.sh@53 -- # ls_guid=88c3b727-c70f-4d0a-95bd-c6bbfc99122c 00:28:38.821 16:53:03 -- host/fio.sh@54 -- # get_lvs_free_mb 88c3b727-c70f-4d0a-95bd-c6bbfc99122c 00:28:38.821 16:53:03 -- common/autotest_common.sh@1343 -- # local lvs_uuid=88c3b727-c70f-4d0a-95bd-c6bbfc99122c 00:28:38.821 16:53:03 -- common/autotest_common.sh@1344 -- # local lvs_info 00:28:38.821 16:53:03 -- common/autotest_common.sh@1345 -- # local fc 00:28:38.821 16:53:03 -- common/autotest_common.sh@1346 -- # local cs 00:28:38.821 16:53:03 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:38.821 16:53:03 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:28:38.821 { 00:28:38.821 "uuid": "88c3b727-c70f-4d0a-95bd-c6bbfc99122c", 00:28:38.821 "name": "lvs_0", 00:28:38.821 "base_bdev": "Nvme0n1", 00:28:38.821 "total_data_clusters": 930, 00:28:38.821 "free_clusters": 930, 00:28:38.821 "block_size": 512, 00:28:38.821 "cluster_size": 1073741824 00:28:38.821 } 00:28:38.821 ]' 00:28:38.821 16:53:03 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="88c3b727-c70f-4d0a-95bd-c6bbfc99122c") .free_clusters' 00:28:38.821 16:53:03 -- common/autotest_common.sh@1348 -- # fc=930 00:28:38.821 16:53:03 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="88c3b727-c70f-4d0a-95bd-c6bbfc99122c") .cluster_size' 00:28:38.821 16:53:04 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:28:38.821 16:53:04 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:28:38.821 16:53:04 -- common/autotest_common.sh@1353 -- # echo 952320 00:28:38.821 952320 00:28:38.821 16:53:04 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:28:39.079 42928851-f066-459f-ab6d-fd20e57f5536 00:28:39.079 16:53:04 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:39.337 16:53:04 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:39.594 16:53:04 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:39.853 16:53:05 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:39.853 16:53:05 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:39.853 16:53:05 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:39.853 16:53:05 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:39.853 16:53:05 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:39.853 16:53:05 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:39.853 16:53:05 -- common/autotest_common.sh@1320 -- # shift 00:28:39.853 16:53:05 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:39.853 16:53:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:39.853 16:53:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:39.853 16:53:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:39.853 16:53:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:39.853 16:53:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:39.853 16:53:05 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:39.853 16:53:05 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:40.111 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:40.111 fio-3.35 00:28:40.111 Starting 1 thread 00:28:40.111 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.643 00:28:42.643 test: (groupid=0, jobs=1): err= 0: pid=1303433: Sun Oct 13 16:53:07 2024 00:28:42.643 read: IOPS=6380, BW=24.9MiB/s (26.1MB/s)(50.0MiB/2008msec) 00:28:42.643 slat (nsec): min=1861, max=142046, avg=2412.46, stdev=1784.19 00:28:42.643 clat (usec): min=615, max=170687, avg=10977.04, stdev=11312.53 00:28:42.643 lat (usec): min=617, max=170723, avg=10979.46, stdev=11312.79 00:28:42.643 clat percentiles (msec): 00:28:42.643 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:28:42.643 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:28:42.643 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:28:42.643 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:42.643 | 99.99th=[ 171] 00:28:42.643 bw ( KiB/s): min=17944, max=28104, per=99.91%, avg=25498.00, stdev=5037.05, samples=4 00:28:42.643 iops : min= 4486, max= 7026, avg=6374.50, stdev=1259.26, samples=4 00:28:42.643 write: IOPS=6381, BW=24.9MiB/s (26.1MB/s)(50.1MiB/2008msec); 0 zone resets 00:28:42.643 slat (usec): min=2, max=105, avg= 2.48, stdev= 1.34 00:28:42.643 clat (usec): min=308, max=169010, avg=8937.40, stdev=10613.87 00:28:42.643 lat (usec): min=310, max=169015, avg=8939.88, stdev=10614.08 00:28:42.643 clat percentiles (msec): 00:28:42.643 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:28:42.643 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:42.643 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:28:42.643 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:28:42.643 | 99.99th=[ 169] 00:28:42.643 bw ( KiB/s): min=18984, max=27720, per=99.90%, avg=25500.00, stdev=4344.13, samples=4 00:28:42.643 iops : min= 4746, max= 6930, avg=6375.00, stdev=1086.03, samples=4 00:28:42.643 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.01% 00:28:42.643 lat (msec) : 2=0.02%, 4=0.18%, 10=69.49%, 20=29.78%, 250=0.50% 00:28:42.643 cpu : usr=63.38%, sys=35.28%, ctx=129, majf=0, minf=36 00:28:42.643 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:42.643 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.643 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:42.643 issued rwts: total=12812,12814,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:42.643 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:42.643 00:28:42.643 Run status group 0 (all jobs): 00:28:42.643 READ: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.0MiB (52.5MB), run=2008-2008msec 00:28:42.643 WRITE: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.1MiB (52.5MB), run=2008-2008msec 00:28:42.643 16:53:07 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:42.643 16:53:08 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:44.017 16:53:09 -- host/fio.sh@64 -- # ls_nested_guid=7e77a90c-b572-4da0-81ad-236b0c821ec7 00:28:44.017 16:53:09 -- host/fio.sh@65 -- # get_lvs_free_mb 7e77a90c-b572-4da0-81ad-236b0c821ec7 00:28:44.017 16:53:09 -- common/autotest_common.sh@1343 -- # local lvs_uuid=7e77a90c-b572-4da0-81ad-236b0c821ec7 00:28:44.017 16:53:09 -- common/autotest_common.sh@1344 -- # local lvs_info 00:28:44.017 16:53:09 -- common/autotest_common.sh@1345 -- # local fc 00:28:44.017 16:53:09 -- common/autotest_common.sh@1346 -- # local cs 00:28:44.017 16:53:09 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:44.017 16:53:09 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:28:44.017 { 00:28:44.017 "uuid": "88c3b727-c70f-4d0a-95bd-c6bbfc99122c", 00:28:44.017 "name": "lvs_0", 00:28:44.017 "base_bdev": "Nvme0n1", 00:28:44.017 "total_data_clusters": 930, 00:28:44.017 "free_clusters": 0, 00:28:44.017 "block_size": 512, 00:28:44.017 "cluster_size": 1073741824 00:28:44.017 }, 00:28:44.017 { 00:28:44.017 "uuid": "7e77a90c-b572-4da0-81ad-236b0c821ec7", 00:28:44.017 "name": "lvs_n_0", 00:28:44.017 "base_bdev": "42928851-f066-459f-ab6d-fd20e57f5536", 00:28:44.017 "total_data_clusters": 237847, 00:28:44.017 "free_clusters": 237847, 00:28:44.017 "block_size": 512, 00:28:44.017 "cluster_size": 4194304 00:28:44.017 } 00:28:44.017 ]' 00:28:44.017 16:53:09 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="7e77a90c-b572-4da0-81ad-236b0c821ec7") .free_clusters' 00:28:44.017 16:53:09 -- common/autotest_common.sh@1348 -- # fc=237847 00:28:44.017 16:53:09 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="7e77a90c-b572-4da0-81ad-236b0c821ec7") .cluster_size' 00:28:44.017 16:53:09 -- common/autotest_common.sh@1349 -- # cs=4194304 00:28:44.017 16:53:09 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:28:44.017 16:53:09 -- common/autotest_common.sh@1353 -- # echo 951388 00:28:44.017 951388 00:28:44.017 16:53:09 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:44.949 22924af3-846f-4445-ac30-c3b013fa5865 00:28:44.949 16:53:10 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:44.949 16:53:10 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:45.207 16:53:10 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:45.498 16:53:10 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:45.498 16:53:10 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:45.498 16:53:10 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:45.498 16:53:10 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:45.498 16:53:10 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:45.498 16:53:10 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:45.498 16:53:10 -- common/autotest_common.sh@1320 -- # shift 00:28:45.498 16:53:10 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:45.498 16:53:10 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:45.498 16:53:10 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:45.498 16:53:10 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:45.498 16:53:10 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:45.498 16:53:10 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:45.498 16:53:10 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:45.498 16:53:10 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:45.779 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:45.779 fio-3.35 00:28:45.779 Starting 1 thread 00:28:45.779 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.305 00:28:48.305 test: (groupid=0, jobs=1): err= 0: pid=1304262: Sun Oct 13 16:53:13 2024 00:28:48.305 read: IOPS=6200, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2008msec) 00:28:48.305 slat (usec): min=2, max=132, avg= 2.74, stdev= 2.09 00:28:48.305 clat (usec): min=4311, max=19803, avg=11360.70, stdev=989.82 00:28:48.305 lat (usec): min=4318, max=19805, avg=11363.44, stdev=989.75 00:28:48.305 clat percentiles (usec): 00:28:48.305 | 1.00th=[ 8979], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[10552], 00:28:48.305 | 30.00th=[10945], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:28:48.305 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12911], 00:28:48.305 | 99.00th=[13566], 99.50th=[13960], 99.90th=[17957], 99.95th=[18220], 00:28:48.305 | 99.99th=[19792] 00:28:48.305 bw ( KiB/s): min=23744, max=25176, per=99.89%, avg=24776.00, stdev=692.54, samples=4 00:28:48.305 iops : min= 5936, max= 6294, avg=6194.00, stdev=173.14, samples=4 00:28:48.305 write: IOPS=6195, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2008msec); 0 zone resets 00:28:48.305 slat (usec): min=2, max=140, avg= 2.78, stdev= 1.85 00:28:48.305 clat (usec): min=2138, max=15593, avg=9192.52, stdev=827.04 00:28:48.305 lat (usec): min=2146, max=15595, avg=9195.30, stdev=827.04 00:28:48.305 clat percentiles (usec): 00:28:48.305 | 1.00th=[ 7308], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:28:48.305 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:28:48.305 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10421], 00:28:48.305 | 99.00th=[10945], 99.50th=[11338], 99.90th=[14353], 99.95th=[14615], 00:28:48.305 | 99.99th=[15533] 00:28:48.305 bw ( KiB/s): min=24704, max=24840, per=99.88%, avg=24754.00, stdev=64.79, samples=4 00:28:48.305 iops : min= 6176, max= 6210, avg=6188.50, stdev=16.20, samples=4 00:28:48.305 lat (msec) : 4=0.04%, 10=46.31%, 20=53.66% 00:28:48.305 cpu : usr=61.93%, sys=36.67%, ctx=112, majf=0, minf=36 00:28:48.305 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:48.305 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:48.305 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:48.305 issued rwts: total=12451,12441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:48.305 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:48.305 00:28:48.305 Run status group 0 (all jobs): 00:28:48.305 READ: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (51.0MB), run=2008-2008msec 00:28:48.305 WRITE: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (51.0MB), run=2008-2008msec 00:28:48.305 16:53:13 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:48.305 16:53:13 -- host/fio.sh@74 -- # sync 00:28:48.305 16:53:13 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:52.484 16:53:17 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:52.485 16:53:17 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:55.760 16:53:20 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:55.760 16:53:20 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:57.656 16:53:22 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:57.656 16:53:22 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:57.656 16:53:22 -- host/fio.sh@86 -- # nvmftestfini 00:28:57.656 16:53:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:57.656 16:53:22 -- nvmf/common.sh@116 -- # sync 00:28:57.656 16:53:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:57.656 16:53:22 -- nvmf/common.sh@119 -- # set +e 00:28:57.656 16:53:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:57.656 16:53:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:57.656 rmmod nvme_tcp 00:28:57.656 rmmod nvme_fabrics 00:28:57.656 rmmod nvme_keyring 00:28:57.656 16:53:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:57.656 16:53:23 -- nvmf/common.sh@123 -- # set -e 00:28:57.656 16:53:23 -- nvmf/common.sh@124 -- # return 0 00:28:57.656 16:53:23 -- nvmf/common.sh@477 -- # '[' -n 1301255 ']' 00:28:57.656 16:53:23 -- nvmf/common.sh@478 -- # killprocess 1301255 00:28:57.656 16:53:23 -- common/autotest_common.sh@926 -- # '[' -z 1301255 ']' 00:28:57.656 16:53:23 -- common/autotest_common.sh@930 -- # kill -0 1301255 00:28:57.656 16:53:23 -- common/autotest_common.sh@931 -- # uname 00:28:57.656 16:53:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:57.656 16:53:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1301255 00:28:57.656 16:53:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:57.656 16:53:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:57.656 16:53:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1301255' 00:28:57.656 killing process with pid 1301255 00:28:57.656 16:53:23 -- common/autotest_common.sh@945 -- # kill 1301255 00:28:57.656 16:53:23 -- common/autotest_common.sh@950 -- # wait 1301255 00:28:57.914 16:53:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:57.914 16:53:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:57.914 16:53:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:57.914 16:53:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:57.914 16:53:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:57.914 16:53:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:57.914 16:53:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:57.914 16:53:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:59.816 16:53:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:59.816 00:28:59.816 real 0m37.804s 00:28:59.816 user 2m26.124s 00:28:59.816 sys 0m6.510s 00:28:59.816 16:53:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:59.816 16:53:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.816 ************************************ 00:28:59.816 END TEST nvmf_fio_host 00:28:59.816 ************************************ 00:29:00.074 16:53:25 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:29:00.074 16:53:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:00.074 16:53:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:00.074 16:53:25 -- common/autotest_common.sh@10 -- # set +x 00:29:00.074 ************************************ 00:29:00.074 START TEST nvmf_failover 00:29:00.074 ************************************ 00:29:00.074 16:53:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:29:00.074 * Looking for test storage... 00:29:00.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:00.074 16:53:25 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:00.074 16:53:25 -- nvmf/common.sh@7 -- # uname -s 00:29:00.075 16:53:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:00.075 16:53:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:00.075 16:53:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:00.075 16:53:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:00.075 16:53:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:00.075 16:53:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:00.075 16:53:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:00.075 16:53:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:00.075 16:53:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:00.075 16:53:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:00.075 16:53:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:00.075 16:53:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:00.075 16:53:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:00.075 16:53:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:00.075 16:53:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:00.075 16:53:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:00.075 16:53:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:00.075 16:53:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:00.075 16:53:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:00.075 16:53:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.075 16:53:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.075 16:53:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.075 16:53:25 -- paths/export.sh@5 -- # export PATH 00:29:00.075 16:53:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:00.075 16:53:25 -- nvmf/common.sh@46 -- # : 0 00:29:00.075 16:53:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:00.075 16:53:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:00.075 16:53:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:00.075 16:53:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:00.075 16:53:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:00.075 16:53:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:00.075 16:53:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:00.075 16:53:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:00.075 16:53:25 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:00.075 16:53:25 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:00.075 16:53:25 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:29:00.075 16:53:25 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:29:00.075 16:53:25 -- host/failover.sh@18 -- # nvmftestinit 00:29:00.075 16:53:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:00.075 16:53:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:00.075 16:53:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:00.075 16:53:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:00.075 16:53:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:00.075 16:53:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:00.075 16:53:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:00.075 16:53:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:00.075 16:53:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:00.075 16:53:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:00.075 16:53:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:00.075 16:53:25 -- common/autotest_common.sh@10 -- # set +x 00:29:01.975 16:53:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:01.975 16:53:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:01.975 16:53:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:01.975 16:53:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:01.975 16:53:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:01.975 16:53:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:01.975 16:53:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:01.975 16:53:27 -- nvmf/common.sh@294 -- # net_devs=() 00:29:01.975 16:53:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:01.975 16:53:27 -- nvmf/common.sh@295 -- # e810=() 00:29:01.975 16:53:27 -- nvmf/common.sh@295 -- # local -ga e810 00:29:01.975 16:53:27 -- nvmf/common.sh@296 -- # x722=() 00:29:01.975 16:53:27 -- nvmf/common.sh@296 -- # local -ga x722 00:29:01.975 16:53:27 -- nvmf/common.sh@297 -- # mlx=() 00:29:01.975 16:53:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:01.975 16:53:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:01.976 16:53:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:01.976 16:53:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:01.976 16:53:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:01.976 16:53:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:01.976 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:01.976 16:53:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:01.976 16:53:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:01.976 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:01.976 16:53:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:01.976 16:53:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:01.976 16:53:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:01.976 16:53:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:01.976 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:01.976 16:53:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:01.976 16:53:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:01.976 16:53:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:01.976 16:53:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:01.976 16:53:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:01.976 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:01.976 16:53:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:01.976 16:53:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:01.976 16:53:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:01.976 16:53:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:01.976 16:53:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:01.976 16:53:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:01.976 16:53:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:01.976 16:53:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:01.976 16:53:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:01.976 16:53:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:01.976 16:53:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:01.976 16:53:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:01.976 16:53:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:01.976 16:53:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:01.976 16:53:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:01.976 16:53:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:01.976 16:53:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:01.976 16:53:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:01.976 16:53:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:01.976 16:53:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:01.976 16:53:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:02.234 16:53:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:02.234 16:53:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:02.234 16:53:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:02.234 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:02.234 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:29:02.234 00:29:02.234 --- 10.0.0.2 ping statistics --- 00:29:02.234 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:02.234 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:29:02.234 16:53:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:02.234 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:02.234 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:29:02.234 00:29:02.234 --- 10.0.0.1 ping statistics --- 00:29:02.234 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:02.234 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:29:02.234 16:53:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:02.234 16:53:27 -- nvmf/common.sh@410 -- # return 0 00:29:02.234 16:53:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:02.234 16:53:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:02.234 16:53:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:02.234 16:53:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:02.234 16:53:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:02.234 16:53:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:02.234 16:53:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:02.234 16:53:27 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:29:02.234 16:53:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:02.234 16:53:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:02.234 16:53:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.234 16:53:27 -- nvmf/common.sh@469 -- # nvmfpid=1307586 00:29:02.234 16:53:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:02.234 16:53:27 -- nvmf/common.sh@470 -- # waitforlisten 1307586 00:29:02.234 16:53:27 -- common/autotest_common.sh@819 -- # '[' -z 1307586 ']' 00:29:02.234 16:53:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:02.234 16:53:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:02.234 16:53:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:02.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:02.234 16:53:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:02.234 16:53:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.234 [2024-10-13 16:53:27.596461] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:02.234 [2024-10-13 16:53:27.596548] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:02.234 EAL: No free 2048 kB hugepages reported on node 1 00:29:02.234 [2024-10-13 16:53:27.662392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:02.492 [2024-10-13 16:53:27.750722] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:02.492 [2024-10-13 16:53:27.750872] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:02.492 [2024-10-13 16:53:27.750891] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:02.492 [2024-10-13 16:53:27.750906] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:02.492 [2024-10-13 16:53:27.750996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:02.492 [2024-10-13 16:53:27.751112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:02.492 [2024-10-13 16:53:27.751115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:03.422 16:53:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:03.422 16:53:28 -- common/autotest_common.sh@852 -- # return 0 00:29:03.422 16:53:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:03.422 16:53:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:03.422 16:53:28 -- common/autotest_common.sh@10 -- # set +x 00:29:03.422 16:53:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:03.422 16:53:28 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:29:03.422 [2024-10-13 16:53:28.848399] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:03.422 16:53:28 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:29:03.680 Malloc0 00:29:03.680 16:53:29 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:03.938 16:53:29 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:04.195 16:53:29 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:04.452 [2024-10-13 16:53:29.893002] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.453 16:53:29 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:04.710 [2024-10-13 16:53:30.149879] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:04.710 16:53:30 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:04.968 [2024-10-13 16:53:30.418673] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:04.968 16:53:30 -- host/failover.sh@31 -- # bdevperf_pid=1307901 00:29:04.968 16:53:30 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:29:04.968 16:53:30 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:04.968 16:53:30 -- host/failover.sh@34 -- # waitforlisten 1307901 /var/tmp/bdevperf.sock 00:29:04.968 16:53:30 -- common/autotest_common.sh@819 -- # '[' -z 1307901 ']' 00:29:04.968 16:53:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:29:04.968 16:53:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:04.968 16:53:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:29:04.968 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:29:04.968 16:53:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:04.968 16:53:30 -- common/autotest_common.sh@10 -- # set +x 00:29:06.340 16:53:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:06.340 16:53:31 -- common/autotest_common.sh@852 -- # return 0 00:29:06.340 16:53:31 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:06.598 NVMe0n1 00:29:06.598 16:53:31 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:06.856 00:29:06.856 16:53:32 -- host/failover.sh@39 -- # run_test_pid=1308164 00:29:06.856 16:53:32 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:06.856 16:53:32 -- host/failover.sh@41 -- # sleep 1 00:29:08.229 16:53:33 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:08.229 [2024-10-13 16:53:33.631818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631967] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.631990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632048] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632060] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632094] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632174] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632185] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632234] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632256] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632313] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632336] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632362] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632390] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632437] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632448] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632460] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632494] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632596] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 [2024-10-13 16:53:33.632619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce8180 is same with the state(5) to be set 00:29:08.229 16:53:33 -- host/failover.sh@45 -- # sleep 3 00:29:11.508 16:53:36 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:11.765 00:29:11.765 16:53:37 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:12.023 [2024-10-13 16:53:37.395580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395641] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395730] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395753] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395765] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395881] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395893] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395950] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395975] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.395987] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396040] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396099] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.023 [2024-10-13 16:53:37.396133] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396145] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396192] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396273] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396334] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396416] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396464] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396487] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396546] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396569] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396603] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396615] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 [2024-10-13 16:53:37.396689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce9530 is same with the state(5) to be set 00:29:12.024 16:53:37 -- host/failover.sh@50 -- # sleep 3 00:29:15.303 16:53:40 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:15.303 [2024-10-13 16:53:40.671059] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:15.303 16:53:40 -- host/failover.sh@55 -- # sleep 1 00:29:16.236 16:53:41 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:16.494 [2024-10-13 16:53:41.951424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951482] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951546] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951569] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951593] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951628] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951721] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951734] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.494 [2024-10-13 16:53:41.951758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951792] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951804] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951850] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951920] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951954] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951980] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.951993] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952004] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952073] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952118] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952162] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952173] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 [2024-10-13 16:53:41.952431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9f5e0 is same with the state(5) to be set 00:29:16.495 16:53:41 -- host/failover.sh@59 -- # wait 1308164 00:29:23.064 0 00:29:23.064 16:53:47 -- host/failover.sh@61 -- # killprocess 1307901 00:29:23.064 16:53:47 -- common/autotest_common.sh@926 -- # '[' -z 1307901 ']' 00:29:23.064 16:53:47 -- common/autotest_common.sh@930 -- # kill -0 1307901 00:29:23.064 16:53:47 -- common/autotest_common.sh@931 -- # uname 00:29:23.064 16:53:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:23.064 16:53:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1307901 00:29:23.064 16:53:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:23.064 16:53:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:23.064 16:53:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1307901' 00:29:23.064 killing process with pid 1307901 00:29:23.064 16:53:47 -- common/autotest_common.sh@945 -- # kill 1307901 00:29:23.064 16:53:47 -- common/autotest_common.sh@950 -- # wait 1307901 00:29:23.064 16:53:47 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:23.064 [2024-10-13 16:53:30.482508] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:23.064 [2024-10-13 16:53:30.482593] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1307901 ] 00:29:23.064 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.064 [2024-10-13 16:53:30.547040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:23.064 [2024-10-13 16:53:30.635365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:23.064 Running I/O for 15 seconds... 00:29:23.064 [2024-10-13 16:53:33.632898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.632941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.632968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:122704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.632984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:122720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:122728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:122736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:122760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:122088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:122096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:122120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:122136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:122152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:122184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:122240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:122296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:122320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:122328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.064 [2024-10-13 16:53:33.633585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:122336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.064 [2024-10-13 16:53:33.633598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:122344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:122392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:122840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:122888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:122904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:122920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:122952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.633978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.633993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:122968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:122984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:122992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:123000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:123016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:123024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:123032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:123040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:123048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:123056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:123064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:123080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:123088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:123104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.065 [2024-10-13 16:53:33.634510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:122504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:122520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:122528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:122552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:122560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.065 [2024-10-13 16:53:33.634782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.065 [2024-10-13 16:53:33.634795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.634824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.634852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:123144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.634880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:123152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.634908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:123160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.634936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:123168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.634963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.634978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:123176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.634991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:123192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:123200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:123216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:123248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:123256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:123272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:123280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:123288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:123312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.066 [2024-10-13 16:53:33.635491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:123320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:122568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:122672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:122744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:122776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:122792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.066 [2024-10-13 16:53:33.635961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:122800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.066 [2024-10-13 16:53:33.635974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.635989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:122808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:123336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:123352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:123360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:123368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:123376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:123384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:123392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:123400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:123408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:123416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:123424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:123440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.067 [2024-10-13 16:53:33.636409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:123448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:122832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:122848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:122928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:122936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:122944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:33.636637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c70 is same with the state(5) to be set 00:29:23.067 [2024-10-13 16:53:33.636668] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:23.067 [2024-10-13 16:53:33.636679] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:23.067 [2024-10-13 16:53:33.636696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122976 len:8 PRP1 0x0 PRP2 0x0 00:29:23.067 [2024-10-13 16:53:33.636709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636773] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f62c70 was disconnected and freed. reset controller. 00:29:23.067 [2024-10-13 16:53:33.636798] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:23.067 [2024-10-13 16:53:33.636834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:33.636852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:33.636879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:33.636906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:33.636931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:33.636943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:23.067 [2024-10-13 16:53:33.636995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f43600 (9): Bad file descriptor 00:29:23.067 [2024-10-13 16:53:33.639228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:23.067 [2024-10-13 16:53:33.707037] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:23.067 [2024-10-13 16:53:37.395884] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:37.395931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.395956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:37.395971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.395986] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:37.395999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.067 [2024-10-13 16:53:37.396025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f43600 is same with the state(5) to be set 00:29:23.067 [2024-10-13 16:53:37.396846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:13272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:37.396871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:13288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:37.396911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:13296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:37.396941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:13304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.067 [2024-10-13 16:53:37.396969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.067 [2024-10-13 16:53:37.396983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.396996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:13344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:12832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:12848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:12856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:12904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:12912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:12920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:13352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:13360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:13376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:13392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:13400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:13408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:13456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:13472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:13488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:13504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:12936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:12968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:12976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:13048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.068 [2024-10-13 16:53:37.397977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.068 [2024-10-13 16:53:37.397991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:13544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:13552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:13560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:13568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:13608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:13632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:13056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:13064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:13096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:13104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:13120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:13152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:13168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:13640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:13648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:13672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:13680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:13688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:13712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:13720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:13728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:13736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.398933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:13744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.398978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:13752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.069 [2024-10-13 16:53:37.398992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:13192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:13224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:13248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:13264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:13280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.069 [2024-10-13 16:53:37.399142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:13312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.069 [2024-10-13 16:53:37.399155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:13368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:13768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:13776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:13784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:13792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:13800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:13816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:13832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:13840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:13848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:13864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:13872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:13880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:13888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:13912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:13920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:13928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:13936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:13952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.399942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.399985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:13968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.399999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:13976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:13984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:13992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:14000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:14008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:14016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.400173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.400229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.070 [2024-10-13 16:53:37.400258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:14048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.070 [2024-10-13 16:53:37.400301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:14056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.070 [2024-10-13 16:53:37.400315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:14064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:13416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:13448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:13464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:13496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:13528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:37.400556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f4fa90 is same with the state(5) to be set 00:29:23.071 [2024-10-13 16:53:37.400586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:23.071 [2024-10-13 16:53:37.400598] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:23.071 [2024-10-13 16:53:37.400609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13536 len:8 PRP1 0x0 PRP2 0x0 00:29:23.071 [2024-10-13 16:53:37.400622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:37.400681] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f4fa90 was disconnected and freed. reset controller. 00:29:23.071 [2024-10-13 16:53:37.400698] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:29:23.071 [2024-10-13 16:53:37.400715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:23.071 [2024-10-13 16:53:37.402887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:23.071 [2024-10-13 16:53:37.402927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f43600 (9): Bad file descriptor 00:29:23.071 [2024-10-13 16:53:37.555827] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:23.071 [2024-10-13 16:53:41.952593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:18048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:18064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:18080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:18088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:18136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:18144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.952897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:18152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.952924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:18160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.952951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:18168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.952978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.952993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:18184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:18200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:18208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:18224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:18240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:18248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:18256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:18264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:18272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.071 [2024-10-13 16:53:41.953332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:18280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:18296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.071 [2024-10-13 16:53:41.953439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.071 [2024-10-13 16:53:41.953454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.953468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.953504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:18320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.953532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:17576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:17600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:17616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:17648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:17728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:17736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:17760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.953975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:17792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.953988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.954067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:18352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.954093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:18368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:17920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:17928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:17992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:18376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.954413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.954444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:18392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.072 [2024-10-13 16:53:41.954471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.072 [2024-10-13 16:53:41.954486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:18400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.072 [2024-10-13 16:53:41.954500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:18416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:18424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:18432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:18440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:18456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:18464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:18472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:18488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:18496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:18512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:18520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.954935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:18528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.954977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:18536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.954990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:18544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:18552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:18568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:18584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:18600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:18608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:18616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:18648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.073 [2024-10-13 16:53:41.955381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:18656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.073 [2024-10-13 16:53:41.955419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.073 [2024-10-13 16:53:41.955434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:18664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:18672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:18704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:18720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:18752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:18760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:18776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.955841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:18808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.955976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:18816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.955989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.956020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:18832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.956048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:18840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:18848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:23.074 [2024-10-13 16:53:41.956103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:18856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:18104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:18112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.074 [2024-10-13 16:53:41.956267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956296] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:23.074 [2024-10-13 16:53:41.956310] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:23.074 [2024-10-13 16:53:41.956322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18120 len:8 PRP1 0x0 PRP2 0x0 00:29:23.074 [2024-10-13 16:53:41.956339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956403] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f64c50 was disconnected and freed. reset controller. 00:29:23.074 [2024-10-13 16:53:41.956428] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:29:23.074 [2024-10-13 16:53:41.956460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.074 [2024-10-13 16:53:41.956483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.074 [2024-10-13 16:53:41.956511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.074 [2024-10-13 16:53:41.956537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.074 [2024-10-13 16:53:41.956563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.074 [2024-10-13 16:53:41.956575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:23.074 [2024-10-13 16:53:41.958596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:23.074 [2024-10-13 16:53:41.958633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f43600 (9): Bad file descriptor 00:29:23.074 [2024-10-13 16:53:41.991426] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:23.074 00:29:23.075 Latency(us) 00:29:23.075 [2024-10-13T14:53:48.576Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.075 [2024-10-13T14:53:48.576Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:23.075 Verification LBA range: start 0x0 length 0x4000 00:29:23.075 NVMe0n1 : 15.01 12769.87 49.88 991.91 0.00 9284.64 615.92 14466.47 00:29:23.075 [2024-10-13T14:53:48.576Z] =================================================================================================================== 00:29:23.075 [2024-10-13T14:53:48.576Z] Total : 12769.87 49.88 991.91 0.00 9284.64 615.92 14466.47 00:29:23.075 Received shutdown signal, test time was about 15.000000 seconds 00:29:23.075 00:29:23.075 Latency(us) 00:29:23.075 [2024-10-13T14:53:48.576Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.075 [2024-10-13T14:53:48.576Z] =================================================================================================================== 00:29:23.075 [2024-10-13T14:53:48.576Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.075 16:53:47 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:29:23.075 16:53:47 -- host/failover.sh@65 -- # count=3 00:29:23.075 16:53:47 -- host/failover.sh@67 -- # (( count != 3 )) 00:29:23.075 16:53:47 -- host/failover.sh@73 -- # bdevperf_pid=1310064 00:29:23.075 16:53:47 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:29:23.075 16:53:47 -- host/failover.sh@75 -- # waitforlisten 1310064 /var/tmp/bdevperf.sock 00:29:23.075 16:53:47 -- common/autotest_common.sh@819 -- # '[' -z 1310064 ']' 00:29:23.075 16:53:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:29:23.075 16:53:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:23.075 16:53:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:29:23.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:29:23.075 16:53:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:23.075 16:53:47 -- common/autotest_common.sh@10 -- # set +x 00:29:23.393 16:53:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:23.393 16:53:48 -- common/autotest_common.sh@852 -- # return 0 00:29:23.393 16:53:48 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:23.650 [2024-10-13 16:53:48.998940] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:23.650 16:53:49 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:23.907 [2024-10-13 16:53:49.243644] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:23.907 16:53:49 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:24.165 NVMe0n1 00:29:24.165 16:53:49 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:24.730 00:29:24.730 16:53:49 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:24.988 00:29:24.988 16:53:50 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:24.988 16:53:50 -- host/failover.sh@82 -- # grep -q NVMe0 00:29:25.245 16:53:50 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:25.503 16:53:50 -- host/failover.sh@87 -- # sleep 3 00:29:28.780 16:53:53 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:28.780 16:53:53 -- host/failover.sh@88 -- # grep -q NVMe0 00:29:28.780 16:53:54 -- host/failover.sh@90 -- # run_test_pid=1310766 00:29:28.780 16:53:54 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:28.780 16:53:54 -- host/failover.sh@92 -- # wait 1310766 00:29:30.151 0 00:29:30.151 16:53:55 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:30.151 [2024-10-13 16:53:47.783936] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:30.151 [2024-10-13 16:53:47.784023] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1310064 ] 00:29:30.151 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.151 [2024-10-13 16:53:47.842431] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:30.151 [2024-10-13 16:53:47.924081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:30.151 [2024-10-13 16:53:50.798674] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:30.151 [2024-10-13 16:53:50.798761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:30.151 [2024-10-13 16:53:50.798784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.151 [2024-10-13 16:53:50.798801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:30.151 [2024-10-13 16:53:50.798814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.151 [2024-10-13 16:53:50.798828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:30.151 [2024-10-13 16:53:50.798841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.151 [2024-10-13 16:53:50.798854] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:30.151 [2024-10-13 16:53:50.798867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.151 [2024-10-13 16:53:50.798891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:30.151 [2024-10-13 16:53:50.798926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:30.151 [2024-10-13 16:53:50.798956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ab600 (9): Bad file descriptor 00:29:30.151 [2024-10-13 16:53:50.843591] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:30.151 Running I/O for 1 seconds... 00:29:30.151 00:29:30.151 Latency(us) 00:29:30.151 [2024-10-13T14:53:55.652Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:30.151 [2024-10-13T14:53:55.653Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:30.152 Verification LBA range: start 0x0 length 0x4000 00:29:30.152 NVMe0n1 : 1.01 12976.13 50.69 0.00 0.00 9820.50 1262.17 16214.09 00:29:30.152 [2024-10-13T14:53:55.653Z] =================================================================================================================== 00:29:30.152 [2024-10-13T14:53:55.653Z] Total : 12976.13 50.69 0.00 0.00 9820.50 1262.17 16214.09 00:29:30.152 16:53:55 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:30.152 16:53:55 -- host/failover.sh@95 -- # grep -q NVMe0 00:29:30.152 16:53:55 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:30.409 16:53:55 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:30.409 16:53:55 -- host/failover.sh@99 -- # grep -q NVMe0 00:29:30.667 16:53:56 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:30.924 16:53:56 -- host/failover.sh@101 -- # sleep 3 00:29:34.201 16:53:59 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:34.201 16:53:59 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:34.201 16:53:59 -- host/failover.sh@108 -- # killprocess 1310064 00:29:34.201 16:53:59 -- common/autotest_common.sh@926 -- # '[' -z 1310064 ']' 00:29:34.201 16:53:59 -- common/autotest_common.sh@930 -- # kill -0 1310064 00:29:34.201 16:53:59 -- common/autotest_common.sh@931 -- # uname 00:29:34.201 16:53:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:34.201 16:53:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1310064 00:29:34.201 16:53:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:34.201 16:53:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:34.201 16:53:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1310064' 00:29:34.201 killing process with pid 1310064 00:29:34.201 16:53:59 -- common/autotest_common.sh@945 -- # kill 1310064 00:29:34.201 16:53:59 -- common/autotest_common.sh@950 -- # wait 1310064 00:29:34.459 16:53:59 -- host/failover.sh@110 -- # sync 00:29:34.459 16:53:59 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:34.716 16:54:00 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:34.716 16:54:00 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:34.716 16:54:00 -- host/failover.sh@116 -- # nvmftestfini 00:29:34.716 16:54:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:34.716 16:54:00 -- nvmf/common.sh@116 -- # sync 00:29:34.716 16:54:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:34.716 16:54:00 -- nvmf/common.sh@119 -- # set +e 00:29:34.716 16:54:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:34.716 16:54:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:34.716 rmmod nvme_tcp 00:29:34.716 rmmod nvme_fabrics 00:29:34.974 rmmod nvme_keyring 00:29:34.974 16:54:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:34.974 16:54:00 -- nvmf/common.sh@123 -- # set -e 00:29:34.974 16:54:00 -- nvmf/common.sh@124 -- # return 0 00:29:34.974 16:54:00 -- nvmf/common.sh@477 -- # '[' -n 1307586 ']' 00:29:34.974 16:54:00 -- nvmf/common.sh@478 -- # killprocess 1307586 00:29:34.974 16:54:00 -- common/autotest_common.sh@926 -- # '[' -z 1307586 ']' 00:29:34.974 16:54:00 -- common/autotest_common.sh@930 -- # kill -0 1307586 00:29:34.974 16:54:00 -- common/autotest_common.sh@931 -- # uname 00:29:34.974 16:54:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:34.974 16:54:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1307586 00:29:34.974 16:54:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:34.974 16:54:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:34.974 16:54:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1307586' 00:29:34.974 killing process with pid 1307586 00:29:34.974 16:54:00 -- common/autotest_common.sh@945 -- # kill 1307586 00:29:34.974 16:54:00 -- common/autotest_common.sh@950 -- # wait 1307586 00:29:35.233 16:54:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:35.233 16:54:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:35.233 16:54:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:35.233 16:54:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:35.233 16:54:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:35.233 16:54:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:35.233 16:54:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:35.233 16:54:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:37.133 16:54:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:37.133 00:29:37.133 real 0m37.218s 00:29:37.133 user 2m12.334s 00:29:37.133 sys 0m5.948s 00:29:37.133 16:54:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:37.133 16:54:02 -- common/autotest_common.sh@10 -- # set +x 00:29:37.133 ************************************ 00:29:37.133 END TEST nvmf_failover 00:29:37.133 ************************************ 00:29:37.133 16:54:02 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:37.133 16:54:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:37.133 16:54:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:37.133 16:54:02 -- common/autotest_common.sh@10 -- # set +x 00:29:37.133 ************************************ 00:29:37.133 START TEST nvmf_discovery 00:29:37.133 ************************************ 00:29:37.133 16:54:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:37.133 * Looking for test storage... 00:29:37.133 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:37.133 16:54:02 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:37.133 16:54:02 -- nvmf/common.sh@7 -- # uname -s 00:29:37.391 16:54:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:37.391 16:54:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:37.391 16:54:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:37.391 16:54:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:37.391 16:54:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:37.391 16:54:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:37.391 16:54:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:37.391 16:54:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:37.391 16:54:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:37.391 16:54:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:37.391 16:54:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:37.391 16:54:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:37.391 16:54:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:37.391 16:54:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:37.391 16:54:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:37.391 16:54:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:37.391 16:54:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:37.391 16:54:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:37.391 16:54:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:37.391 16:54:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:37.392 16:54:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:37.392 16:54:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:37.392 16:54:02 -- paths/export.sh@5 -- # export PATH 00:29:37.392 16:54:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:37.392 16:54:02 -- nvmf/common.sh@46 -- # : 0 00:29:37.392 16:54:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:37.392 16:54:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:37.392 16:54:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:37.392 16:54:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:37.392 16:54:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:37.392 16:54:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:37.392 16:54:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:37.392 16:54:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:37.392 16:54:02 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:37.392 16:54:02 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:37.392 16:54:02 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:37.392 16:54:02 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:37.392 16:54:02 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:37.392 16:54:02 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:37.392 16:54:02 -- host/discovery.sh@25 -- # nvmftestinit 00:29:37.392 16:54:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:37.392 16:54:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:37.392 16:54:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:37.392 16:54:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:37.392 16:54:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:37.392 16:54:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:37.392 16:54:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:37.392 16:54:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:37.392 16:54:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:37.392 16:54:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:37.392 16:54:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:37.392 16:54:02 -- common/autotest_common.sh@10 -- # set +x 00:29:39.292 16:54:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:39.292 16:54:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:39.292 16:54:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:39.292 16:54:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:39.293 16:54:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:39.293 16:54:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:39.293 16:54:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:39.293 16:54:04 -- nvmf/common.sh@294 -- # net_devs=() 00:29:39.293 16:54:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:39.293 16:54:04 -- nvmf/common.sh@295 -- # e810=() 00:29:39.293 16:54:04 -- nvmf/common.sh@295 -- # local -ga e810 00:29:39.293 16:54:04 -- nvmf/common.sh@296 -- # x722=() 00:29:39.293 16:54:04 -- nvmf/common.sh@296 -- # local -ga x722 00:29:39.293 16:54:04 -- nvmf/common.sh@297 -- # mlx=() 00:29:39.293 16:54:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:39.293 16:54:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:39.293 16:54:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:39.293 16:54:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:39.293 16:54:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:39.293 16:54:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:39.293 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:39.293 16:54:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:39.293 16:54:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:39.293 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:39.293 16:54:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:39.293 16:54:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:39.293 16:54:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:39.293 16:54:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:39.293 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:39.293 16:54:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:39.293 16:54:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:39.293 16:54:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:39.293 16:54:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:39.293 16:54:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:39.293 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:39.293 16:54:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:39.293 16:54:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:39.293 16:54:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:39.293 16:54:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:39.293 16:54:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:39.293 16:54:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:39.293 16:54:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:39.293 16:54:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:39.293 16:54:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:39.293 16:54:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:39.293 16:54:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:39.293 16:54:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:39.293 16:54:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:39.293 16:54:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:39.293 16:54:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:39.293 16:54:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:39.293 16:54:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:39.293 16:54:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:39.293 16:54:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:39.293 16:54:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:39.293 16:54:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:39.552 16:54:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:39.552 16:54:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:39.552 16:54:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:39.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:39.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:29:39.552 00:29:39.552 --- 10.0.0.2 ping statistics --- 00:29:39.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:39.552 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:29:39.552 16:54:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:39.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:39.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:29:39.552 00:29:39.552 --- 10.0.0.1 ping statistics --- 00:29:39.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:39.552 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:29:39.552 16:54:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:39.552 16:54:04 -- nvmf/common.sh@410 -- # return 0 00:29:39.552 16:54:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:39.552 16:54:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:39.552 16:54:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:39.552 16:54:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:39.552 16:54:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:39.552 16:54:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:39.552 16:54:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:39.552 16:54:04 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:39.552 16:54:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:39.552 16:54:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:39.552 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:29:39.552 16:54:04 -- nvmf/common.sh@469 -- # nvmfpid=1313630 00:29:39.552 16:54:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:39.552 16:54:04 -- nvmf/common.sh@470 -- # waitforlisten 1313630 00:29:39.552 16:54:04 -- common/autotest_common.sh@819 -- # '[' -z 1313630 ']' 00:29:39.552 16:54:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:39.552 16:54:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:39.552 16:54:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:39.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:39.552 16:54:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:39.552 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:29:39.552 [2024-10-13 16:54:04.937982] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:39.552 [2024-10-13 16:54:04.938076] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:39.552 EAL: No free 2048 kB hugepages reported on node 1 00:29:39.552 [2024-10-13 16:54:05.011795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:39.810 [2024-10-13 16:54:05.109370] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:39.810 [2024-10-13 16:54:05.109565] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:39.810 [2024-10-13 16:54:05.109583] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:39.810 [2024-10-13 16:54:05.109597] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:39.810 [2024-10-13 16:54:05.109627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:40.744 16:54:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:40.744 16:54:05 -- common/autotest_common.sh@852 -- # return 0 00:29:40.744 16:54:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:40.744 16:54:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:40.744 16:54:05 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 16:54:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:40.744 16:54:06 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:40.744 16:54:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 [2024-10-13 16:54:06.008509] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:40.744 16:54:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.744 16:54:06 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:40.744 16:54:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 [2024-10-13 16:54:06.016705] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:40.744 16:54:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.744 16:54:06 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:40.744 16:54:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 null0 00:29:40.744 16:54:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.744 16:54:06 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:40.744 16:54:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 null1 00:29:40.744 16:54:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.744 16:54:06 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:40.744 16:54:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 16:54:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.744 16:54:06 -- host/discovery.sh@45 -- # hostpid=1313785 00:29:40.744 16:54:06 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:40.744 16:54:06 -- host/discovery.sh@46 -- # waitforlisten 1313785 /tmp/host.sock 00:29:40.744 16:54:06 -- common/autotest_common.sh@819 -- # '[' -z 1313785 ']' 00:29:40.744 16:54:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:29:40.744 16:54:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:40.744 16:54:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:40.744 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:40.744 16:54:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:40.744 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.744 [2024-10-13 16:54:06.088849] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:40.744 [2024-10-13 16:54:06.088923] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1313785 ] 00:29:40.744 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.744 [2024-10-13 16:54:06.153314] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.744 [2024-10-13 16:54:06.241545] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:40.744 [2024-10-13 16:54:06.241719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:41.677 16:54:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:41.677 16:54:07 -- common/autotest_common.sh@852 -- # return 0 00:29:41.677 16:54:07 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:41.677 16:54:07 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.677 16:54:07 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.677 16:54:07 -- host/discovery.sh@72 -- # notify_id=0 00:29:41.677 16:54:07 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # sort 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # xargs 00:29:41.677 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.677 16:54:07 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:41.677 16:54:07 -- host/discovery.sh@79 -- # get_bdev_list 00:29:41.677 16:54:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.677 16:54:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- host/discovery.sh@55 -- # sort 00:29:41.677 16:54:07 -- host/discovery.sh@55 -- # xargs 00:29:41.677 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.677 16:54:07 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:41.677 16:54:07 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.677 16:54:07 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:41.677 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.677 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # sort 00:29:41.677 16:54:07 -- host/discovery.sh@59 -- # xargs 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:41.935 16:54:07 -- host/discovery.sh@83 -- # get_bdev_list 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # sort 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # xargs 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:41.935 16:54:07 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # sort 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # xargs 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:41.935 16:54:07 -- host/discovery.sh@87 -- # get_bdev_list 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # sort 00:29:41.935 16:54:07 -- host/discovery.sh@55 -- # xargs 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:41.935 16:54:07 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 [2024-10-13 16:54:07.344458] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:41.935 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # sort 00:29:41.935 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.935 16:54:07 -- host/discovery.sh@59 -- # xargs 00:29:41.935 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.935 16:54:07 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:41.935 16:54:07 -- host/discovery.sh@93 -- # get_bdev_list 00:29:41.936 16:54:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.936 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.936 16:54:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:41.936 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:41.936 16:54:07 -- host/discovery.sh@55 -- # sort 00:29:41.936 16:54:07 -- host/discovery.sh@55 -- # xargs 00:29:41.936 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.936 16:54:07 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:41.936 16:54:07 -- host/discovery.sh@94 -- # get_notification_count 00:29:41.936 16:54:07 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:41.936 16:54:07 -- host/discovery.sh@74 -- # jq '. | length' 00:29:41.936 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.936 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:42.193 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.193 16:54:07 -- host/discovery.sh@74 -- # notification_count=0 00:29:42.193 16:54:07 -- host/discovery.sh@75 -- # notify_id=0 00:29:42.193 16:54:07 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:42.193 16:54:07 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:42.193 16:54:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.193 16:54:07 -- common/autotest_common.sh@10 -- # set +x 00:29:42.193 16:54:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.193 16:54:07 -- host/discovery.sh@100 -- # sleep 1 00:29:42.758 [2024-10-13 16:54:08.127540] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:42.758 [2024-10-13 16:54:08.127571] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:42.758 [2024-10-13 16:54:08.127594] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:42.758 [2024-10-13 16:54:08.213885] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:43.016 [2024-10-13 16:54:08.311626] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:43.016 [2024-10-13 16:54:08.311651] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:43.016 16:54:08 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:43.016 16:54:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:43.016 16:54:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.016 16:54:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:43.016 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:29:43.016 16:54:08 -- host/discovery.sh@59 -- # sort 00:29:43.016 16:54:08 -- host/discovery.sh@59 -- # xargs 00:29:43.016 16:54:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@102 -- # get_bdev_list 00:29:43.273 16:54:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:43.273 16:54:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.273 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:29:43.273 16:54:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:43.273 16:54:08 -- host/discovery.sh@55 -- # sort 00:29:43.273 16:54:08 -- host/discovery.sh@55 -- # xargs 00:29:43.273 16:54:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:43.273 16:54:08 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:43.273 16:54:08 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:43.273 16:54:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.273 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:29:43.273 16:54:08 -- host/discovery.sh@63 -- # sort -n 00:29:43.273 16:54:08 -- host/discovery.sh@63 -- # xargs 00:29:43.273 16:54:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@104 -- # get_notification_count 00:29:43.273 16:54:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:43.273 16:54:08 -- host/discovery.sh@74 -- # jq '. | length' 00:29:43.273 16:54:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.273 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:29:43.273 16:54:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@74 -- # notification_count=1 00:29:43.273 16:54:08 -- host/discovery.sh@75 -- # notify_id=1 00:29:43.273 16:54:08 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:43.273 16:54:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.273 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:29:43.273 16:54:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.273 16:54:08 -- host/discovery.sh@109 -- # sleep 1 00:29:44.206 16:54:09 -- host/discovery.sh@110 -- # get_bdev_list 00:29:44.206 16:54:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:44.206 16:54:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:44.206 16:54:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.206 16:54:09 -- host/discovery.sh@55 -- # sort 00:29:44.206 16:54:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.206 16:54:09 -- host/discovery.sh@55 -- # xargs 00:29:44.206 16:54:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.206 16:54:09 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:44.206 16:54:09 -- host/discovery.sh@111 -- # get_notification_count 00:29:44.206 16:54:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:44.206 16:54:09 -- host/discovery.sh@74 -- # jq '. | length' 00:29:44.206 16:54:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.206 16:54:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.464 16:54:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.464 16:54:09 -- host/discovery.sh@74 -- # notification_count=1 00:29:44.464 16:54:09 -- host/discovery.sh@75 -- # notify_id=2 00:29:44.464 16:54:09 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:44.464 16:54:09 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:44.464 16:54:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.464 16:54:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.464 [2024-10-13 16:54:09.739528] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:44.464 [2024-10-13 16:54:09.740724] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:44.464 [2024-10-13 16:54:09.740777] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:44.464 16:54:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.464 16:54:09 -- host/discovery.sh@117 -- # sleep 1 00:29:44.464 [2024-10-13 16:54:09.867113] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:44.722 [2024-10-13 16:54:10.127616] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:44.722 [2024-10-13 16:54:10.127663] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:44.722 [2024-10-13 16:54:10.127673] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:45.287 16:54:10 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:45.287 16:54:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:45.287 16:54:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:45.287 16:54:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:45.287 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:45.287 16:54:10 -- host/discovery.sh@59 -- # sort 00:29:45.287 16:54:10 -- host/discovery.sh@59 -- # xargs 00:29:45.287 16:54:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:45.545 16:54:10 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:45.545 16:54:10 -- host/discovery.sh@119 -- # get_bdev_list 00:29:45.545 16:54:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:45.545 16:54:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:45.545 16:54:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:45.545 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:45.545 16:54:10 -- host/discovery.sh@55 -- # sort 00:29:45.545 16:54:10 -- host/discovery.sh@55 -- # xargs 00:29:45.545 16:54:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:45.545 16:54:10 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:45.546 16:54:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:45.546 16:54:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:45.546 16:54:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:45.546 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:45.546 16:54:10 -- host/discovery.sh@63 -- # sort -n 00:29:45.546 16:54:10 -- host/discovery.sh@63 -- # xargs 00:29:45.546 16:54:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@121 -- # get_notification_count 00:29:45.546 16:54:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:45.546 16:54:10 -- host/discovery.sh@74 -- # jq '. | length' 00:29:45.546 16:54:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:45.546 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:45.546 16:54:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@74 -- # notification_count=0 00:29:45.546 16:54:10 -- host/discovery.sh@75 -- # notify_id=2 00:29:45.546 16:54:10 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:45.546 16:54:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:45.546 16:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:45.546 [2024-10-13 16:54:10.923093] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:45.546 [2024-10-13 16:54:10.923145] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:45.546 [2024-10-13 16:54:10.925960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:45.546 [2024-10-13 16:54:10.925996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:45.546 [2024-10-13 16:54:10.926016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:45.546 [2024-10-13 16:54:10.926032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:45.546 [2024-10-13 16:54:10.926047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:45.546 [2024-10-13 16:54:10.926062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:45.546 [2024-10-13 16:54:10.926078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:45.546 [2024-10-13 16:54:10.926093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:45.546 [2024-10-13 16:54:10.926108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 16:54:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:45.546 16:54:10 -- host/discovery.sh@127 -- # sleep 1 00:29:45.546 [2024-10-13 16:54:10.935964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.946010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.946258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.946382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.946436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.946465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.946488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.946528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.946556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.946573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.946608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:10.956093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.956251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.956382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.956436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.956453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.956475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.956495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.956508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.956521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.956541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:10.966171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.966354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.966516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.966542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.966558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.966580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.966653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.966676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.966690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.966710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:10.976252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.976413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.976572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.976597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.976613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.976635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.976670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.976689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.976708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.976728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:10.986329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.986542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.986666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.986707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.986726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.986750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.986790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.986812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.986827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.986848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:10.996409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:10.996625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.996801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:10.996828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:10.996845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:10.996869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:10.996907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:10.996928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:10.996943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:10.996964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.546 [2024-10-13 16:54:11.006496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:45.546 [2024-10-13 16:54:11.006651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:11.006765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:45.546 [2024-10-13 16:54:11.006790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x231bb80 with addr=10.0.0.2, port=4420 00:29:45.546 [2024-10-13 16:54:11.006806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231bb80 is same with the state(5) to be set 00:29:45.546 [2024-10-13 16:54:11.006827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231bb80 (9): Bad file descriptor 00:29:45.546 [2024-10-13 16:54:11.006847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:45.546 [2024-10-13 16:54:11.006875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:45.546 [2024-10-13 16:54:11.006890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:45.546 [2024-10-13 16:54:11.006911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:45.547 [2024-10-13 16:54:11.008950] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:45.547 [2024-10-13 16:54:11.008982] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:46.479 16:54:11 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:46.479 16:54:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:46.479 16:54:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:46.479 16:54:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:46.479 16:54:11 -- common/autotest_common.sh@10 -- # set +x 00:29:46.479 16:54:11 -- host/discovery.sh@59 -- # sort 00:29:46.479 16:54:11 -- host/discovery.sh@59 -- # xargs 00:29:46.479 16:54:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:46.479 16:54:11 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:46.479 16:54:11 -- host/discovery.sh@129 -- # get_bdev_list 00:29:46.479 16:54:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:46.479 16:54:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:46.479 16:54:11 -- common/autotest_common.sh@10 -- # set +x 00:29:46.479 16:54:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:46.479 16:54:11 -- host/discovery.sh@55 -- # sort 00:29:46.479 16:54:11 -- host/discovery.sh@55 -- # xargs 00:29:46.737 16:54:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:46.737 16:54:12 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:46.737 16:54:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:46.737 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:29:46.737 16:54:12 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:46.737 16:54:12 -- host/discovery.sh@63 -- # sort -n 00:29:46.737 16:54:12 -- host/discovery.sh@63 -- # xargs 00:29:46.737 16:54:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@131 -- # get_notification_count 00:29:46.737 16:54:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:46.737 16:54:12 -- host/discovery.sh@74 -- # jq '. | length' 00:29:46.737 16:54:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:46.737 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:29:46.737 16:54:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@74 -- # notification_count=0 00:29:46.737 16:54:12 -- host/discovery.sh@75 -- # notify_id=2 00:29:46.737 16:54:12 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:46.737 16:54:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:46.737 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:29:46.737 16:54:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:46.737 16:54:12 -- host/discovery.sh@135 -- # sleep 1 00:29:47.678 16:54:13 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:47.678 16:54:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:47.678 16:54:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:47.678 16:54:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:47.678 16:54:13 -- common/autotest_common.sh@10 -- # set +x 00:29:47.678 16:54:13 -- host/discovery.sh@59 -- # sort 00:29:47.678 16:54:13 -- host/discovery.sh@59 -- # xargs 00:29:47.678 16:54:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:47.678 16:54:13 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:47.678 16:54:13 -- host/discovery.sh@137 -- # get_bdev_list 00:29:47.678 16:54:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:47.678 16:54:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:47.678 16:54:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:47.678 16:54:13 -- common/autotest_common.sh@10 -- # set +x 00:29:47.678 16:54:13 -- host/discovery.sh@55 -- # sort 00:29:47.678 16:54:13 -- host/discovery.sh@55 -- # xargs 00:29:47.679 16:54:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:47.936 16:54:13 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:47.936 16:54:13 -- host/discovery.sh@138 -- # get_notification_count 00:29:47.936 16:54:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:47.936 16:54:13 -- host/discovery.sh@74 -- # jq '. | length' 00:29:47.936 16:54:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:47.936 16:54:13 -- common/autotest_common.sh@10 -- # set +x 00:29:47.936 16:54:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:47.936 16:54:13 -- host/discovery.sh@74 -- # notification_count=2 00:29:47.936 16:54:13 -- host/discovery.sh@75 -- # notify_id=4 00:29:47.936 16:54:13 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:47.936 16:54:13 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:47.936 16:54:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:47.936 16:54:13 -- common/autotest_common.sh@10 -- # set +x 00:29:48.869 [2024-10-13 16:54:14.233457] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:48.869 [2024-10-13 16:54:14.233482] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:48.869 [2024-10-13 16:54:14.233503] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:48.869 [2024-10-13 16:54:14.320837] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:49.434 [2024-10-13 16:54:14.629739] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:49.435 [2024-10-13 16:54:14.629778] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@640 -- # local es=0 00:29:49.435 16:54:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 request: 00:29:49.435 { 00:29:49.435 "name": "nvme", 00:29:49.435 "trtype": "tcp", 00:29:49.435 "traddr": "10.0.0.2", 00:29:49.435 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:49.435 "adrfam": "ipv4", 00:29:49.435 "trsvcid": "8009", 00:29:49.435 "wait_for_attach": true, 00:29:49.435 "method": "bdev_nvme_start_discovery", 00:29:49.435 "req_id": 1 00:29:49.435 } 00:29:49.435 Got JSON-RPC error response 00:29:49.435 response: 00:29:49.435 { 00:29:49.435 "code": -17, 00:29:49.435 "message": "File exists" 00:29:49.435 } 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:49.435 16:54:14 -- common/autotest_common.sh@643 -- # es=1 00:29:49.435 16:54:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:49.435 16:54:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:49.435 16:54:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:49.435 16:54:14 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # sort 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # xargs 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:49.435 16:54:14 -- host/discovery.sh@147 -- # get_bdev_list 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # sort 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # xargs 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@640 -- # local es=0 00:29:49.435 16:54:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 request: 00:29:49.435 { 00:29:49.435 "name": "nvme_second", 00:29:49.435 "trtype": "tcp", 00:29:49.435 "traddr": "10.0.0.2", 00:29:49.435 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:49.435 "adrfam": "ipv4", 00:29:49.435 "trsvcid": "8009", 00:29:49.435 "wait_for_attach": true, 00:29:49.435 "method": "bdev_nvme_start_discovery", 00:29:49.435 "req_id": 1 00:29:49.435 } 00:29:49.435 Got JSON-RPC error response 00:29:49.435 response: 00:29:49.435 { 00:29:49.435 "code": -17, 00:29:49.435 "message": "File exists" 00:29:49.435 } 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:49.435 16:54:14 -- common/autotest_common.sh@643 -- # es=1 00:29:49.435 16:54:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:49.435 16:54:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:49.435 16:54:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:49.435 16:54:14 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # sort 00:29:49.435 16:54:14 -- host/discovery.sh@67 -- # xargs 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:49.435 16:54:14 -- host/discovery.sh@153 -- # get_bdev_list 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # sort 00:29:49.435 16:54:14 -- host/discovery.sh@55 -- # xargs 00:29:49.435 16:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:49.435 16:54:14 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:49.435 16:54:14 -- common/autotest_common.sh@640 -- # local es=0 00:29:49.435 16:54:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:49.435 16:54:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:49.435 16:54:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:49.435 16:54:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:49.435 16:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:49.435 16:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:50.368 [2024-10-13 16:54:15.825089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.368 [2024-10-13 16:54:15.825216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.368 [2024-10-13 16:54:15.825258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23533c0 with addr=10.0.0.2, port=8010 00:29:50.368 [2024-10-13 16:54:15.825280] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:50.368 [2024-10-13 16:54:15.825309] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:50.368 [2024-10-13 16:54:15.825324] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:51.748 [2024-10-13 16:54:16.827500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.748 [2024-10-13 16:54:16.827609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.748 [2024-10-13 16:54:16.827634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23533c0 with addr=10.0.0.2, port=8010 00:29:51.748 [2024-10-13 16:54:16.827653] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:51.748 [2024-10-13 16:54:16.827666] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:51.748 [2024-10-13 16:54:16.827678] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:52.409 [2024-10-13 16:54:17.829779] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:52.409 request: 00:29:52.409 { 00:29:52.409 "name": "nvme_second", 00:29:52.409 "trtype": "tcp", 00:29:52.409 "traddr": "10.0.0.2", 00:29:52.409 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:52.409 "adrfam": "ipv4", 00:29:52.409 "trsvcid": "8010", 00:29:52.409 "attach_timeout_ms": 3000, 00:29:52.409 "method": "bdev_nvme_start_discovery", 00:29:52.409 "req_id": 1 00:29:52.409 } 00:29:52.409 Got JSON-RPC error response 00:29:52.409 response: 00:29:52.409 { 00:29:52.409 "code": -110, 00:29:52.409 "message": "Connection timed out" 00:29:52.409 } 00:29:52.409 16:54:17 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:52.410 16:54:17 -- common/autotest_common.sh@643 -- # es=1 00:29:52.410 16:54:17 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:52.410 16:54:17 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:52.410 16:54:17 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:52.410 16:54:17 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:52.410 16:54:17 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:52.410 16:54:17 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:52.410 16:54:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:52.410 16:54:17 -- host/discovery.sh@67 -- # sort 00:29:52.410 16:54:17 -- common/autotest_common.sh@10 -- # set +x 00:29:52.410 16:54:17 -- host/discovery.sh@67 -- # xargs 00:29:52.410 16:54:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:52.410 16:54:17 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:52.410 16:54:17 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:52.410 16:54:17 -- host/discovery.sh@162 -- # kill 1313785 00:29:52.410 16:54:17 -- host/discovery.sh@163 -- # nvmftestfini 00:29:52.410 16:54:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:52.410 16:54:17 -- nvmf/common.sh@116 -- # sync 00:29:52.410 16:54:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:52.410 16:54:17 -- nvmf/common.sh@119 -- # set +e 00:29:52.410 16:54:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:52.410 16:54:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:52.410 rmmod nvme_tcp 00:29:52.410 rmmod nvme_fabrics 00:29:52.667 rmmod nvme_keyring 00:29:52.667 16:54:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:52.667 16:54:17 -- nvmf/common.sh@123 -- # set -e 00:29:52.667 16:54:17 -- nvmf/common.sh@124 -- # return 0 00:29:52.667 16:54:17 -- nvmf/common.sh@477 -- # '[' -n 1313630 ']' 00:29:52.667 16:54:17 -- nvmf/common.sh@478 -- # killprocess 1313630 00:29:52.667 16:54:17 -- common/autotest_common.sh@926 -- # '[' -z 1313630 ']' 00:29:52.667 16:54:17 -- common/autotest_common.sh@930 -- # kill -0 1313630 00:29:52.667 16:54:17 -- common/autotest_common.sh@931 -- # uname 00:29:52.667 16:54:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:52.667 16:54:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1313630 00:29:52.667 16:54:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:52.667 16:54:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:52.667 16:54:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1313630' 00:29:52.667 killing process with pid 1313630 00:29:52.667 16:54:17 -- common/autotest_common.sh@945 -- # kill 1313630 00:29:52.667 16:54:17 -- common/autotest_common.sh@950 -- # wait 1313630 00:29:52.925 16:54:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:52.925 16:54:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:52.925 16:54:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:52.925 16:54:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:52.925 16:54:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:52.925 16:54:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.925 16:54:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:52.925 16:54:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:54.829 16:54:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:54.829 00:29:54.829 real 0m17.679s 00:29:54.829 user 0m27.396s 00:29:54.829 sys 0m2.916s 00:29:54.829 16:54:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:54.829 16:54:20 -- common/autotest_common.sh@10 -- # set +x 00:29:54.829 ************************************ 00:29:54.829 END TEST nvmf_discovery 00:29:54.829 ************************************ 00:29:54.829 16:54:20 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:54.829 16:54:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:54.829 16:54:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:54.829 16:54:20 -- common/autotest_common.sh@10 -- # set +x 00:29:54.829 ************************************ 00:29:54.829 START TEST nvmf_discovery_remove_ifc 00:29:54.829 ************************************ 00:29:54.829 16:54:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:55.087 * Looking for test storage... 00:29:55.087 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:55.087 16:54:20 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:55.087 16:54:20 -- nvmf/common.sh@7 -- # uname -s 00:29:55.087 16:54:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:55.087 16:54:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:55.087 16:54:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:55.087 16:54:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:55.087 16:54:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:55.087 16:54:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:55.087 16:54:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:55.087 16:54:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:55.087 16:54:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:55.087 16:54:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:55.087 16:54:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.087 16:54:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.087 16:54:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:55.087 16:54:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:55.087 16:54:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:55.087 16:54:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:55.087 16:54:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:55.087 16:54:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:55.087 16:54:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:55.087 16:54:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.088 16:54:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.088 16:54:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.088 16:54:20 -- paths/export.sh@5 -- # export PATH 00:29:55.088 16:54:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.088 16:54:20 -- nvmf/common.sh@46 -- # : 0 00:29:55.088 16:54:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:55.088 16:54:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:55.088 16:54:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:55.088 16:54:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:55.088 16:54:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:55.088 16:54:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:55.088 16:54:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:55.088 16:54:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:55.088 16:54:20 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:55.088 16:54:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:55.088 16:54:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:55.088 16:54:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:55.088 16:54:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:55.088 16:54:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:55.088 16:54:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:55.088 16:54:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:55.088 16:54:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.088 16:54:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:55.088 16:54:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:55.088 16:54:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:55.088 16:54:20 -- common/autotest_common.sh@10 -- # set +x 00:29:56.987 16:54:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:56.987 16:54:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:56.987 16:54:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:56.987 16:54:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:56.987 16:54:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:56.987 16:54:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:56.987 16:54:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:56.987 16:54:22 -- nvmf/common.sh@294 -- # net_devs=() 00:29:56.987 16:54:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:56.987 16:54:22 -- nvmf/common.sh@295 -- # e810=() 00:29:56.987 16:54:22 -- nvmf/common.sh@295 -- # local -ga e810 00:29:56.987 16:54:22 -- nvmf/common.sh@296 -- # x722=() 00:29:56.987 16:54:22 -- nvmf/common.sh@296 -- # local -ga x722 00:29:56.987 16:54:22 -- nvmf/common.sh@297 -- # mlx=() 00:29:56.987 16:54:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:56.987 16:54:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:56.987 16:54:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.988 16:54:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:56.988 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:56.988 16:54:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.988 16:54:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:56.988 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:56.988 16:54:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.988 16:54:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.988 16:54:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.988 16:54:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:56.988 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:56.988 16:54:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.988 16:54:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.988 16:54:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.988 16:54:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:56.988 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:56.988 16:54:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:56.988 16:54:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:56.988 16:54:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:56.988 16:54:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:56.988 16:54:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:56.988 16:54:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:56.988 16:54:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:56.988 16:54:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:56.988 16:54:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:56.988 16:54:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:56.988 16:54:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:56.988 16:54:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:56.988 16:54:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:56.988 16:54:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:56.988 16:54:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:56.988 16:54:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:56.988 16:54:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:56.988 16:54:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:56.988 16:54:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:56.988 16:54:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:56.988 16:54:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:56.988 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:56.988 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:29:56.988 00:29:56.988 --- 10.0.0.2 ping statistics --- 00:29:56.988 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.988 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:29:56.988 16:54:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:56.988 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:56.988 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:29:56.988 00:29:56.988 --- 10.0.0.1 ping statistics --- 00:29:56.988 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.988 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:29:56.988 16:54:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:56.988 16:54:22 -- nvmf/common.sh@410 -- # return 0 00:29:56.988 16:54:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:56.988 16:54:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:56.988 16:54:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:56.988 16:54:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:56.988 16:54:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:56.988 16:54:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:56.988 16:54:22 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:56.988 16:54:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:56.988 16:54:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:56.988 16:54:22 -- common/autotest_common.sh@10 -- # set +x 00:29:56.988 16:54:22 -- nvmf/common.sh@469 -- # nvmfpid=1317760 00:29:56.988 16:54:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:56.988 16:54:22 -- nvmf/common.sh@470 -- # waitforlisten 1317760 00:29:56.988 16:54:22 -- common/autotest_common.sh@819 -- # '[' -z 1317760 ']' 00:29:56.988 16:54:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:56.988 16:54:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:56.988 16:54:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:56.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:56.988 16:54:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:56.988 16:54:22 -- common/autotest_common.sh@10 -- # set +x 00:29:57.247 [2024-10-13 16:54:22.530858] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:57.247 [2024-10-13 16:54:22.530936] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:57.247 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.247 [2024-10-13 16:54:22.597884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:57.247 [2024-10-13 16:54:22.683273] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:57.247 [2024-10-13 16:54:22.683459] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:57.247 [2024-10-13 16:54:22.683494] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:57.247 [2024-10-13 16:54:22.683507] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:57.247 [2024-10-13 16:54:22.683546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:58.181 16:54:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:58.181 16:54:23 -- common/autotest_common.sh@852 -- # return 0 00:29:58.181 16:54:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:58.181 16:54:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:58.181 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:58.181 16:54:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:58.181 16:54:23 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:58.181 16:54:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:58.181 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:58.181 [2024-10-13 16:54:23.533912] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:58.181 [2024-10-13 16:54:23.542089] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:58.181 null0 00:29:58.181 [2024-10-13 16:54:23.574048] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:58.181 16:54:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:58.181 16:54:23 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1317918 00:29:58.181 16:54:23 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:58.181 16:54:23 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1317918 /tmp/host.sock 00:29:58.181 16:54:23 -- common/autotest_common.sh@819 -- # '[' -z 1317918 ']' 00:29:58.181 16:54:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:29:58.181 16:54:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:58.181 16:54:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:58.181 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:58.181 16:54:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:58.181 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:58.181 [2024-10-13 16:54:23.636013] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:29:58.181 [2024-10-13 16:54:23.636091] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1317918 ] 00:29:58.181 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.440 [2024-10-13 16:54:23.697222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:58.440 [2024-10-13 16:54:23.787064] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:58.440 [2024-10-13 16:54:23.787251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:58.440 16:54:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:58.440 16:54:23 -- common/autotest_common.sh@852 -- # return 0 00:29:58.440 16:54:23 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:58.440 16:54:23 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:58.440 16:54:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:58.440 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:58.440 16:54:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:58.440 16:54:23 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:58.440 16:54:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:58.440 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:58.697 16:54:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:58.697 16:54:23 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:58.697 16:54:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:58.697 16:54:23 -- common/autotest_common.sh@10 -- # set +x 00:29:59.631 [2024-10-13 16:54:25.001051] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:59.631 [2024-10-13 16:54:25.001083] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:59.631 [2024-10-13 16:54:25.001117] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:59.631 [2024-10-13 16:54:25.089400] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:59.889 [2024-10-13 16:54:25.191928] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:59.889 [2024-10-13 16:54:25.191984] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:59.889 [2024-10-13 16:54:25.192023] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:59.889 [2024-10-13 16:54:25.192051] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:59.889 [2024-10-13 16:54:25.192081] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:59.889 16:54:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:59.889 16:54:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:59.889 16:54:25 -- common/autotest_common.sh@10 -- # set +x 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:59.889 [2024-10-13 16:54:25.199671] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xad54b0 was disconnected and freed. delete nvme_qpair. 00:29:59.889 16:54:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:59.889 16:54:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:59.889 16:54:25 -- common/autotest_common.sh@10 -- # set +x 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:59.889 16:54:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:59.889 16:54:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:01.261 16:54:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:01.262 16:54:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:01.262 16:54:26 -- common/autotest_common.sh@10 -- # set +x 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:01.262 16:54:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:01.262 16:54:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:02.194 16:54:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:02.194 16:54:27 -- common/autotest_common.sh@10 -- # set +x 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:02.194 16:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:02.194 16:54:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:03.126 16:54:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:03.126 16:54:28 -- common/autotest_common.sh@10 -- # set +x 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:03.126 16:54:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:03.126 16:54:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:04.059 16:54:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:04.059 16:54:29 -- common/autotest_common.sh@10 -- # set +x 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:04.059 16:54:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:04.059 16:54:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:05.432 16:54:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:05.432 16:54:30 -- common/autotest_common.sh@10 -- # set +x 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:05.432 16:54:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:05.432 16:54:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:05.432 [2024-10-13 16:54:30.633423] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:30:05.432 [2024-10-13 16:54:30.633506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:05.432 [2024-10-13 16:54:30.633527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:05.432 [2024-10-13 16:54:30.633543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:05.432 [2024-10-13 16:54:30.633556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:05.432 [2024-10-13 16:54:30.633576] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:05.432 [2024-10-13 16:54:30.633588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:05.432 [2024-10-13 16:54:30.633601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:05.432 [2024-10-13 16:54:30.633614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:05.432 [2024-10-13 16:54:30.633627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:30:05.432 [2024-10-13 16:54:30.633639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:05.433 [2024-10-13 16:54:30.633651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa9c790 is same with the state(5) to be set 00:30:05.433 [2024-10-13 16:54:30.643457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa9c790 (9): Bad file descriptor 00:30:05.433 [2024-10-13 16:54:30.653493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:06.364 16:54:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:06.364 16:54:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:06.364 16:54:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:06.364 16:54:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.364 16:54:31 -- common/autotest_common.sh@10 -- # set +x 00:30:06.364 16:54:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:06.364 16:54:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:06.364 [2024-10-13 16:54:31.700458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:30:07.296 [2024-10-13 16:54:32.724436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:30:07.296 [2024-10-13 16:54:32.724519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa9c790 with addr=10.0.0.2, port=4420 00:30:07.296 [2024-10-13 16:54:32.724543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa9c790 is same with the state(5) to be set 00:30:07.297 [2024-10-13 16:54:32.724577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:07.297 [2024-10-13 16:54:32.724593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:07.297 [2024-10-13 16:54:32.724606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:07.297 [2024-10-13 16:54:32.724619] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:30:07.297 [2024-10-13 16:54:32.725054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa9c790 (9): Bad file descriptor 00:30:07.297 [2024-10-13 16:54:32.725098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:07.297 [2024-10-13 16:54:32.725143] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:30:07.297 [2024-10-13 16:54:32.725182] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:07.297 [2024-10-13 16:54:32.725208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:07.297 [2024-10-13 16:54:32.725229] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:07.297 [2024-10-13 16:54:32.725245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:07.297 [2024-10-13 16:54:32.725262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:07.297 [2024-10-13 16:54:32.725278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:07.297 [2024-10-13 16:54:32.725293] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:07.297 [2024-10-13 16:54:32.725308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:07.297 [2024-10-13 16:54:32.725323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:30:07.297 [2024-10-13 16:54:32.725338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:07.297 [2024-10-13 16:54:32.725352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:30:07.297 [2024-10-13 16:54:32.725578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa9bc40 (9): Bad file descriptor 00:30:07.297 [2024-10-13 16:54:32.726596] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:30:07.297 [2024-10-13 16:54:32.726619] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:30:07.297 16:54:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:07.297 16:54:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:07.297 16:54:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:08.249 16:54:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:08.249 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:08.249 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:08.249 16:54:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:08.249 16:54:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.249 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:08.249 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:08.506 16:54:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:08.506 16:54:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:08.506 16:54:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:08.506 16:54:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:30:08.506 16:54:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:09.439 [2024-10-13 16:54:34.777550] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:30:09.439 [2024-10-13 16:54:34.777571] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:30:09.439 [2024-10-13 16:54:34.777592] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:09.439 [2024-10-13 16:54:34.863900] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:30:09.439 [2024-10-13 16:54:34.927676] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:30:09.439 [2024-10-13 16:54:34.927741] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:30:09.439 [2024-10-13 16:54:34.927777] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:30:09.439 [2024-10-13 16:54:34.927801] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:30:09.439 [2024-10-13 16:54:34.927815] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:30:09.439 [2024-10-13 16:54:34.935869] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xab9c20 was disconnected and freed. delete nvme_qpair. 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:09.697 16:54:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:09.697 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:09.697 16:54:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:30:09.697 16:54:34 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1317918 00:30:09.697 16:54:34 -- common/autotest_common.sh@926 -- # '[' -z 1317918 ']' 00:30:09.697 16:54:34 -- common/autotest_common.sh@930 -- # kill -0 1317918 00:30:09.697 16:54:34 -- common/autotest_common.sh@931 -- # uname 00:30:09.697 16:54:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:09.697 16:54:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1317918 00:30:09.697 16:54:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:09.697 16:54:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:09.697 16:54:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1317918' 00:30:09.697 killing process with pid 1317918 00:30:09.697 16:54:35 -- common/autotest_common.sh@945 -- # kill 1317918 00:30:09.697 16:54:35 -- common/autotest_common.sh@950 -- # wait 1317918 00:30:09.955 16:54:35 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:30:09.955 16:54:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:09.955 16:54:35 -- nvmf/common.sh@116 -- # sync 00:30:09.955 16:54:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:09.955 16:54:35 -- nvmf/common.sh@119 -- # set +e 00:30:09.955 16:54:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:09.955 16:54:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:09.955 rmmod nvme_tcp 00:30:09.955 rmmod nvme_fabrics 00:30:09.955 rmmod nvme_keyring 00:30:09.955 16:54:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:09.955 16:54:35 -- nvmf/common.sh@123 -- # set -e 00:30:09.955 16:54:35 -- nvmf/common.sh@124 -- # return 0 00:30:09.955 16:54:35 -- nvmf/common.sh@477 -- # '[' -n 1317760 ']' 00:30:09.955 16:54:35 -- nvmf/common.sh@478 -- # killprocess 1317760 00:30:09.955 16:54:35 -- common/autotest_common.sh@926 -- # '[' -z 1317760 ']' 00:30:09.955 16:54:35 -- common/autotest_common.sh@930 -- # kill -0 1317760 00:30:09.955 16:54:35 -- common/autotest_common.sh@931 -- # uname 00:30:09.955 16:54:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:09.955 16:54:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1317760 00:30:09.955 16:54:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:09.955 16:54:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:09.955 16:54:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1317760' 00:30:09.955 killing process with pid 1317760 00:30:09.955 16:54:35 -- common/autotest_common.sh@945 -- # kill 1317760 00:30:09.955 16:54:35 -- common/autotest_common.sh@950 -- # wait 1317760 00:30:10.214 16:54:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:10.214 16:54:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:10.214 16:54:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:10.214 16:54:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:10.214 16:54:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:10.214 16:54:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:10.214 16:54:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:10.214 16:54:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:12.746 16:54:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:12.746 00:30:12.746 real 0m17.335s 00:30:12.746 user 0m23.572s 00:30:12.746 sys 0m2.819s 00:30:12.746 16:54:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:12.746 16:54:37 -- common/autotest_common.sh@10 -- # set +x 00:30:12.746 ************************************ 00:30:12.746 END TEST nvmf_discovery_remove_ifc 00:30:12.746 ************************************ 00:30:12.746 16:54:37 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:30:12.746 16:54:37 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:30:12.746 16:54:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:12.746 16:54:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:12.746 16:54:37 -- common/autotest_common.sh@10 -- # set +x 00:30:12.746 ************************************ 00:30:12.746 START TEST nvmf_digest 00:30:12.746 ************************************ 00:30:12.746 16:54:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:30:12.746 * Looking for test storage... 00:30:12.746 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:12.746 16:54:37 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:12.746 16:54:37 -- nvmf/common.sh@7 -- # uname -s 00:30:12.746 16:54:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:12.746 16:54:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:12.746 16:54:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:12.746 16:54:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:12.746 16:54:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:12.746 16:54:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:12.746 16:54:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:12.746 16:54:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:12.746 16:54:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:12.746 16:54:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:12.746 16:54:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.746 16:54:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.746 16:54:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:12.746 16:54:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:12.746 16:54:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:12.746 16:54:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:12.746 16:54:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:12.746 16:54:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:12.746 16:54:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:12.746 16:54:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.746 16:54:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.746 16:54:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.746 16:54:37 -- paths/export.sh@5 -- # export PATH 00:30:12.747 16:54:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.747 16:54:37 -- nvmf/common.sh@46 -- # : 0 00:30:12.747 16:54:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:12.747 16:54:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:12.747 16:54:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:12.747 16:54:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:12.747 16:54:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:12.747 16:54:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:12.747 16:54:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:12.747 16:54:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:12.747 16:54:37 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:30:12.747 16:54:37 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:30:12.747 16:54:37 -- host/digest.sh@16 -- # runtime=2 00:30:12.747 16:54:37 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:30:12.747 16:54:37 -- host/digest.sh@132 -- # nvmftestinit 00:30:12.747 16:54:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:12.747 16:54:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:12.747 16:54:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:12.747 16:54:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:12.747 16:54:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:12.747 16:54:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.747 16:54:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:12.747 16:54:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:12.747 16:54:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:12.747 16:54:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:12.747 16:54:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:12.747 16:54:37 -- common/autotest_common.sh@10 -- # set +x 00:30:14.119 16:54:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:14.119 16:54:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:14.120 16:54:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:14.120 16:54:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:14.120 16:54:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:14.120 16:54:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:14.120 16:54:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:14.120 16:54:39 -- nvmf/common.sh@294 -- # net_devs=() 00:30:14.120 16:54:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:14.120 16:54:39 -- nvmf/common.sh@295 -- # e810=() 00:30:14.120 16:54:39 -- nvmf/common.sh@295 -- # local -ga e810 00:30:14.120 16:54:39 -- nvmf/common.sh@296 -- # x722=() 00:30:14.120 16:54:39 -- nvmf/common.sh@296 -- # local -ga x722 00:30:14.120 16:54:39 -- nvmf/common.sh@297 -- # mlx=() 00:30:14.120 16:54:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:14.120 16:54:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:14.120 16:54:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:14.120 16:54:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:14.120 16:54:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.120 16:54:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:14.120 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:14.120 16:54:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.120 16:54:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:14.120 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:14.120 16:54:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.120 16:54:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.120 16:54:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.120 16:54:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:14.120 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:14.120 16:54:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.120 16:54:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.120 16:54:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.120 16:54:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.120 16:54:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:14.120 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:14.120 16:54:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.120 16:54:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:14.120 16:54:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:14.120 16:54:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:14.120 16:54:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:14.120 16:54:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:14.120 16:54:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:14.120 16:54:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:14.120 16:54:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:14.120 16:54:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:14.120 16:54:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:14.120 16:54:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:14.120 16:54:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:14.120 16:54:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:14.120 16:54:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:14.120 16:54:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:14.120 16:54:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:14.120 16:54:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:14.120 16:54:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:14.379 16:54:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:14.379 16:54:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:14.379 16:54:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:14.379 16:54:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:14.379 16:54:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:14.379 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:14.379 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:30:14.379 00:30:14.379 --- 10.0.0.2 ping statistics --- 00:30:14.379 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.379 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:30:14.379 16:54:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:14.379 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:14.379 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:30:14.379 00:30:14.379 --- 10.0.0.1 ping statistics --- 00:30:14.379 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.379 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:30:14.379 16:54:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:14.379 16:54:39 -- nvmf/common.sh@410 -- # return 0 00:30:14.379 16:54:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:14.379 16:54:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:14.379 16:54:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:14.379 16:54:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:14.379 16:54:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:14.379 16:54:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:14.379 16:54:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:14.379 16:54:39 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:30:14.379 16:54:39 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:30:14.379 16:54:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:14.379 16:54:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:14.379 16:54:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.379 ************************************ 00:30:14.379 START TEST nvmf_digest_clean 00:30:14.379 ************************************ 00:30:14.379 16:54:39 -- common/autotest_common.sh@1104 -- # run_digest 00:30:14.379 16:54:39 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:30:14.379 16:54:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:14.379 16:54:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:14.379 16:54:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.379 16:54:39 -- nvmf/common.sh@469 -- # nvmfpid=1321409 00:30:14.379 16:54:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:14.379 16:54:39 -- nvmf/common.sh@470 -- # waitforlisten 1321409 00:30:14.379 16:54:39 -- common/autotest_common.sh@819 -- # '[' -z 1321409 ']' 00:30:14.379 16:54:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:14.379 16:54:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:14.379 16:54:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:14.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:14.379 16:54:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:14.379 16:54:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.379 [2024-10-13 16:54:39.745762] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:14.379 [2024-10-13 16:54:39.745831] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:14.379 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.379 [2024-10-13 16:54:39.807446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:14.637 [2024-10-13 16:54:39.891350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:14.637 [2024-10-13 16:54:39.891716] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:14.637 [2024-10-13 16:54:39.891739] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:14.637 [2024-10-13 16:54:39.891752] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:14.637 [2024-10-13 16:54:39.891781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:14.637 16:54:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:14.637 16:54:39 -- common/autotest_common.sh@852 -- # return 0 00:30:14.637 16:54:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:14.637 16:54:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:14.637 16:54:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.637 16:54:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:14.637 16:54:39 -- host/digest.sh@120 -- # common_target_config 00:30:14.637 16:54:39 -- host/digest.sh@43 -- # rpc_cmd 00:30:14.637 16:54:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.637 16:54:39 -- common/autotest_common.sh@10 -- # set +x 00:30:14.637 null0 00:30:14.637 [2024-10-13 16:54:40.092923] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:14.637 [2024-10-13 16:54:40.117171] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:14.637 16:54:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.637 16:54:40 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:30:14.637 16:54:40 -- host/digest.sh@77 -- # local rw bs qd 00:30:14.637 16:54:40 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:14.637 16:54:40 -- host/digest.sh@80 -- # rw=randread 00:30:14.637 16:54:40 -- host/digest.sh@80 -- # bs=4096 00:30:14.637 16:54:40 -- host/digest.sh@80 -- # qd=128 00:30:14.637 16:54:40 -- host/digest.sh@82 -- # bperfpid=1321428 00:30:14.637 16:54:40 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:14.638 16:54:40 -- host/digest.sh@83 -- # waitforlisten 1321428 /var/tmp/bperf.sock 00:30:14.638 16:54:40 -- common/autotest_common.sh@819 -- # '[' -z 1321428 ']' 00:30:14.638 16:54:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:14.638 16:54:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:14.638 16:54:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:14.638 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:14.638 16:54:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:14.638 16:54:40 -- common/autotest_common.sh@10 -- # set +x 00:30:14.896 [2024-10-13 16:54:40.161993] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:14.896 [2024-10-13 16:54:40.162067] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1321428 ] 00:30:14.896 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.896 [2024-10-13 16:54:40.223622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:14.896 [2024-10-13 16:54:40.311882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:14.896 16:54:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:14.896 16:54:40 -- common/autotest_common.sh@852 -- # return 0 00:30:14.896 16:54:40 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:14.896 16:54:40 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:14.896 16:54:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:15.462 16:54:40 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:15.462 16:54:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:15.719 nvme0n1 00:30:15.719 16:54:41 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:15.719 16:54:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:15.976 Running I/O for 2 seconds... 00:30:17.872 00:30:17.872 Latency(us) 00:30:17.873 [2024-10-13T14:54:43.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:17.873 [2024-10-13T14:54:43.374Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:17.873 nvme0n1 : 2.04 15357.66 59.99 0.00 0.00 8170.66 3713.71 46603.38 00:30:17.873 [2024-10-13T14:54:43.374Z] =================================================================================================================== 00:30:17.873 [2024-10-13T14:54:43.374Z] Total : 15357.66 59.99 0.00 0.00 8170.66 3713.71 46603.38 00:30:17.873 0 00:30:17.873 16:54:43 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:17.873 16:54:43 -- host/digest.sh@92 -- # get_accel_stats 00:30:17.873 16:54:43 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:17.873 16:54:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:17.873 16:54:43 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:17.873 | select(.opcode=="crc32c") 00:30:17.873 | "\(.module_name) \(.executed)"' 00:30:18.130 16:54:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:18.130 16:54:43 -- host/digest.sh@93 -- # exp_module=software 00:30:18.130 16:54:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:18.130 16:54:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:18.130 16:54:43 -- host/digest.sh@97 -- # killprocess 1321428 00:30:18.130 16:54:43 -- common/autotest_common.sh@926 -- # '[' -z 1321428 ']' 00:30:18.130 16:54:43 -- common/autotest_common.sh@930 -- # kill -0 1321428 00:30:18.130 16:54:43 -- common/autotest_common.sh@931 -- # uname 00:30:18.130 16:54:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:18.130 16:54:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1321428 00:30:18.388 16:54:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:18.388 16:54:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:18.388 16:54:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1321428' 00:30:18.388 killing process with pid 1321428 00:30:18.388 16:54:43 -- common/autotest_common.sh@945 -- # kill 1321428 00:30:18.388 Received shutdown signal, test time was about 2.000000 seconds 00:30:18.388 00:30:18.388 Latency(us) 00:30:18.388 [2024-10-13T14:54:43.889Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:18.388 [2024-10-13T14:54:43.889Z] =================================================================================================================== 00:30:18.388 [2024-10-13T14:54:43.889Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:18.388 16:54:43 -- common/autotest_common.sh@950 -- # wait 1321428 00:30:18.388 16:54:43 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:30:18.388 16:54:43 -- host/digest.sh@77 -- # local rw bs qd 00:30:18.388 16:54:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:18.388 16:54:43 -- host/digest.sh@80 -- # rw=randread 00:30:18.388 16:54:43 -- host/digest.sh@80 -- # bs=131072 00:30:18.388 16:54:43 -- host/digest.sh@80 -- # qd=16 00:30:18.388 16:54:43 -- host/digest.sh@82 -- # bperfpid=1321853 00:30:18.388 16:54:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:18.388 16:54:43 -- host/digest.sh@83 -- # waitforlisten 1321853 /var/tmp/bperf.sock 00:30:18.388 16:54:43 -- common/autotest_common.sh@819 -- # '[' -z 1321853 ']' 00:30:18.388 16:54:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:18.388 16:54:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:18.388 16:54:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:18.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:18.388 16:54:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:18.388 16:54:43 -- common/autotest_common.sh@10 -- # set +x 00:30:18.646 [2024-10-13 16:54:43.902857] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:18.646 [2024-10-13 16:54:43.902938] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1321853 ] 00:30:18.646 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:18.646 Zero copy mechanism will not be used. 00:30:18.646 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.646 [2024-10-13 16:54:43.964926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:18.646 [2024-10-13 16:54:44.054011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:18.646 16:54:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:18.646 16:54:44 -- common/autotest_common.sh@852 -- # return 0 00:30:18.646 16:54:44 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:18.646 16:54:44 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:18.646 16:54:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:19.212 16:54:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:19.212 16:54:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:19.472 nvme0n1 00:30:19.472 16:54:44 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:19.472 16:54:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:19.472 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:19.472 Zero copy mechanism will not be used. 00:30:19.472 Running I/O for 2 seconds... 00:30:21.439 00:30:21.439 Latency(us) 00:30:21.439 [2024-10-13T14:54:46.940Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.439 [2024-10-13T14:54:46.940Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:21.439 nvme0n1 : 2.00 6002.30 750.29 0.00 0.00 2661.58 946.63 11359.57 00:30:21.439 [2024-10-13T14:54:46.940Z] =================================================================================================================== 00:30:21.439 [2024-10-13T14:54:46.940Z] Total : 6002.30 750.29 0.00 0.00 2661.58 946.63 11359.57 00:30:21.439 0 00:30:21.439 16:54:46 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:21.439 16:54:46 -- host/digest.sh@92 -- # get_accel_stats 00:30:21.440 16:54:46 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:21.440 16:54:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:21.440 16:54:46 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:21.440 | select(.opcode=="crc32c") 00:30:21.440 | "\(.module_name) \(.executed)"' 00:30:21.697 16:54:47 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:21.697 16:54:47 -- host/digest.sh@93 -- # exp_module=software 00:30:21.697 16:54:47 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:21.697 16:54:47 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:21.697 16:54:47 -- host/digest.sh@97 -- # killprocess 1321853 00:30:21.697 16:54:47 -- common/autotest_common.sh@926 -- # '[' -z 1321853 ']' 00:30:21.697 16:54:47 -- common/autotest_common.sh@930 -- # kill -0 1321853 00:30:21.697 16:54:47 -- common/autotest_common.sh@931 -- # uname 00:30:21.697 16:54:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:21.697 16:54:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1321853 00:30:21.955 16:54:47 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:21.955 16:54:47 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:21.955 16:54:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1321853' 00:30:21.955 killing process with pid 1321853 00:30:21.955 16:54:47 -- common/autotest_common.sh@945 -- # kill 1321853 00:30:21.956 Received shutdown signal, test time was about 2.000000 seconds 00:30:21.956 00:30:21.956 Latency(us) 00:30:21.956 [2024-10-13T14:54:47.457Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.956 [2024-10-13T14:54:47.457Z] =================================================================================================================== 00:30:21.956 [2024-10-13T14:54:47.457Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:21.956 16:54:47 -- common/autotest_common.sh@950 -- # wait 1321853 00:30:21.956 16:54:47 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:30:21.956 16:54:47 -- host/digest.sh@77 -- # local rw bs qd 00:30:21.956 16:54:47 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:21.956 16:54:47 -- host/digest.sh@80 -- # rw=randwrite 00:30:21.956 16:54:47 -- host/digest.sh@80 -- # bs=4096 00:30:21.956 16:54:47 -- host/digest.sh@80 -- # qd=128 00:30:21.956 16:54:47 -- host/digest.sh@82 -- # bperfpid=1322279 00:30:21.956 16:54:47 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:21.956 16:54:47 -- host/digest.sh@83 -- # waitforlisten 1322279 /var/tmp/bperf.sock 00:30:21.956 16:54:47 -- common/autotest_common.sh@819 -- # '[' -z 1322279 ']' 00:30:21.956 16:54:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:21.956 16:54:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:21.956 16:54:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:21.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:21.956 16:54:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:21.956 16:54:47 -- common/autotest_common.sh@10 -- # set +x 00:30:22.214 [2024-10-13 16:54:47.470311] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:22.214 [2024-10-13 16:54:47.470416] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1322279 ] 00:30:22.214 EAL: No free 2048 kB hugepages reported on node 1 00:30:22.214 [2024-10-13 16:54:47.533442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:22.214 [2024-10-13 16:54:47.620902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:22.214 16:54:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:22.214 16:54:47 -- common/autotest_common.sh@852 -- # return 0 00:30:22.214 16:54:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:22.214 16:54:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:22.214 16:54:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:22.777 16:54:48 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:22.778 16:54:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:23.035 nvme0n1 00:30:23.035 16:54:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:23.035 16:54:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:23.035 Running I/O for 2 seconds... 00:30:25.563 00:30:25.563 Latency(us) 00:30:25.563 [2024-10-13T14:54:51.064Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.563 [2024-10-13T14:54:51.064Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:25.563 nvme0n1 : 2.01 20596.21 80.45 0.00 0.00 6201.40 2560.76 13398.47 00:30:25.563 [2024-10-13T14:54:51.064Z] =================================================================================================================== 00:30:25.563 [2024-10-13T14:54:51.064Z] Total : 20596.21 80.45 0.00 0.00 6201.40 2560.76 13398.47 00:30:25.563 0 00:30:25.563 16:54:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:25.563 16:54:50 -- host/digest.sh@92 -- # get_accel_stats 00:30:25.563 16:54:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:25.563 16:54:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:25.563 16:54:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:25.563 | select(.opcode=="crc32c") 00:30:25.563 | "\(.module_name) \(.executed)"' 00:30:25.563 16:54:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:25.563 16:54:50 -- host/digest.sh@93 -- # exp_module=software 00:30:25.563 16:54:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:25.563 16:54:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:25.563 16:54:50 -- host/digest.sh@97 -- # killprocess 1322279 00:30:25.563 16:54:50 -- common/autotest_common.sh@926 -- # '[' -z 1322279 ']' 00:30:25.563 16:54:50 -- common/autotest_common.sh@930 -- # kill -0 1322279 00:30:25.563 16:54:50 -- common/autotest_common.sh@931 -- # uname 00:30:25.563 16:54:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:25.563 16:54:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1322279 00:30:25.563 16:54:50 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:25.563 16:54:50 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:25.563 16:54:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1322279' 00:30:25.563 killing process with pid 1322279 00:30:25.563 16:54:50 -- common/autotest_common.sh@945 -- # kill 1322279 00:30:25.563 Received shutdown signal, test time was about 2.000000 seconds 00:30:25.563 00:30:25.563 Latency(us) 00:30:25.563 [2024-10-13T14:54:51.064Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.563 [2024-10-13T14:54:51.064Z] =================================================================================================================== 00:30:25.563 [2024-10-13T14:54:51.064Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:25.563 16:54:50 -- common/autotest_common.sh@950 -- # wait 1322279 00:30:25.563 16:54:50 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:30:25.563 16:54:50 -- host/digest.sh@77 -- # local rw bs qd 00:30:25.563 16:54:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:25.563 16:54:50 -- host/digest.sh@80 -- # rw=randwrite 00:30:25.563 16:54:50 -- host/digest.sh@80 -- # bs=131072 00:30:25.563 16:54:50 -- host/digest.sh@80 -- # qd=16 00:30:25.563 16:54:50 -- host/digest.sh@82 -- # bperfpid=1322815 00:30:25.563 16:54:50 -- host/digest.sh@83 -- # waitforlisten 1322815 /var/tmp/bperf.sock 00:30:25.563 16:54:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:25.563 16:54:50 -- common/autotest_common.sh@819 -- # '[' -z 1322815 ']' 00:30:25.563 16:54:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:25.563 16:54:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:25.563 16:54:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:25.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:25.563 16:54:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:25.563 16:54:50 -- common/autotest_common.sh@10 -- # set +x 00:30:25.563 [2024-10-13 16:54:51.034296] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:25.563 [2024-10-13 16:54:51.034384] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1322815 ] 00:30:25.563 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:25.563 Zero copy mechanism will not be used. 00:30:25.563 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.821 [2024-10-13 16:54:51.094779] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:25.821 [2024-10-13 16:54:51.184007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:25.821 16:54:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:25.821 16:54:51 -- common/autotest_common.sh@852 -- # return 0 00:30:25.821 16:54:51 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:25.821 16:54:51 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:25.821 16:54:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:26.387 16:54:51 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:26.387 16:54:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:26.645 nvme0n1 00:30:26.645 16:54:52 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:26.645 16:54:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:26.904 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:26.904 Zero copy mechanism will not be used. 00:30:26.904 Running I/O for 2 seconds... 00:30:28.803 00:30:28.803 Latency(us) 00:30:28.803 [2024-10-13T14:54:54.304Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:28.803 [2024-10-13T14:54:54.304Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:28.803 nvme0n1 : 2.00 6402.62 800.33 0.00 0.00 2491.70 1844.72 9126.49 00:30:28.803 [2024-10-13T14:54:54.304Z] =================================================================================================================== 00:30:28.803 [2024-10-13T14:54:54.304Z] Total : 6402.62 800.33 0.00 0.00 2491.70 1844.72 9126.49 00:30:28.803 0 00:30:28.803 16:54:54 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:28.803 16:54:54 -- host/digest.sh@92 -- # get_accel_stats 00:30:28.803 16:54:54 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:28.803 16:54:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:28.803 16:54:54 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:28.803 | select(.opcode=="crc32c") 00:30:28.803 | "\(.module_name) \(.executed)"' 00:30:29.061 16:54:54 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:29.061 16:54:54 -- host/digest.sh@93 -- # exp_module=software 00:30:29.061 16:54:54 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:29.061 16:54:54 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:29.061 16:54:54 -- host/digest.sh@97 -- # killprocess 1322815 00:30:29.061 16:54:54 -- common/autotest_common.sh@926 -- # '[' -z 1322815 ']' 00:30:29.061 16:54:54 -- common/autotest_common.sh@930 -- # kill -0 1322815 00:30:29.061 16:54:54 -- common/autotest_common.sh@931 -- # uname 00:30:29.061 16:54:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:29.061 16:54:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1322815 00:30:29.061 16:54:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:29.061 16:54:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:29.061 16:54:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1322815' 00:30:29.061 killing process with pid 1322815 00:30:29.061 16:54:54 -- common/autotest_common.sh@945 -- # kill 1322815 00:30:29.061 Received shutdown signal, test time was about 2.000000 seconds 00:30:29.061 00:30:29.061 Latency(us) 00:30:29.061 [2024-10-13T14:54:54.562Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.061 [2024-10-13T14:54:54.562Z] =================================================================================================================== 00:30:29.061 [2024-10-13T14:54:54.562Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:29.061 16:54:54 -- common/autotest_common.sh@950 -- # wait 1322815 00:30:29.318 16:54:54 -- host/digest.sh@126 -- # killprocess 1321409 00:30:29.318 16:54:54 -- common/autotest_common.sh@926 -- # '[' -z 1321409 ']' 00:30:29.318 16:54:54 -- common/autotest_common.sh@930 -- # kill -0 1321409 00:30:29.318 16:54:54 -- common/autotest_common.sh@931 -- # uname 00:30:29.318 16:54:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:29.318 16:54:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1321409 00:30:29.318 16:54:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:29.318 16:54:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:29.318 16:54:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1321409' 00:30:29.318 killing process with pid 1321409 00:30:29.319 16:54:54 -- common/autotest_common.sh@945 -- # kill 1321409 00:30:29.319 16:54:54 -- common/autotest_common.sh@950 -- # wait 1321409 00:30:29.576 00:30:29.576 real 0m15.317s 00:30:29.576 user 0m30.273s 00:30:29.576 sys 0m4.334s 00:30:29.576 16:54:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:29.576 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.576 ************************************ 00:30:29.576 END TEST nvmf_digest_clean 00:30:29.576 ************************************ 00:30:29.576 16:54:55 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:30:29.576 16:54:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:29.576 16:54:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:29.576 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.576 ************************************ 00:30:29.576 START TEST nvmf_digest_error 00:30:29.576 ************************************ 00:30:29.576 16:54:55 -- common/autotest_common.sh@1104 -- # run_digest_error 00:30:29.576 16:54:55 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:30:29.576 16:54:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:29.576 16:54:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:29.576 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.576 16:54:55 -- nvmf/common.sh@469 -- # nvmfpid=1323262 00:30:29.576 16:54:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:29.576 16:54:55 -- nvmf/common.sh@470 -- # waitforlisten 1323262 00:30:29.576 16:54:55 -- common/autotest_common.sh@819 -- # '[' -z 1323262 ']' 00:30:29.576 16:54:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:29.576 16:54:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:29.576 16:54:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:29.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:29.576 16:54:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:29.576 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.835 [2024-10-13 16:54:55.098892] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:29.835 [2024-10-13 16:54:55.098972] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:29.835 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.835 [2024-10-13 16:54:55.165387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:29.835 [2024-10-13 16:54:55.253837] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:29.835 [2024-10-13 16:54:55.253997] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:29.835 [2024-10-13 16:54:55.254027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:29.835 [2024-10-13 16:54:55.254043] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:29.835 [2024-10-13 16:54:55.254081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:29.835 16:54:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:29.835 16:54:55 -- common/autotest_common.sh@852 -- # return 0 00:30:29.835 16:54:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:29.835 16:54:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:29.835 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.835 16:54:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:29.835 16:54:55 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:30:29.835 16:54:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.835 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:29.835 [2024-10-13 16:54:55.334710] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:30:30.093 16:54:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.093 16:54:55 -- host/digest.sh@104 -- # common_target_config 00:30:30.093 16:54:55 -- host/digest.sh@43 -- # rpc_cmd 00:30:30.093 16:54:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.093 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.093 null0 00:30:30.093 [2024-10-13 16:54:55.450875] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:30.093 [2024-10-13 16:54:55.475079] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:30.093 16:54:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.093 16:54:55 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:30:30.093 16:54:55 -- host/digest.sh@54 -- # local rw bs qd 00:30:30.093 16:54:55 -- host/digest.sh@56 -- # rw=randread 00:30:30.093 16:54:55 -- host/digest.sh@56 -- # bs=4096 00:30:30.093 16:54:55 -- host/digest.sh@56 -- # qd=128 00:30:30.093 16:54:55 -- host/digest.sh@58 -- # bperfpid=1323397 00:30:30.093 16:54:55 -- host/digest.sh@60 -- # waitforlisten 1323397 /var/tmp/bperf.sock 00:30:30.093 16:54:55 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:30:30.093 16:54:55 -- common/autotest_common.sh@819 -- # '[' -z 1323397 ']' 00:30:30.093 16:54:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:30.093 16:54:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:30.093 16:54:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:30.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:30.093 16:54:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:30.093 16:54:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.093 [2024-10-13 16:54:55.519873] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:30.093 [2024-10-13 16:54:55.519947] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1323397 ] 00:30:30.093 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.093 [2024-10-13 16:54:55.581719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:30.352 [2024-10-13 16:54:55.670243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:31.285 16:54:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:31.285 16:54:56 -- common/autotest_common.sh@852 -- # return 0 00:30:31.285 16:54:56 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:31.285 16:54:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:31.285 16:54:56 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:31.285 16:54:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:31.285 16:54:56 -- common/autotest_common.sh@10 -- # set +x 00:30:31.285 16:54:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:31.285 16:54:56 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:31.285 16:54:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:31.851 nvme0n1 00:30:31.851 16:54:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:31.851 16:54:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:31.851 16:54:57 -- common/autotest_common.sh@10 -- # set +x 00:30:31.851 16:54:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:31.851 16:54:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:31.851 16:54:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:31.851 Running I/O for 2 seconds... 00:30:31.851 [2024-10-13 16:54:57.275210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.275263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:10141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.275285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:31.851 [2024-10-13 16:54:57.290148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.290186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:17973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.290206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:31.851 [2024-10-13 16:54:57.305556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.305588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:23434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.305606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:31.851 [2024-10-13 16:54:57.322971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.323005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:17493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.323025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:31.851 [2024-10-13 16:54:57.334032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.334067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.334086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:31.851 [2024-10-13 16:54:57.346670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:31.851 [2024-10-13 16:54:57.346701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:1892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:31.851 [2024-10-13 16:54:57.346735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.359496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.359527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.359555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.371459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.371488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:11271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.371520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.384041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.384075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.384093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.395170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.395203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5175 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.395222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.410599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.410628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:20406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.410661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.427743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.427776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:19121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.427795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.444649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.444677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:8289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.444709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.461631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.461659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.461690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.478744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.478777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.478796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.495983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.496023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:2784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.496043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.512771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.512806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:1758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.512825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.530024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.530058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.530078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.547590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.547620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:11797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.547637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.564519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.564548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4430 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.564564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.581483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.581512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.581528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.110 [2024-10-13 16:54:57.598056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.110 [2024-10-13 16:54:57.598090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:3460 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.110 [2024-10-13 16:54:57.598109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.368 [2024-10-13 16:54:57.615497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.368 [2024-10-13 16:54:57.615527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.368 [2024-10-13 16:54:57.615558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.368 [2024-10-13 16:54:57.632402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.368 [2024-10-13 16:54:57.632462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:18153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.368 [2024-10-13 16:54:57.632478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.649485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.649515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:11126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.649533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.666564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.666594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:11727 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.666611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.683644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.683692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.683708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.700415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.700461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:2762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.700478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.717202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.717245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1424 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.717264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.728343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.728377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:2337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.728421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.744538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.744580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21267 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.744596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.761046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.761080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.761099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.783840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.783874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:14595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.783899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.800762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.800796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:24605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.800815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.817556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.817585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.817617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.834076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.834110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.834129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.850934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.850967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:15622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.850986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.369 [2024-10-13 16:54:57.866338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.369 [2024-10-13 16:54:57.866371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3224 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.369 [2024-10-13 16:54:57.866390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.878287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.878321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.878340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.896013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.896047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:14842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.896066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.911620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.911648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:11905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.911683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.928704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.928737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:3986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.928767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.945704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.945738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9923 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.945757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.962558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.962586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.962616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.979832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.979866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:24076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.979885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:57.997033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:57.997067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:22338 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:57.997087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.014112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.014147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:22154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.014166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.031008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.031042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.031061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.047938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.047972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.047990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.064827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.064861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10505 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.064880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.081590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.081618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:7500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.081649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.099099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.099133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.099152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.626 [2024-10-13 16:54:58.115813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.626 [2024-10-13 16:54:58.115847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.626 [2024-10-13 16:54:58.115866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.133031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.133065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.133083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.150179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.150213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:24091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.150232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.165412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.165460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:9755 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.165476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.183925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.183959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:3137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.183977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.200783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.200817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:3168 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.200836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.216155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.216194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:12468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.216214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.233070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.233104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7825 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.233123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.251475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.251502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.251533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.268439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.268467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:12965 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.268483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.285295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.285329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.285348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.296934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.296967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:21942 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.296985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.312350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.312383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:4475 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.312409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.329226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.329261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:20593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.329280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.344401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.344450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:20921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.344467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.361338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.361372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:24197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.361391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:32.884 [2024-10-13 16:54:58.378468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:32.884 [2024-10-13 16:54:58.378495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:32.884 [2024-10-13 16:54:58.378526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.395417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.395464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:18710 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.395480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.412481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.412508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:11538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.412538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.430203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.430237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.430257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.446868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.446903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:13461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.446922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.463953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.463988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:22297 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.464007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.480846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.480880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:24598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.480899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.497696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.497730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11263 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.497756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.514786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.514820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.514840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.531745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.531793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.531812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.548597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.548625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.548656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.564861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.564895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:24465 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.564913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.581871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.581905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:21390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.581924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.598877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.598911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:18739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.598930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.615811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.615845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.615864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.142 [2024-10-13 16:54:58.632557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.142 [2024-10-13 16:54:58.632584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.142 [2024-10-13 16:54:58.632614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.649381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.649443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:24958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.649462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.666244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.666278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:22593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.666297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.682944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.682978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:4195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.682996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.699900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.699934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:16647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.699953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.716566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.716593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:863 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.716624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.733656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.733700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:8860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.733717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.750324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.750359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:711 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.750379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.767348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.767382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:15603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.767414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.781303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.781337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.781356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.796615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.796644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:21684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.796660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.813801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.813841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:7587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.813860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.830953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.830987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.831006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.848192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.848221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:2054 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.848251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.865525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.401 [2024-10-13 16:54:58.865556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:3631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.401 [2024-10-13 16:54:58.865573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.401 [2024-10-13 16:54:58.882931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.402 [2024-10-13 16:54:58.882965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19861 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.402 [2024-10-13 16:54:58.882984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.402 [2024-10-13 16:54:58.894644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.402 [2024-10-13 16:54:58.894693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9382 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.402 [2024-10-13 16:54:58.894712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.659 [2024-10-13 16:54:58.910772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.659 [2024-10-13 16:54:58.910805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.659 [2024-10-13 16:54:58.910823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.659 [2024-10-13 16:54:58.928040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.659 [2024-10-13 16:54:58.928075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:23520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.659 [2024-10-13 16:54:58.928102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.659 [2024-10-13 16:54:58.945010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:58.945044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:58.945062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:58.962210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:58.962244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:11667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:58.962263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:58.979113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:58.979147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5245 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:58.979165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:58.995913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:58.995947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:21962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:58.995966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.012543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.012571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.012602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.029298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.029331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:13902 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.029350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.046380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.046421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:10872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.046441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.063211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.063245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.063264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.080096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.080131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:2684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.080150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.097031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.097065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.097085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.113647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.113674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.113705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.130370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.130411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:1606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.130432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.660 [2024-10-13 16:54:59.147297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.660 [2024-10-13 16:54:59.147331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21700 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.660 [2024-10-13 16:54:59.147350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.164225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.164259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:11656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.164278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.180823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.180856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13907 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.180875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.197195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.197228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.197247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.214035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.214068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:15246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.214097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.230830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.230863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21166 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.230882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 [2024-10-13 16:54:59.247682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1652400) 00:30:33.918 [2024-10-13 16:54:59.247709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:22480 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:33.918 [2024-10-13 16:54:59.247725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:33.918 00:30:33.918 Latency(us) 00:30:33.918 [2024-10-13T14:54:59.419Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:33.918 [2024-10-13T14:54:59.419Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:33.918 nvme0n1 : 2.00 15484.53 60.49 0.00 0.00 8259.10 3810.80 31457.28 00:30:33.918 [2024-10-13T14:54:59.419Z] =================================================================================================================== 00:30:33.918 [2024-10-13T14:54:59.419Z] Total : 15484.53 60.49 0.00 0.00 8259.10 3810.80 31457.28 00:30:33.918 0 00:30:33.918 16:54:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:33.918 16:54:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:33.918 16:54:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:33.918 16:54:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:33.918 | .driver_specific 00:30:33.918 | .nvme_error 00:30:33.918 | .status_code 00:30:33.918 | .command_transient_transport_error' 00:30:34.176 16:54:59 -- host/digest.sh@71 -- # (( 121 > 0 )) 00:30:34.176 16:54:59 -- host/digest.sh@73 -- # killprocess 1323397 00:30:34.176 16:54:59 -- common/autotest_common.sh@926 -- # '[' -z 1323397 ']' 00:30:34.176 16:54:59 -- common/autotest_common.sh@930 -- # kill -0 1323397 00:30:34.176 16:54:59 -- common/autotest_common.sh@931 -- # uname 00:30:34.176 16:54:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:34.176 16:54:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1323397 00:30:34.176 16:54:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:34.176 16:54:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:34.176 16:54:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1323397' 00:30:34.176 killing process with pid 1323397 00:30:34.176 16:54:59 -- common/autotest_common.sh@945 -- # kill 1323397 00:30:34.176 Received shutdown signal, test time was about 2.000000 seconds 00:30:34.176 00:30:34.176 Latency(us) 00:30:34.176 [2024-10-13T14:54:59.677Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:34.176 [2024-10-13T14:54:59.677Z] =================================================================================================================== 00:30:34.176 [2024-10-13T14:54:59.677Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:34.176 16:54:59 -- common/autotest_common.sh@950 -- # wait 1323397 00:30:34.434 16:54:59 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:34.434 16:54:59 -- host/digest.sh@54 -- # local rw bs qd 00:30:34.434 16:54:59 -- host/digest.sh@56 -- # rw=randread 00:30:34.434 16:54:59 -- host/digest.sh@56 -- # bs=131072 00:30:34.434 16:54:59 -- host/digest.sh@56 -- # qd=16 00:30:34.434 16:54:59 -- host/digest.sh@58 -- # bperfpid=1323838 00:30:34.434 16:54:59 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:34.434 16:54:59 -- host/digest.sh@60 -- # waitforlisten 1323838 /var/tmp/bperf.sock 00:30:34.434 16:54:59 -- common/autotest_common.sh@819 -- # '[' -z 1323838 ']' 00:30:34.434 16:54:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:34.434 16:54:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:34.434 16:54:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:34.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:34.434 16:54:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:34.434 16:54:59 -- common/autotest_common.sh@10 -- # set +x 00:30:34.434 [2024-10-13 16:54:59.828690] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:34.434 [2024-10-13 16:54:59.828767] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1323838 ] 00:30:34.434 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:34.434 Zero copy mechanism will not be used. 00:30:34.434 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.434 [2024-10-13 16:54:59.890787] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:34.691 [2024-10-13 16:54:59.983016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:35.625 16:55:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:35.625 16:55:00 -- common/autotest_common.sh@852 -- # return 0 00:30:35.625 16:55:00 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:35.625 16:55:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:35.625 16:55:01 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:35.625 16:55:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.625 16:55:01 -- common/autotest_common.sh@10 -- # set +x 00:30:35.625 16:55:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.625 16:55:01 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:35.626 16:55:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:36.190 nvme0n1 00:30:36.190 16:55:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:36.190 16:55:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:36.190 16:55:01 -- common/autotest_common.sh@10 -- # set +x 00:30:36.190 16:55:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:36.190 16:55:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:36.190 16:55:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:36.190 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:36.190 Zero copy mechanism will not be used. 00:30:36.190 Running I/O for 2 seconds... 00:30:36.190 [2024-10-13 16:55:01.634087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.634143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.634166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.640070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.640108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.640129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.645944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.645990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.646012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.651852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.651886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.651907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.657997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.658032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.658052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.663966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.664001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.664021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.669764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.190 [2024-10-13 16:55:01.669808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.190 [2024-10-13 16:55:01.669829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.190 [2024-10-13 16:55:01.675713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.191 [2024-10-13 16:55:01.675748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.191 [2024-10-13 16:55:01.675768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.191 [2024-10-13 16:55:01.681823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.191 [2024-10-13 16:55:01.681857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.191 [2024-10-13 16:55:01.681877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.191 [2024-10-13 16:55:01.687583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.191 [2024-10-13 16:55:01.687626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.191 [2024-10-13 16:55:01.687644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.449 [2024-10-13 16:55:01.693470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.449 [2024-10-13 16:55:01.693501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.693519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.699115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.699150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.699170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.705618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.705649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.705668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.710773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.710808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.710828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.716081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.716116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.716136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.721793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.721827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.721847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.727316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.727351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.727371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.732853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.732889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.732909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.738338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.738374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.738402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.744037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.744071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.744097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.749555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.749586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.749604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.755383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.755427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.755448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.760911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.760946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.760966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.766480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.766509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.766541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.773076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.773112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.773132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.780196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.780232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.780252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.787714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.787750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.787771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.795573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.795604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.795636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.803354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.803390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.803420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.811768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.811805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.811825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.819937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.819973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.819993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.827814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.827849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.827870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.836104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.836139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.836159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.843492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.843524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.843542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.851282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.851318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.851338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.858565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.858598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.858616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.866125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.866161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.866188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.873712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.450 [2024-10-13 16:55:01.873758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.450 [2024-10-13 16:55:01.873779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.450 [2024-10-13 16:55:01.880812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.880848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.880868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.887455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.887487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.887505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.894048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.894080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.894098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.900676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.900721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.900739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.906854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.906889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.906910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.912797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.912833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.912852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.918861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.918897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.918917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.924804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.924846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.924867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.930852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.930888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.930908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.936942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.936978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.936997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.942657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.942688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.942707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.451 [2024-10-13 16:55:01.948359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.451 [2024-10-13 16:55:01.948416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.451 [2024-10-13 16:55:01.948438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.953370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.953414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.953435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.959660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.959690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.959722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.965803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.965839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.965859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.971333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.971367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.971387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.977033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.977069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.977089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.708 [2024-10-13 16:55:01.982927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.708 [2024-10-13 16:55:01.982963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.708 [2024-10-13 16:55:01.982983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:01.989089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:01.989124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:01.989143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:01.996568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:01.996600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:01.996618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.002794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.002829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.002848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.008784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.008820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.008840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.014912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.014947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.014966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.020958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.020993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.021012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.027043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.027078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.027104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.033170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.033205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.033246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.038532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.038577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.038596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.044439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.044471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.044489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.050543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.050575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.050593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.056541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.056574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.056592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.062663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.062712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.062732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.069444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.069476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.069494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.076823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.076858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.076879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.083783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.083825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.083846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.090610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.090640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.090657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.098046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.098081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.098101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.104729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.104764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.104785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.112233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.112264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.112299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.119108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.119144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.119164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.126024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.126060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.126080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.133199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.133235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.133255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.139473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.139506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.139524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.145442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.145475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.145493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.151264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.151296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.151314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.157220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.157255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.157275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.163657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.163704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.163721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.169768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.169804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.169823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.175618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.175648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.175680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.181833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.181875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.181908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.188379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.188424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.188464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.195840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.195877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.195904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.201863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.201899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.201919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.709 [2024-10-13 16:55:02.207994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.709 [2024-10-13 16:55:02.208030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.709 [2024-10-13 16:55:02.208049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.968 [2024-10-13 16:55:02.214538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.968 [2024-10-13 16:55:02.214571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.968 [2024-10-13 16:55:02.214590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.968 [2024-10-13 16:55:02.220668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.220701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.220719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.226681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.226742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.226762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.232534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.232567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.232585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.238829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.238863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.238881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.246147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.246179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.246198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.252571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.252603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.252621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.258665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.258724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.258742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.264624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.264656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.264689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.270577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.270624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.270641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.276497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.276544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.276561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.282794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.282829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.282849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.290243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.290278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.290298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.296776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.296812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.296832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.302981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.303017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.303044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.309550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.309581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.309598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.316195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.316230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.316250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.323415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.323463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.323481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.330408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.330456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.330474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.337256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.337292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.337312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.343063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.343098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.343119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.348597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.348643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.348660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.354303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.354338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.354358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.359940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.359987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.360009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.365562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.365594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.365613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.371246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.371281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.371301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.377001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.377036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.377055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.382688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.382737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.382757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.388258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.388293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.969 [2024-10-13 16:55:02.388312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.969 [2024-10-13 16:55:02.393880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.969 [2024-10-13 16:55:02.393915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.393935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.399802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.399836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.399856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.405566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.405609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.405625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.411647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.411685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.411702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.417628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.417657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.417687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.423648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.423678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.423696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.429338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.429372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.429402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.435350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.435386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.435415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.442609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.442640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.442673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.449520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.449551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.449584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.456112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.456148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.456168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.462098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.462133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.462160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.970 [2024-10-13 16:55:02.468039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:36.970 [2024-10-13 16:55:02.468074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.970 [2024-10-13 16:55:02.468094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.475209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.475259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.475279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.481984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.482020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.482040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.488159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.488195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.488214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.494118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.494153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.494173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.499966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.500001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.500021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.505938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.505973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.505993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.512892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.512927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.512946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.519871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.519913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.519934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.525996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.526028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.526061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.531880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.531914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.531933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.537990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.538024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.538043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.544000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.544036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.544055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.550054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.550089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.550110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.556373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.556417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.556450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.563353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.563388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.563420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.569982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.570018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.229 [2024-10-13 16:55:02.570038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.229 [2024-10-13 16:55:02.576797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.229 [2024-10-13 16:55:02.576833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.576853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.583662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.583709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.583730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.590094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.590129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.590149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.596791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.596826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.596846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.603633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.603665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.603701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.609802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.609838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.609858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.615440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.615487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.615505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.620957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.620992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.621012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.626737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.626780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.626807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.632329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.632364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.632383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.637948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.637984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.638003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.643779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.643814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.643833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.649591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.649623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.649641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.655387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.655431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.655451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.661103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.661138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.661158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.666983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.667018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.667037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.672790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.672825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.672844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.678538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.678567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.678600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.684297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.684331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.684350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.690051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.690086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.690106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.695786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.695820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.695840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.701585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.701614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.701646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.707352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.707386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.707416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.713048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.713082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.713101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.718791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.718826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.718846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.230 [2024-10-13 16:55:02.724637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.230 [2024-10-13 16:55:02.724682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.230 [2024-10-13 16:55:02.724709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.730512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.730543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.730561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.736104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.736138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.736158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.741803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.741838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.741857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.747551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.747580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.747613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.753523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.753568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.753586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.759304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.759338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.759358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.765042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.765071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.765104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.770848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.770883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.770902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.776562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.776597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.776630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.782349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.782383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.782412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.788184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.788218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.788238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.793955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.489 [2024-10-13 16:55:02.793990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.489 [2024-10-13 16:55:02.794011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.489 [2024-10-13 16:55:02.799791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.799826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.799846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.806358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.806403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.806440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.813861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.813896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.813916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.819859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.819893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.819914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.825895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.825929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.825949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.832013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.832060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.832078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.838199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.838234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.838254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.845266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.845301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.845321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.852881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.852917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.852936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.858984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.859019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.859039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.865110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.865145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.865165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.871293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.871328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.871348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.877220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.877254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.877274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.883137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.883171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.883197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.889816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.889851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.889870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.897349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.897384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.897412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.904839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.904876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.904896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.911464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.911510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.911528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.917285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.917320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.917340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.923273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.923309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.923329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.929756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.929791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.929811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.935775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.935811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.935831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.942527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.942579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.942597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.950137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.950172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.950192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.957679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.957726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.957744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.965723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.965754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.965772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.973276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.973311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.973331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.980974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.981009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.981029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.490 [2024-10-13 16:55:02.988485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.490 [2024-10-13 16:55:02.988516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.490 [2024-10-13 16:55:02.988534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:02.995749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:02.995785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.749 [2024-10-13 16:55:02.995804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:03.003843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:03.003879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.749 [2024-10-13 16:55:03.003899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:03.011532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:03.011579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.749 [2024-10-13 16:55:03.011597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:03.019389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:03.019447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.749 [2024-10-13 16:55:03.019465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:03.027541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:03.027573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.749 [2024-10-13 16:55:03.027592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.749 [2024-10-13 16:55:03.035187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.749 [2024-10-13 16:55:03.035222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.035243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.042709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.042745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.042765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.049443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.049475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.049508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.055937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.055973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.055993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.062000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.062035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.062055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.067552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.067583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.067609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.073231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.073266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.073286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.078675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.078707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.078741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.084028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.084058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.084090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.089646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.089693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.089710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.095198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.095228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.095245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.101097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.101129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.101147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.107038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.107073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.107093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.112840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.112870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.112888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.118731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.118766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.118786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.124780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.124816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.124836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.130563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.130593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.130627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.136808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.136843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.136863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.143419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.143466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.143484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.149475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.149522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.149539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.155152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.155186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.155206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.160724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.160759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.160780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.166519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.166548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.166572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.172184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.172219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.172239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.177719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.177754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.177775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.183295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.183329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.183350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.188868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.188903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.188922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.194601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.750 [2024-10-13 16:55:03.194633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.750 [2024-10-13 16:55:03.194667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.750 [2024-10-13 16:55:03.200195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.200230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.200250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.205873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.205909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.205928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.211538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.211569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.211603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.217222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.217258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.217277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.222809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.222844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.222864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.228323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.228357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.228377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.233844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.233880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.233900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.239485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.239532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.239549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:37.751 [2024-10-13 16:55:03.245028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:37.751 [2024-10-13 16:55:03.245064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.751 [2024-10-13 16:55:03.245084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.250661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.250707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.250727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.256240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.256275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.256295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.261974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.262011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.262031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.267576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.267612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.267631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.273211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.273247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.273268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.278997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.279033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.279053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.284661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.284723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.284741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.290485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.290532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.290549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.295984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.296019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.296039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.301665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.301712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.301733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.307232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.307267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.307287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.312761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.312796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.312823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.318521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.318552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.318584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.324285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.324321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.324340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.330173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.330208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.330228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.336113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.336148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.336168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.343041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.343076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.343096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.350583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.350616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.350635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.357537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.357571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.357590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.363469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.363501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.363520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.369165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.369206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.369228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.375084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.375120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.375140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.381472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.381504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.381523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.388371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.388414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.388453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.010 [2024-10-13 16:55:03.395869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.010 [2024-10-13 16:55:03.395902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.010 [2024-10-13 16:55:03.395921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.403948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.403985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.404006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.411392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.411448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.411465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.418597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.418650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.418668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.425917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.425950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.425969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.433000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.433035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.433055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.439487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.439533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.439554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.445764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.445819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.445840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.452174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.452209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.452229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.459362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.459405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.459441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.466482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.466529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.466546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.474589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.474622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.474640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.482123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.482158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.482178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.490303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.490338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.490364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.498409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.498467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.498485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.011 [2024-10-13 16:55:03.505947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.011 [2024-10-13 16:55:03.505983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.011 [2024-10-13 16:55:03.506003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.513389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.513431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.513475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.521160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.521191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.521209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.528074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.528109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.528129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.534927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.534963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.534983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.541762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.541794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.541812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.549012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.549043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.549061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.555901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.555937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.555957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.563191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.563226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.563247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.570196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.570232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.570252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.577261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.577297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.577318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.584148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.584183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.584203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.589692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.589744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.589764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.595482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.595528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.595545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.600991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.601026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.601046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.606566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.606597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.606622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.612201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.612235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.612255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.617744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.617780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.617800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.623518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.623574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.623591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:38.270 [2024-10-13 16:55:03.629305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24e12f0) 00:30:38.270 [2024-10-13 16:55:03.629341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:38.270 [2024-10-13 16:55:03.629361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:38.270 00:30:38.270 Latency(us) 00:30:38.270 [2024-10-13T14:55:03.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:38.270 [2024-10-13T14:55:03.771Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:38.270 nvme0n1 : 2.00 4925.05 615.63 0.00 0.00 3244.54 1140.81 8349.77 00:30:38.270 [2024-10-13T14:55:03.771Z] =================================================================================================================== 00:30:38.270 [2024-10-13T14:55:03.771Z] Total : 4925.05 615.63 0.00 0.00 3244.54 1140.81 8349.77 00:30:38.270 0 00:30:38.270 16:55:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:38.270 16:55:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:38.270 16:55:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:38.270 | .driver_specific 00:30:38.270 | .nvme_error 00:30:38.270 | .status_code 00:30:38.270 | .command_transient_transport_error' 00:30:38.270 16:55:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:38.528 16:55:03 -- host/digest.sh@71 -- # (( 317 > 0 )) 00:30:38.528 16:55:03 -- host/digest.sh@73 -- # killprocess 1323838 00:30:38.528 16:55:03 -- common/autotest_common.sh@926 -- # '[' -z 1323838 ']' 00:30:38.528 16:55:03 -- common/autotest_common.sh@930 -- # kill -0 1323838 00:30:38.528 16:55:03 -- common/autotest_common.sh@931 -- # uname 00:30:38.528 16:55:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:38.528 16:55:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1323838 00:30:38.528 16:55:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:38.528 16:55:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:38.528 16:55:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1323838' 00:30:38.528 killing process with pid 1323838 00:30:38.528 16:55:03 -- common/autotest_common.sh@945 -- # kill 1323838 00:30:38.528 Received shutdown signal, test time was about 2.000000 seconds 00:30:38.528 00:30:38.528 Latency(us) 00:30:38.528 [2024-10-13T14:55:04.029Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:38.528 [2024-10-13T14:55:04.029Z] =================================================================================================================== 00:30:38.528 [2024-10-13T14:55:04.029Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:38.528 16:55:03 -- common/autotest_common.sh@950 -- # wait 1323838 00:30:38.786 16:55:04 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:38.786 16:55:04 -- host/digest.sh@54 -- # local rw bs qd 00:30:38.786 16:55:04 -- host/digest.sh@56 -- # rw=randwrite 00:30:38.786 16:55:04 -- host/digest.sh@56 -- # bs=4096 00:30:38.786 16:55:04 -- host/digest.sh@56 -- # qd=128 00:30:38.786 16:55:04 -- host/digest.sh@58 -- # bperfpid=1324392 00:30:38.786 16:55:04 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:38.786 16:55:04 -- host/digest.sh@60 -- # waitforlisten 1324392 /var/tmp/bperf.sock 00:30:38.786 16:55:04 -- common/autotest_common.sh@819 -- # '[' -z 1324392 ']' 00:30:38.786 16:55:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:38.786 16:55:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:38.786 16:55:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:38.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:38.786 16:55:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:38.786 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:30:38.786 [2024-10-13 16:55:04.194784] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:38.786 [2024-10-13 16:55:04.194862] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1324392 ] 00:30:38.786 EAL: No free 2048 kB hugepages reported on node 1 00:30:38.786 [2024-10-13 16:55:04.252723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:39.044 [2024-10-13 16:55:04.338172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:39.978 16:55:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:39.978 16:55:05 -- common/autotest_common.sh@852 -- # return 0 00:30:39.978 16:55:05 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:39.978 16:55:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:40.236 16:55:05 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:40.236 16:55:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:40.236 16:55:05 -- common/autotest_common.sh@10 -- # set +x 00:30:40.236 16:55:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:40.236 16:55:05 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:40.236 16:55:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:40.493 nvme0n1 00:30:40.493 16:55:05 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:40.493 16:55:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:40.493 16:55:05 -- common/autotest_common.sh@10 -- # set +x 00:30:40.493 16:55:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:40.493 16:55:05 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:40.493 16:55:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:40.751 Running I/O for 2 seconds... 00:30:40.751 [2024-10-13 16:55:06.065687] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.066042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:23119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.066082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.079471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.079792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:14694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.079826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.093334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.093657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.093687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.107016] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.107293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:5214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.107326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.120829] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.121134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.121166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.134547] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.134950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.134983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.148514] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.148872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.148904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.162191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.162508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:7394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.162537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.175954] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.176256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:24751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.751 [2024-10-13 16:55:06.176288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.751 [2024-10-13 16:55:06.189611] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.751 [2024-10-13 16:55:06.189951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.752 [2024-10-13 16:55:06.189990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.752 [2024-10-13 16:55:06.203270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.752 [2024-10-13 16:55:06.203593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:19501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.752 [2024-10-13 16:55:06.203623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.752 [2024-10-13 16:55:06.216947] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.752 [2024-10-13 16:55:06.217246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:11492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.752 [2024-10-13 16:55:06.217278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.752 [2024-10-13 16:55:06.230613] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.752 [2024-10-13 16:55:06.230931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:25471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.752 [2024-10-13 16:55:06.230963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.752 [2024-10-13 16:55:06.244291] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:40.752 [2024-10-13 16:55:06.244588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:21577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.752 [2024-10-13 16:55:06.244617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.257866] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.258168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:6585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.258199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.271511] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.271860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.271891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.285230] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.285537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.285566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.298968] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.299269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:17026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.299300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.312781] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.313093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.313125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.326456] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.326778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.326810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.340098] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.340406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.340451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.353785] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.354086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:17968 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.354117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.367483] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.367777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:11908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.367808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.381160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.381482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:7453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.381511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.394818] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.395119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:24921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.395151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.408472] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.010 [2024-10-13 16:55:06.408846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.010 [2024-10-13 16:55:06.408878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.010 [2024-10-13 16:55:06.422200] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.422517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:11397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.422546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.435846] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.436149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:12426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.436180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.449500] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.449835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:18055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.449866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.463190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.463517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:1421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.463545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.476874] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.477173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.477204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.490553] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.490857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:14686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.490888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.011 [2024-10-13 16:55:06.504140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.011 [2024-10-13 16:55:06.504463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.011 [2024-10-13 16:55:06.504491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.517716] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.518018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.518051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.531332] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.531747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.531780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.545055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.545362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.545407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.558844] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.559154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:16610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.559186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.572534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.572869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.572900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.586235] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.586544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:5947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.586573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.599943] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.600251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:2376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.600283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.613622] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.613950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:7392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.269 [2024-10-13 16:55:06.613982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.269 [2024-10-13 16:55:06.627383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.269 [2024-10-13 16:55:06.627767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:24464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.627799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.641034] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.641336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.641368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.654673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.654998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.655029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.668218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.668534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.668563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.681615] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.681939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:15973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.681970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.695159] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.695480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.695509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.708710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.709033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.709065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.722304] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.722593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.722621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.735961] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.736265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:11837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.736296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.749675] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.750002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.750034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.270 [2024-10-13 16:55:06.763410] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.270 [2024-10-13 16:55:06.763696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:14679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.270 [2024-10-13 16:55:06.763728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.528 [2024-10-13 16:55:06.776973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.528 [2024-10-13 16:55:06.777276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:23487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.528 [2024-10-13 16:55:06.777308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.528 [2024-10-13 16:55:06.790469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.528 [2024-10-13 16:55:06.790774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:19509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.528 [2024-10-13 16:55:06.790806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.528 [2024-10-13 16:55:06.803919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.528 [2024-10-13 16:55:06.804220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:21699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.528 [2024-10-13 16:55:06.804251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.528 [2024-10-13 16:55:06.817335] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.528 [2024-10-13 16:55:06.817612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:19650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.528 [2024-10-13 16:55:06.817641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.528 [2024-10-13 16:55:06.830986] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.831285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:9637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.831317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.844683] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.845021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:9949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.845053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.858468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.858848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:6324 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.858881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.872249] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.872548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:2316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.872577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.885976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.886241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.886273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.899730] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.900030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19503 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.900067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.913569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.913973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.914006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.927232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.927539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8747 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.927568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.940930] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.941231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.941262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.954612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.954946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.954978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.968316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.968618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:22879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.968647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.981963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.982230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:1156 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.982262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:06.995613] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:06.995937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:22818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:06.995968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:07.009362] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:07.009648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:17406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:07.009677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.529 [2024-10-13 16:55:07.022989] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.529 [2024-10-13 16:55:07.023295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:17277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.529 [2024-10-13 16:55:07.023327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.036546] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.036921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:2796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.036952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.050168] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.050484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.050523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.063847] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.064152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:2469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.064183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.077518] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.077877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.077908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.091187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.091514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.091543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.104911] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.105213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.105244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.118540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.118909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:21581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.118941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.132179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.132508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:25291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.132536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.145888] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.146188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.146219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.159801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.160100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:17268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.160132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.173468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.173795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:11557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.173827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.187181] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.187506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:4349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.187535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.200855] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.201165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:20841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.201196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.214467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.214785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.214816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.228172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.228489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.228521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.241793] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.242095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.242128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.255414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.255760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:23334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.255798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.269104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.269415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.269461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.788 [2024-10-13 16:55:07.282826] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:41.788 [2024-10-13 16:55:07.283140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:41.788 [2024-10-13 16:55:07.283172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.296339] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.296629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.296658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.310092] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.310402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:7597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.310448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.323859] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.324160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:23554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.324191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.337478] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.337864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.337895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.351155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.351477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:17796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.351506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.364899] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.365208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.365240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.378467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.046 [2024-10-13 16:55:07.378849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.046 [2024-10-13 16:55:07.378880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.046 [2024-10-13 16:55:07.392144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.392473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:21564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.392502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.405883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.406185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:24821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.406215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.419583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.419925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.419956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.433292] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.433646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.433690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.446998] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.447298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.447329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.460709] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.461020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.461050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.474464] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.474804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.474836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.488129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.488452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.488481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.501822] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.502121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:23338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.502151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.515525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.515848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:16721 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.515880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.529190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.529518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:1914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.529546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.047 [2024-10-13 16:55:07.542869] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.047 [2024-10-13 16:55:07.543178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:13719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.047 [2024-10-13 16:55:07.543209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.556314] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.556644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.556673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.570006] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.570306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:25182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.570337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.583706] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.584008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:11420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.584040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.597355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.597639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:17288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.597668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.611087] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.611390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:7743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.611462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.624808] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.625110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.625141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.638373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.638776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:15834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.638808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.652072] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.652372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.652412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.665751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.666054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.305 [2024-10-13 16:55:07.666086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.305 [2024-10-13 16:55:07.679480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.305 [2024-10-13 16:55:07.679774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.679805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.692379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.692628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:3912 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.692657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.705609] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.705919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:10404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.705950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.719269] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.719580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6310 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.719608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.733037] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.733304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:2436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.733341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.746685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.747017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.747049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.760365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.760670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:16899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.760714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.774109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.774420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:4193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.774468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.787894] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.788199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:23995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.788230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.306 [2024-10-13 16:55:07.801298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.306 [2024-10-13 16:55:07.801549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:1857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.306 [2024-10-13 16:55:07.801578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.814629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.814955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:21319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.814988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.828279] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.828594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.828623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.841980] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.842284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.842324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.855695] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.856018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.856050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.869661] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.869993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.870025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.883368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.883765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.883797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.896876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.897175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.897214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.910379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.910649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.910693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.923969] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.924272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:6975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.924303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.937550] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.564 [2024-10-13 16:55:07.937907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10014 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.564 [2024-10-13 16:55:07.937939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.564 [2024-10-13 16:55:07.951245] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:07.951531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:19713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:07.951560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:07.964898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:07.965208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:12010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:07.965244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:07.978610] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:07.978908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:11170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:07.978940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:07.992318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:07.992645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21390 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:07.992689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:08.006021] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:08.006342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:08.006373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:08.019690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:08.020008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:6085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:08.020039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:08.033374] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:08.033691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:08.033737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 [2024-10-13 16:55:08.047055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204c920) with pdu=0x2000190f7da8 00:30:42.565 [2024-10-13 16:55:08.047356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:42.565 [2024-10-13 16:55:08.047387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:42.565 00:30:42.565 Latency(us) 00:30:42.565 [2024-10-13T14:55:08.066Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:42.565 [2024-10-13T14:55:08.066Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:42.565 nvme0n1 : 2.01 18686.03 72.99 0.00 0.00 6835.16 3325.35 13981.01 00:30:42.565 [2024-10-13T14:55:08.066Z] =================================================================================================================== 00:30:42.565 [2024-10-13T14:55:08.066Z] Total : 18686.03 72.99 0.00 0.00 6835.16 3325.35 13981.01 00:30:42.565 0 00:30:42.822 16:55:08 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:42.822 16:55:08 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:42.822 16:55:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:42.822 16:55:08 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:42.822 | .driver_specific 00:30:42.822 | .nvme_error 00:30:42.822 | .status_code 00:30:42.822 | .command_transient_transport_error' 00:30:42.822 16:55:08 -- host/digest.sh@71 -- # (( 146 > 0 )) 00:30:42.822 16:55:08 -- host/digest.sh@73 -- # killprocess 1324392 00:30:42.822 16:55:08 -- common/autotest_common.sh@926 -- # '[' -z 1324392 ']' 00:30:42.822 16:55:08 -- common/autotest_common.sh@930 -- # kill -0 1324392 00:30:42.822 16:55:08 -- common/autotest_common.sh@931 -- # uname 00:30:43.080 16:55:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:43.080 16:55:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1324392 00:30:43.080 16:55:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:43.080 16:55:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:43.080 16:55:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1324392' 00:30:43.080 killing process with pid 1324392 00:30:43.080 16:55:08 -- common/autotest_common.sh@945 -- # kill 1324392 00:30:43.080 Received shutdown signal, test time was about 2.000000 seconds 00:30:43.080 00:30:43.080 Latency(us) 00:30:43.080 [2024-10-13T14:55:08.581Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:43.080 [2024-10-13T14:55:08.581Z] =================================================================================================================== 00:30:43.080 [2024-10-13T14:55:08.581Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:43.080 16:55:08 -- common/autotest_common.sh@950 -- # wait 1324392 00:30:43.080 16:55:08 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:43.080 16:55:08 -- host/digest.sh@54 -- # local rw bs qd 00:30:43.080 16:55:08 -- host/digest.sh@56 -- # rw=randwrite 00:30:43.080 16:55:08 -- host/digest.sh@56 -- # bs=131072 00:30:43.080 16:55:08 -- host/digest.sh@56 -- # qd=16 00:30:43.080 16:55:08 -- host/digest.sh@58 -- # bperfpid=1324941 00:30:43.080 16:55:08 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:43.080 16:55:08 -- host/digest.sh@60 -- # waitforlisten 1324941 /var/tmp/bperf.sock 00:30:43.080 16:55:08 -- common/autotest_common.sh@819 -- # '[' -z 1324941 ']' 00:30:43.080 16:55:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:43.080 16:55:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:43.080 16:55:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:43.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:43.080 16:55:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:43.080 16:55:08 -- common/autotest_common.sh@10 -- # set +x 00:30:43.338 [2024-10-13 16:55:08.610599] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:43.338 [2024-10-13 16:55:08.610678] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1324941 ] 00:30:43.338 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:43.338 Zero copy mechanism will not be used. 00:30:43.338 EAL: No free 2048 kB hugepages reported on node 1 00:30:43.338 [2024-10-13 16:55:08.671515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:43.338 [2024-10-13 16:55:08.760016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:44.271 16:55:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:44.271 16:55:09 -- common/autotest_common.sh@852 -- # return 0 00:30:44.271 16:55:09 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:44.271 16:55:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:44.529 16:55:09 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:44.529 16:55:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:44.529 16:55:09 -- common/autotest_common.sh@10 -- # set +x 00:30:44.529 16:55:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:44.529 16:55:09 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:44.529 16:55:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:44.787 nvme0n1 00:30:44.787 16:55:10 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:44.787 16:55:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:44.787 16:55:10 -- common/autotest_common.sh@10 -- # set +x 00:30:44.787 16:55:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:44.787 16:55:10 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:44.788 16:55:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:45.076 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:45.076 Zero copy mechanism will not be used. 00:30:45.076 Running I/O for 2 seconds... 00:30:45.076 [2024-10-13 16:55:10.372486] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.372816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.372861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.377598] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.377749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.377792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.382242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.382370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.382411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.386842] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.386967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.386999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.391283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.391417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.391464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.395787] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.395886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.395921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.400304] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.400469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.400499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.404946] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.405183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.405216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.409484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.409720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.409754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.413990] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.414147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.414180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.418493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.418634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.418667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.422905] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.423023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.423056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.427327] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.427468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.427498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.431886] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.432023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.432056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.436471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.436621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.436650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.441504] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.441799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.441841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.446635] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.446868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.446901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.451658] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.451846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.451878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.456814] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.457034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.457066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.461852] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.462017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.462049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.466888] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.467068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.467101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.471982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.472140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.472172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.477271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.477521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.477551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.482352] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.482657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.482687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.487492] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.487705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.076 [2024-10-13 16:55:10.487734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.076 [2024-10-13 16:55:10.492630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.076 [2024-10-13 16:55:10.492843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.492877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.497714] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.497917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.497948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.502765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.502922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.502954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.507875] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.508108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.508137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.512886] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.513038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.513069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.518202] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.518470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.518503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.523414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.523653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.523683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.528305] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.528484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.528517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.532891] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.533092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.533124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.537978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.538158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.538189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.543081] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.543277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.543309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.548130] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.548329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.548360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.077 [2024-10-13 16:55:10.553223] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.077 [2024-10-13 16:55:10.553496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.077 [2024-10-13 16:55:10.553526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.558422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.558704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.558737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.563460] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.563585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.563614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.568567] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.568773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.568806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.573532] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.573721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.573765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.578602] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.578822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.578854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.583609] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.583758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.583788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.588682] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.588857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.588890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.593768] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.593972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.594004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.598945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.599125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.599157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.604115] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.604404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.604464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.609095] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.609289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.609321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.614010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.614174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.614207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.618635] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.618787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.618834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.623782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.623977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.624010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.628768] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.628951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.628979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.633786] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.633994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.634023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.639802] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.640082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.640114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.644885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.645112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.341 [2024-10-13 16:55:10.645144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.341 [2024-10-13 16:55:10.649493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.341 [2024-10-13 16:55:10.649690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.649737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.654023] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.654162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.654195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.658752] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.658869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.658897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.663240] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.663445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.663490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.667912] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.668067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.668099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.673005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.673110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.673141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.679335] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.679559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.679589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.684421] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.684626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.684655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.689015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.689135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.689163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.693612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.693778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.693811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.699164] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.699278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.699310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.703595] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.703770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.703808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.708737] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.708917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.708949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.713825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.713948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.713980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.720135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.720429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.720476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.725020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.725125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.725156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.729537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.729689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.729722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.734366] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.734571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.734601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.738960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.739093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.739126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.743582] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.743734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.743766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.748220] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.748351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.748383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.752777] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.752895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.752927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.757439] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.757654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.757683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.763606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.763727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.763758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.768917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.769043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.769075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.773919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.774140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.774171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.778720] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.778855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.778887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.784679] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.784882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.784914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.789920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.342 [2024-10-13 16:55:10.790095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.342 [2024-10-13 16:55:10.790128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.342 [2024-10-13 16:55:10.794369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.794501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.794537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.798987] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.799193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.799225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.803561] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.803717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.803749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.808945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.809150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.809182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.813482] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.813617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.813647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.818307] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.818491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.818521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.824135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.824267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.824299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.829975] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.830157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.830188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.834570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.834740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.834778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.343 [2024-10-13 16:55:10.839010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.343 [2024-10-13 16:55:10.839175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.343 [2024-10-13 16:55:10.839206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.843782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.843995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.844027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.848849] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.849043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.849075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.853832] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.853971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.854003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.859475] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.859658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.859686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.865573] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.865771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.865803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.871220] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.871391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.871432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.876192] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.876418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.876466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.881125] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.881267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.881295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.886526] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.886817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.886847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.891674] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.891918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.602 [2024-10-13 16:55:10.891951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.602 [2024-10-13 16:55:10.898065] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.602 [2024-10-13 16:55:10.898271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.898303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.903364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.903522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.903552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.908123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.908242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.908274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.912580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.912709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.912741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.917428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.917518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.917545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.923106] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.923276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.923313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.927621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.927871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.927902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.932052] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.932277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.932309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.936551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.936686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.936733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.940960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.941071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.941104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.945363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.945498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.945527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.949784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.949872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.949902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.954436] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.954564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.954593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.959001] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.959137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.959169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.963768] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.963987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.964020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.968403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.968572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.968601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.973056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.973189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.973222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.977551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.977640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.977672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.982073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.982189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.982221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.986489] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.986582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.986611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.991015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.991126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.991159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:10.995633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:10.995781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:10.995813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.000500] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.000691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.000719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.005154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.005381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.005424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.010036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.010211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.010244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.015187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.015346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.015378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.021078] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.021286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.021318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.026441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.026608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.026637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.031364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.603 [2024-10-13 16:55:11.031517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.603 [2024-10-13 16:55:11.031545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.603 [2024-10-13 16:55:11.036185] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.036375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.036415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.041466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.041764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.041797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.047292] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.047477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.047512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.052367] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.052504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.052537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.056899] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.057099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.057131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.061493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.061672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.061717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.066195] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.066280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.066309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.071522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.071727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.071760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.076079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.076235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.076266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.081237] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.081518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.081551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.086906] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.087081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.087112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.092773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.092921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.092952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.097332] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.097522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.097552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.604 [2024-10-13 16:55:11.101696] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.604 [2024-10-13 16:55:11.101841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.604 [2024-10-13 16:55:11.101872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.106280] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.106432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.106478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.110900] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.111050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.111081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.115487] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.115638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.115666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.120037] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.120217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.120249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.124732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.124898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.124931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.129117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.129255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.129286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.134067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.134252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.134280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.139076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.139268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.139297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.144217] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.144358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.144390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.149386] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.149562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.149591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.154760] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.154903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.154934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.161013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.161249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.161281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.165896] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.166097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.166129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.170567] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.170798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.170831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.175138] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.175305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.863 [2024-10-13 16:55:11.175342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.863 [2024-10-13 16:55:11.180250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.863 [2024-10-13 16:55:11.180352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.180383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.185298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.185433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.185481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.189829] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.189955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.189987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.194206] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.194314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.194346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.199012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.199223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.199254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.203503] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.203680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.203728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.208031] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.208252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.208284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.212549] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.212718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.212751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.216983] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.217107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.217140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.221472] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.221657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.221687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.225945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.226067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.226099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.230432] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.230566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.230595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.235229] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.235442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.235487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.239856] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.240036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.240069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.244491] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.244711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.244743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.249128] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.249324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.249355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.253824] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.253911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.253946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.258531] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.258722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.258754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.263129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.263275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.263307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.268156] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.268265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.268296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.272782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.273000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.273032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.277510] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.277734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.277767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.282932] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.283193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.283225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.287917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.288044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.288076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.294023] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.294256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.294289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.299425] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.299674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.299718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.304592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.304860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.304892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.864 [2024-10-13 16:55:11.309933] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.864 [2024-10-13 16:55:11.310142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.864 [2024-10-13 16:55:11.310174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.315338] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.315559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.315588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.320629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.320839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.320872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.326275] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.326532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.326561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.331794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.331937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.331969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.337000] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.337121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.337152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.342369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.342532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.342572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.347613] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.347881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.347913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.353140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.353387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.353434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:45.865 [2024-10-13 16:55:11.358469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:45.865 [2024-10-13 16:55:11.358675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:45.865 [2024-10-13 16:55:11.358718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.363875] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.364146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.364179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.369181] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.369522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.369552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.374506] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.374643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.374671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.379784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.379952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.379983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.384858] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.385021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.385049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.390051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.390213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.390251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.395290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.395526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.395556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.400361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.400564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.123 [2024-10-13 16:55:11.400593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.123 [2024-10-13 16:55:11.405660] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.123 [2024-10-13 16:55:11.405917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.405949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.410818] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.410970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.411002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.416005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.416155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.416186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.421336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.421480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.421508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.426684] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.426837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.426869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.431769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.431910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.431941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.437217] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.437505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.437534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.443363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.443610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.443651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.448651] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.448892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.448923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.453809] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.454142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.454174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.458914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.459148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.459180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.464100] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.464230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.464262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.469817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.470016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.470048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.474997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.475193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.475225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.480039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.480221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.480253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.485133] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.485307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.485338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.490418] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.490676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.490721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.495546] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.495712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.495760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.500881] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.501181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.501212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.506127] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.506416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.506463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.511447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.511590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.511618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.516611] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.516812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.516844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.521869] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.522049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.522081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.527169] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.527343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.527380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.532405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.532562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.532590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.537929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.538205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.538237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.543592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.124 [2024-10-13 16:55:11.543868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.124 [2024-10-13 16:55:11.543900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.124 [2024-10-13 16:55:11.549808] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.549967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.549998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.554522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.554631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.554660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.558914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.559078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.559110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.563868] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.563980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.564012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.569440] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.569562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.569592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.573941] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.574094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.574126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.579119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.579338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.579370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.584473] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.584686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.584718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.590490] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.590810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.590843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.596355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.596518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.596548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.602539] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.602750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.602782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.608952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.609117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.609150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.613794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.613900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.613933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.618206] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.618331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.618363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.125 [2024-10-13 16:55:11.622626] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.125 [2024-10-13 16:55:11.622750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.125 [2024-10-13 16:55:11.622781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.627163] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.627298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.627331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.631731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.631969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.632001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.635851] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.636047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.636077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.640077] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.640271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.640303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.644433] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.644577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.644606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.648817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.648927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.648959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.653240] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.653365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.653407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.657779] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.657950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.657988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.662168] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.662303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.662334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.666731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.666967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.666999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.671116] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.671344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.671375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.675577] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.675751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.675784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.384 [2024-10-13 16:55:11.679985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.384 [2024-10-13 16:55:11.680130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.384 [2024-10-13 16:55:11.680162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.684454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.684622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.684654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.689547] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.689722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.689753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.694563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.694831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.694862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.699625] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.699781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.699812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.704840] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.705195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.705227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.710303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.710505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.710535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.716343] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.716529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.716558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.721587] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.721733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.721766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.726980] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.727175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.727207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.732483] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.732637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.732665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.738753] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.738880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.738912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.744108] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.744312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.744344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.749495] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.749723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.749762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.755234] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.755545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.755574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.761676] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.761842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.761873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.768145] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.768377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.768422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.774119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.774234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.774279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.779513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.779646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.779675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.784117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.784217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.784245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.788516] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.788624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.788653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.793218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.793440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.793491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.797830] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.798059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.798091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.802213] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.802353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.802385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.806862] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.806969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.807001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.811578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.811768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.811801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.816084] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.816231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.816263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.820520] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.820610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.820637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.825186] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.825402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.385 [2024-10-13 16:55:11.825449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.385 [2024-10-13 16:55:11.830084] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.385 [2024-10-13 16:55:11.830255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.830287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.835543] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.835771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.835804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.840056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.840186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.840218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.844884] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.845030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.845061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.850154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.850319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.850351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.855362] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.855574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.855604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.861585] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.861811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.861844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.866589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.866752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.866785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.871243] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.871477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.871507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.875785] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.875966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.875998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.386 [2024-10-13 16:55:11.880516] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.386 [2024-10-13 16:55:11.880584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.386 [2024-10-13 16:55:11.880612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.885955] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.886080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.886111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.890382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.890710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.890739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.895606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.895774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.895806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.901261] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.901433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.901479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.907236] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.907543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.907573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.913671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.913848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.913880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.919826] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.920048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.920080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.925463] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.925581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.925619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.930054] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.930206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.930237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.934562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.934662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.934706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.939125] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.939199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.939229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.943730] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.943965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.943998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.948586] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.948762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.948794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.953207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.953360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.953392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.957657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.957805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.957837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.962597] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.962684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.962728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.967576] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.967669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.967699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.972153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.972263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.972295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.977026] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.977138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.977170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.981633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.981846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.981879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.986654] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.986856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.645 [2024-10-13 16:55:11.986888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.645 [2024-10-13 16:55:11.991284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.645 [2024-10-13 16:55:11.991513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:11.991543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:11.996732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:11.996874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:11.996905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.002689] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.002836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.002867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.008258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.008440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.008485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.013172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.013287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.013318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.017917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.018100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.018131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.023288] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.023411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.023442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.029320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.029544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.029573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.034198] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.034299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.034328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.038790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.038951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.038982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.043162] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.043239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.043268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.048657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.048866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.048898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.053093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.053222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.053262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.057486] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.057611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.057642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.061979] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.062183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.062214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.066366] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.066571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.066600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.070909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.071139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.071171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.075314] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.075501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.075530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.079952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.080058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.080089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.084680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.084843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.084875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.089492] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.089584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.089616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.094193] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.094297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.094327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.099010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.099217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.099250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.103899] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.104054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.104085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.108880] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.109073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.109105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.113607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.113740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.113771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.117995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.118069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.118099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.122819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.122984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.646 [2024-10-13 16:55:12.123015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.646 [2024-10-13 16:55:12.127304] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.646 [2024-10-13 16:55:12.127448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.647 [2024-10-13 16:55:12.127493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.647 [2024-10-13 16:55:12.131867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.647 [2024-10-13 16:55:12.131966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.647 [2024-10-13 16:55:12.132003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.647 [2024-10-13 16:55:12.136601] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.647 [2024-10-13 16:55:12.136776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.647 [2024-10-13 16:55:12.136808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.647 [2024-10-13 16:55:12.141593] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.647 [2024-10-13 16:55:12.141811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.647 [2024-10-13 16:55:12.141843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.146113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.146335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.146367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.150629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.150799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.150830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.155045] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.155145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.155176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.159438] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.159625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.159653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.163845] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.164002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.164034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.168233] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.168339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.168374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.172780] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.172990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.173022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.177136] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.177325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.177357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.181621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.181858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.181889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.186044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.186217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.186248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.190566] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.190686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.190729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.195382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.195554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.195583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.200015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.200117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.200151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.204656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.204772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.204803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.906 [2024-10-13 16:55:12.209414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.906 [2024-10-13 16:55:12.209598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.906 [2024-10-13 16:55:12.209626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.214098] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.214284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.214315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.218647] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.218853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.218885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.223546] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.223662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.223690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.228782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.228888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.228920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.233577] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.233709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.233737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.238580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.238739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.238770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.243023] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.243132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.243163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.247879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.248088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.248120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.252275] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.252498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.252533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.256792] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.257020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.257051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.261186] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.261350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.261381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.265627] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.265754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.265785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.270050] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.270244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.270275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.274484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.274613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.274641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.278928] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.279045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.279077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.283531] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.283693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.283738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.288101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.288251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.288283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.292658] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.292899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.292932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.297105] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.297278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.297309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.302166] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.302333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.302365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.307984] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.308177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.308209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.313371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.313597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.313627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.318443] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.318567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.318598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.322981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.323159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.323190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.328255] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.328443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.328473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.333408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.333549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.333577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.338670] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.338929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.338962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.344502] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.907 [2024-10-13 16:55:12.344620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.907 [2024-10-13 16:55:12.344647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.907 [2024-10-13 16:55:12.349939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.908 [2024-10-13 16:55:12.350072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.908 [2024-10-13 16:55:12.350104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.908 [2024-10-13 16:55:12.354560] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.908 [2024-10-13 16:55:12.354715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.908 [2024-10-13 16:55:12.354748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.908 [2024-10-13 16:55:12.359224] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.908 [2024-10-13 16:55:12.359332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.908 [2024-10-13 16:55:12.359362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.908 [2024-10-13 16:55:12.364026] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.908 [2024-10-13 16:55:12.364241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.908 [2024-10-13 16:55:12.364273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.908 [2024-10-13 16:55:12.368466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x204cac0) with pdu=0x2000190fef90 00:30:46.908 [2024-10-13 16:55:12.368534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.908 [2024-10-13 16:55:12.368560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.908 00:30:46.908 Latency(us) 00:30:46.908 [2024-10-13T14:55:12.409Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:46.908 [2024-10-13T14:55:12.409Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:46.908 nvme0n1 : 2.00 6239.09 779.89 0.00 0.00 2556.89 1881.13 8543.95 00:30:46.908 [2024-10-13T14:55:12.409Z] =================================================================================================================== 00:30:46.908 [2024-10-13T14:55:12.409Z] Total : 6239.09 779.89 0.00 0.00 2556.89 1881.13 8543.95 00:30:46.908 0 00:30:46.908 16:55:12 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:46.908 16:55:12 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:46.908 16:55:12 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:46.908 | .driver_specific 00:30:46.908 | .nvme_error 00:30:46.908 | .status_code 00:30:46.908 | .command_transient_transport_error' 00:30:46.908 16:55:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:47.165 16:55:12 -- host/digest.sh@71 -- # (( 403 > 0 )) 00:30:47.165 16:55:12 -- host/digest.sh@73 -- # killprocess 1324941 00:30:47.165 16:55:12 -- common/autotest_common.sh@926 -- # '[' -z 1324941 ']' 00:30:47.165 16:55:12 -- common/autotest_common.sh@930 -- # kill -0 1324941 00:30:47.165 16:55:12 -- common/autotest_common.sh@931 -- # uname 00:30:47.165 16:55:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:47.165 16:55:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1324941 00:30:47.424 16:55:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:47.424 16:55:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:47.424 16:55:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1324941' 00:30:47.424 killing process with pid 1324941 00:30:47.424 16:55:12 -- common/autotest_common.sh@945 -- # kill 1324941 00:30:47.424 Received shutdown signal, test time was about 2.000000 seconds 00:30:47.424 00:30:47.424 Latency(us) 00:30:47.424 [2024-10-13T14:55:12.925Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:47.424 [2024-10-13T14:55:12.925Z] =================================================================================================================== 00:30:47.424 [2024-10-13T14:55:12.925Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:47.424 16:55:12 -- common/autotest_common.sh@950 -- # wait 1324941 00:30:47.424 16:55:12 -- host/digest.sh@115 -- # killprocess 1323262 00:30:47.424 16:55:12 -- common/autotest_common.sh@926 -- # '[' -z 1323262 ']' 00:30:47.424 16:55:12 -- common/autotest_common.sh@930 -- # kill -0 1323262 00:30:47.424 16:55:12 -- common/autotest_common.sh@931 -- # uname 00:30:47.424 16:55:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:47.424 16:55:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1323262 00:30:47.682 16:55:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:47.682 16:55:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:47.682 16:55:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1323262' 00:30:47.682 killing process with pid 1323262 00:30:47.682 16:55:12 -- common/autotest_common.sh@945 -- # kill 1323262 00:30:47.682 16:55:12 -- common/autotest_common.sh@950 -- # wait 1323262 00:30:47.939 00:30:47.939 real 0m18.151s 00:30:47.939 user 0m36.576s 00:30:47.939 sys 0m4.624s 00:30:47.939 16:55:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:47.939 16:55:13 -- common/autotest_common.sh@10 -- # set +x 00:30:47.939 ************************************ 00:30:47.939 END TEST nvmf_digest_error 00:30:47.939 ************************************ 00:30:47.939 16:55:13 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:47.939 16:55:13 -- host/digest.sh@139 -- # nvmftestfini 00:30:47.940 16:55:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:47.940 16:55:13 -- nvmf/common.sh@116 -- # sync 00:30:47.940 16:55:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:47.940 16:55:13 -- nvmf/common.sh@119 -- # set +e 00:30:47.940 16:55:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:47.940 16:55:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:47.940 rmmod nvme_tcp 00:30:47.940 rmmod nvme_fabrics 00:30:47.940 rmmod nvme_keyring 00:30:47.940 16:55:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:47.940 16:55:13 -- nvmf/common.sh@123 -- # set -e 00:30:47.940 16:55:13 -- nvmf/common.sh@124 -- # return 0 00:30:47.940 16:55:13 -- nvmf/common.sh@477 -- # '[' -n 1323262 ']' 00:30:47.940 16:55:13 -- nvmf/common.sh@478 -- # killprocess 1323262 00:30:47.940 16:55:13 -- common/autotest_common.sh@926 -- # '[' -z 1323262 ']' 00:30:47.940 16:55:13 -- common/autotest_common.sh@930 -- # kill -0 1323262 00:30:47.940 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1323262) - No such process 00:30:47.940 16:55:13 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1323262 is not found' 00:30:47.940 Process with pid 1323262 is not found 00:30:47.940 16:55:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:47.940 16:55:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:47.940 16:55:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:47.940 16:55:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:47.940 16:55:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:47.940 16:55:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:47.940 16:55:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:47.940 16:55:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:49.841 16:55:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:49.841 00:30:49.841 real 0m37.675s 00:30:49.841 user 1m7.609s 00:30:49.841 sys 0m10.401s 00:30:49.841 16:55:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:49.841 16:55:15 -- common/autotest_common.sh@10 -- # set +x 00:30:49.841 ************************************ 00:30:49.841 END TEST nvmf_digest 00:30:49.841 ************************************ 00:30:50.099 16:55:15 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:50.099 16:55:15 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:50.099 16:55:15 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:50.099 16:55:15 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:50.099 16:55:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:50.099 16:55:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:50.099 16:55:15 -- common/autotest_common.sh@10 -- # set +x 00:30:50.099 ************************************ 00:30:50.099 START TEST nvmf_bdevperf 00:30:50.099 ************************************ 00:30:50.099 16:55:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:50.099 * Looking for test storage... 00:30:50.099 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:50.099 16:55:15 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:50.099 16:55:15 -- nvmf/common.sh@7 -- # uname -s 00:30:50.099 16:55:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:50.099 16:55:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:50.099 16:55:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:50.099 16:55:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:50.099 16:55:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:50.099 16:55:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:50.099 16:55:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:50.099 16:55:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:50.099 16:55:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:50.099 16:55:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:50.099 16:55:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:50.099 16:55:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:50.099 16:55:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:50.099 16:55:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:50.099 16:55:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:50.099 16:55:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:50.099 16:55:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:50.099 16:55:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:50.099 16:55:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:50.100 16:55:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.100 16:55:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.100 16:55:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.100 16:55:15 -- paths/export.sh@5 -- # export PATH 00:30:50.100 16:55:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.100 16:55:15 -- nvmf/common.sh@46 -- # : 0 00:30:50.100 16:55:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:50.100 16:55:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:50.100 16:55:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:50.100 16:55:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:50.100 16:55:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:50.100 16:55:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:50.100 16:55:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:50.100 16:55:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:50.100 16:55:15 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:50.100 16:55:15 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:50.100 16:55:15 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:50.100 16:55:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:50.100 16:55:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:50.100 16:55:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:50.100 16:55:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:50.100 16:55:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:50.100 16:55:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:50.100 16:55:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:50.100 16:55:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:50.100 16:55:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:50.100 16:55:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:50.100 16:55:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:50.100 16:55:15 -- common/autotest_common.sh@10 -- # set +x 00:30:51.999 16:55:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:51.999 16:55:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:51.999 16:55:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:51.999 16:55:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:51.999 16:55:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:51.999 16:55:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:51.999 16:55:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:51.999 16:55:17 -- nvmf/common.sh@294 -- # net_devs=() 00:30:51.999 16:55:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:51.999 16:55:17 -- nvmf/common.sh@295 -- # e810=() 00:30:51.999 16:55:17 -- nvmf/common.sh@295 -- # local -ga e810 00:30:51.999 16:55:17 -- nvmf/common.sh@296 -- # x722=() 00:30:51.999 16:55:17 -- nvmf/common.sh@296 -- # local -ga x722 00:30:51.999 16:55:17 -- nvmf/common.sh@297 -- # mlx=() 00:30:51.999 16:55:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:51.999 16:55:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:51.999 16:55:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:51.999 16:55:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:51.999 16:55:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:51.999 16:55:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:51.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:51.999 16:55:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:51.999 16:55:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:51.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:51.999 16:55:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:51.999 16:55:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:51.999 16:55:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:51.999 16:55:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:51.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:51.999 16:55:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:51.999 16:55:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:51.999 16:55:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:51.999 16:55:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:51.999 16:55:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:51.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:51.999 16:55:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:51.999 16:55:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:51.999 16:55:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:51.999 16:55:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:51.999 16:55:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:51.999 16:55:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:51.999 16:55:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:51.999 16:55:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:51.999 16:55:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:51.999 16:55:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:51.999 16:55:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:51.999 16:55:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:52.000 16:55:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:52.000 16:55:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:52.000 16:55:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:52.000 16:55:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:52.000 16:55:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:52.000 16:55:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:52.000 16:55:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:52.000 16:55:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:52.000 16:55:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:52.000 16:55:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:52.000 16:55:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:52.000 16:55:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:52.000 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:52.000 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:30:52.000 00:30:52.000 --- 10.0.0.2 ping statistics --- 00:30:52.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:52.000 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:30:52.000 16:55:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:52.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:52.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:30:52.000 00:30:52.000 --- 10.0.0.1 ping statistics --- 00:30:52.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:52.000 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:30:52.000 16:55:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:52.000 16:55:17 -- nvmf/common.sh@410 -- # return 0 00:30:52.000 16:55:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:52.000 16:55:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:52.000 16:55:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:52.000 16:55:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:52.000 16:55:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:52.000 16:55:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:52.000 16:55:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:52.000 16:55:17 -- host/bdevperf.sh@25 -- # tgt_init 00:30:52.000 16:55:17 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:52.000 16:55:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:52.000 16:55:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:52.000 16:55:17 -- common/autotest_common.sh@10 -- # set +x 00:30:52.000 16:55:17 -- nvmf/common.sh@469 -- # nvmfpid=1327450 00:30:52.000 16:55:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:52.000 16:55:17 -- nvmf/common.sh@470 -- # waitforlisten 1327450 00:30:52.000 16:55:17 -- common/autotest_common.sh@819 -- # '[' -z 1327450 ']' 00:30:52.000 16:55:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:52.000 16:55:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:52.000 16:55:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:52.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:52.000 16:55:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:52.000 16:55:17 -- common/autotest_common.sh@10 -- # set +x 00:30:52.258 [2024-10-13 16:55:17.537523] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:52.258 [2024-10-13 16:55:17.537596] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:52.258 EAL: No free 2048 kB hugepages reported on node 1 00:30:52.258 [2024-10-13 16:55:17.607955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:52.258 [2024-10-13 16:55:17.699155] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:52.258 [2024-10-13 16:55:17.699323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:52.258 [2024-10-13 16:55:17.699341] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:52.258 [2024-10-13 16:55:17.699353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:52.258 [2024-10-13 16:55:17.699433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:52.258 [2024-10-13 16:55:17.699461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:52.258 [2024-10-13 16:55:17.699464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:53.191 16:55:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:53.191 16:55:18 -- common/autotest_common.sh@852 -- # return 0 00:30:53.191 16:55:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:53.191 16:55:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.191 16:55:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:53.191 16:55:18 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:53.191 16:55:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.191 [2024-10-13 16:55:18.566412] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:53.191 16:55:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:53.191 16:55:18 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:53.191 16:55:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.191 Malloc0 00:30:53.191 16:55:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:53.191 16:55:18 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:53.191 16:55:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.191 16:55:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:53.191 16:55:18 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:53.191 16:55:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.191 16:55:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:53.191 16:55:18 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:53.191 16:55:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:53.191 16:55:18 -- common/autotest_common.sh@10 -- # set +x 00:30:53.192 [2024-10-13 16:55:18.629710] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:53.192 16:55:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:53.192 16:55:18 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:53.192 16:55:18 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:53.192 16:55:18 -- nvmf/common.sh@520 -- # config=() 00:30:53.192 16:55:18 -- nvmf/common.sh@520 -- # local subsystem config 00:30:53.192 16:55:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:53.192 16:55:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:53.192 { 00:30:53.192 "params": { 00:30:53.192 "name": "Nvme$subsystem", 00:30:53.192 "trtype": "$TEST_TRANSPORT", 00:30:53.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:53.192 "adrfam": "ipv4", 00:30:53.192 "trsvcid": "$NVMF_PORT", 00:30:53.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:53.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:53.192 "hdgst": ${hdgst:-false}, 00:30:53.192 "ddgst": ${ddgst:-false} 00:30:53.192 }, 00:30:53.192 "method": "bdev_nvme_attach_controller" 00:30:53.192 } 00:30:53.192 EOF 00:30:53.192 )") 00:30:53.192 16:55:18 -- nvmf/common.sh@542 -- # cat 00:30:53.192 16:55:18 -- nvmf/common.sh@544 -- # jq . 00:30:53.192 16:55:18 -- nvmf/common.sh@545 -- # IFS=, 00:30:53.192 16:55:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:53.192 "params": { 00:30:53.192 "name": "Nvme1", 00:30:53.192 "trtype": "tcp", 00:30:53.192 "traddr": "10.0.0.2", 00:30:53.192 "adrfam": "ipv4", 00:30:53.192 "trsvcid": "4420", 00:30:53.192 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:53.192 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:53.192 "hdgst": false, 00:30:53.192 "ddgst": false 00:30:53.192 }, 00:30:53.192 "method": "bdev_nvme_attach_controller" 00:30:53.192 }' 00:30:53.192 [2024-10-13 16:55:18.676366] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:53.192 [2024-10-13 16:55:18.676455] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1327605 ] 00:30:53.450 EAL: No free 2048 kB hugepages reported on node 1 00:30:53.450 [2024-10-13 16:55:18.735876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:53.450 [2024-10-13 16:55:18.823749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:53.708 Running I/O for 1 seconds... 00:30:54.639 00:30:54.639 Latency(us) 00:30:54.639 [2024-10-13T14:55:20.140Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:54.639 [2024-10-13T14:55:20.140Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:54.639 Verification LBA range: start 0x0 length 0x4000 00:30:54.639 Nvme1n1 : 1.01 12066.99 47.14 0.00 0.00 10559.96 989.11 17961.72 00:30:54.639 [2024-10-13T14:55:20.140Z] =================================================================================================================== 00:30:54.639 [2024-10-13T14:55:20.140Z] Total : 12066.99 47.14 0.00 0.00 10559.96 989.11 17961.72 00:30:54.897 16:55:20 -- host/bdevperf.sh@30 -- # bdevperfpid=1327754 00:30:54.897 16:55:20 -- host/bdevperf.sh@32 -- # sleep 3 00:30:54.897 16:55:20 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:54.897 16:55:20 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:54.897 16:55:20 -- nvmf/common.sh@520 -- # config=() 00:30:54.897 16:55:20 -- nvmf/common.sh@520 -- # local subsystem config 00:30:54.897 16:55:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:54.897 16:55:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:54.897 { 00:30:54.897 "params": { 00:30:54.897 "name": "Nvme$subsystem", 00:30:54.897 "trtype": "$TEST_TRANSPORT", 00:30:54.897 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:54.897 "adrfam": "ipv4", 00:30:54.897 "trsvcid": "$NVMF_PORT", 00:30:54.897 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:54.897 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:54.897 "hdgst": ${hdgst:-false}, 00:30:54.897 "ddgst": ${ddgst:-false} 00:30:54.897 }, 00:30:54.897 "method": "bdev_nvme_attach_controller" 00:30:54.897 } 00:30:54.897 EOF 00:30:54.897 )") 00:30:54.897 16:55:20 -- nvmf/common.sh@542 -- # cat 00:30:54.897 16:55:20 -- nvmf/common.sh@544 -- # jq . 00:30:54.897 16:55:20 -- nvmf/common.sh@545 -- # IFS=, 00:30:54.897 16:55:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:54.897 "params": { 00:30:54.897 "name": "Nvme1", 00:30:54.897 "trtype": "tcp", 00:30:54.897 "traddr": "10.0.0.2", 00:30:54.897 "adrfam": "ipv4", 00:30:54.897 "trsvcid": "4420", 00:30:54.897 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:54.897 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:54.897 "hdgst": false, 00:30:54.897 "ddgst": false 00:30:54.897 }, 00:30:54.897 "method": "bdev_nvme_attach_controller" 00:30:54.897 }' 00:30:54.897 [2024-10-13 16:55:20.284989] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:30:54.898 [2024-10-13 16:55:20.285064] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1327754 ] 00:30:54.898 EAL: No free 2048 kB hugepages reported on node 1 00:30:54.898 [2024-10-13 16:55:20.347242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:55.155 [2024-10-13 16:55:20.431336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:55.155 Running I/O for 15 seconds... 00:30:58.441 16:55:23 -- host/bdevperf.sh@33 -- # kill -9 1327450 00:30:58.441 16:55:23 -- host/bdevperf.sh@35 -- # sleep 3 00:30:58.441 [2024-10-13 16:55:23.253639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.253975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.253990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.441 [2024-10-13 16:55:23.254466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.441 [2024-10-13 16:55:23.254480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:6384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:6392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:6400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:6416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.254959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.254977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.254992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:6440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:6456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:6480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:6504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.442 [2024-10-13 16:55:23.255703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.442 [2024-10-13 16:55:23.255765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.442 [2024-10-13 16:55:23.255782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:5792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.255968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.255982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:5968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:6568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:6584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:6592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:6600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:6608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:6624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.256644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.256982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.256998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.257013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.257029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:6664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.257044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.257060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:6672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.443 [2024-10-13 16:55:23.257075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.257092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.443 [2024-10-13 16:55:23.257107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.443 [2024-10-13 16:55:23.257124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:6712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:6744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:58.444 [2024-10-13 16:55:23.257417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:6152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:6344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:58.444 [2024-10-13 16:55:23.257931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.257947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ee49a0 is same with the state(5) to be set 00:30:58.444 [2024-10-13 16:55:23.257964] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:58.444 [2024-10-13 16:55:23.257976] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:58.444 [2024-10-13 16:55:23.257989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6352 len:8 PRP1 0x0 PRP2 0x0 00:30:58.444 [2024-10-13 16:55:23.258002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.258062] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ee49a0 was disconnected and freed. reset controller. 00:30:58.444 [2024-10-13 16:55:23.258135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.444 [2024-10-13 16:55:23.258159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.258175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.444 [2024-10-13 16:55:23.258194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.258210] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.444 [2024-10-13 16:55:23.258223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.258238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.444 [2024-10-13 16:55:23.258252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.444 [2024-10-13 16:55:23.258265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.444 [2024-10-13 16:55:23.260565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.444 [2024-10-13 16:55:23.260603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.444 [2024-10-13 16:55:23.261020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.444 [2024-10-13 16:55:23.261239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.444 [2024-10-13 16:55:23.261327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.444 [2024-10-13 16:55:23.261345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.444 [2024-10-13 16:55:23.261561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.444 [2024-10-13 16:55:23.261814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.444 [2024-10-13 16:55:23.261837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.444 [2024-10-13 16:55:23.261855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.444 [2024-10-13 16:55:23.264372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.444 [2024-10-13 16:55:23.273159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.444 [2024-10-13 16:55:23.273470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.444 [2024-10-13 16:55:23.273636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.273666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.273684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.273885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.274071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.274093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.274108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.276470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.285669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.285974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.286160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.286206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.286230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.286359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.286545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.286570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.286586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.288876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.298286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.298549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.298685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.298713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.298731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.298930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.299135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.299157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.299173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.301554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.310888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.311166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.311298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.311327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.311344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.311566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.311736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.311759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.311775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.313993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.323490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.323795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.323918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.323946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.323963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.324133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.324337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.324360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.324375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.326698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.335864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.336200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.336333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.336361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.336378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.336559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.336712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.336735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.336750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.339056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.348362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.348621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.348869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.348911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.348928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.349129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.349280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.349302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.349317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.351656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.360887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.361178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.361363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.361388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.445 [2024-10-13 16:55:23.361434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.445 [2024-10-13 16:55:23.361638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.445 [2024-10-13 16:55:23.361807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.445 [2024-10-13 16:55:23.361830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.445 [2024-10-13 16:55:23.361845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.445 [2024-10-13 16:55:23.364152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.445 [2024-10-13 16:55:23.373532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.445 [2024-10-13 16:55:23.373783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.445 [2024-10-13 16:55:23.373908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.373936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.373954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.374119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.374323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.374346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.374361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.376508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.386200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.386504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.386647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.386674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.386690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.386897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.387030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.387053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.387068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.389370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.398798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.399132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.399297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.399327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.399345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.399549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.399726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.399750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.399765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.402019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.411310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.411610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.411738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.411768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.411786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.411987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.412102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.412125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.412140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.414370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.423982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.424234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.424362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.424391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.424426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.424612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.424744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.424767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.424782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.427400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.436680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.436987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.437108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.437134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.437150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.437312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.437533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.437564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.437581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.440037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.449183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.449478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.449608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.449637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.449655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.449802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.450024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.450047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.450062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.452709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.461760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.462054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.462142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.462170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.462188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.462353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.462540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.462565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.462580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.464835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.474483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.474776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.474979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.475007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.475024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.475189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.475375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.475411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.446 [2024-10-13 16:55:23.475440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.446 [2024-10-13 16:55:23.477823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.446 [2024-10-13 16:55:23.487132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.446 [2024-10-13 16:55:23.487503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.487643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.446 [2024-10-13 16:55:23.487683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.446 [2024-10-13 16:55:23.487699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.446 [2024-10-13 16:55:23.487843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.446 [2024-10-13 16:55:23.488053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.446 [2024-10-13 16:55:23.488076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.488091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.490687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.499901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.500236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.500385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.500424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.500442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.500616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.500749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.500772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.500786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.503040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.512453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.512744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.512869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.512898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.512917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.513082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.513287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.513310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.513325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.515605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.524933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.525220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.525364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.525402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.525431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.525617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.525768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.525790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.525805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.527970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.537468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.537826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.538011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.538068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.538086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.538214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.538431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.538455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.538470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.540829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.550127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.550412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.550533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.550561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.550579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.550726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.550877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.550899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.550914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.553292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.562711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.563031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.563174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.563219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.563237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.563414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.563587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.563610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.563625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.565805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.575205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.575538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.575691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.575719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.575737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.575919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.576088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.576111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.576126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.578531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.587859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.588190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.588341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.588369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.588387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.588599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.588769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.588791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.588807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.591191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.600647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.447 [2024-10-13 16:55:23.600962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.601117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.447 [2024-10-13 16:55:23.601146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.447 [2024-10-13 16:55:23.601163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.447 [2024-10-13 16:55:23.601346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.447 [2024-10-13 16:55:23.601561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.447 [2024-10-13 16:55:23.601585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.447 [2024-10-13 16:55:23.601600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.447 [2024-10-13 16:55:23.604014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.447 [2024-10-13 16:55:23.613305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.613571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.613712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.613740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.613758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.613922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.614090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.614114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.614129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.616283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.625845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.626156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.626281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.626309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.626327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.626473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.626661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.626685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.626699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.628952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.638489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.638853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.639006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.639040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.639059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.639241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.639391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.639432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.639448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.641776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.651071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.651374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.651522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.651551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.651569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.651715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.651902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.651925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.651940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.654293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.663499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.663832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.663984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.664013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.664030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.664194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.664326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.664349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.664363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.666634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.676038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.676386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.676557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.676585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.676608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.676756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.676961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.676984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.676999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.679467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.688559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.688944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.689118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.689146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.689164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.689382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.689534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.689558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.689573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.691756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.701439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.701833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.702025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.702072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.702090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.702236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.702387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.702424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.702439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.704637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.713814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.714163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.714320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.714348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.448 [2024-10-13 16:55:23.714365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.448 [2024-10-13 16:55:23.714527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.448 [2024-10-13 16:55:23.714750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.448 [2024-10-13 16:55:23.714774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.448 [2024-10-13 16:55:23.714789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.448 [2024-10-13 16:55:23.717202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.448 [2024-10-13 16:55:23.726447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.448 [2024-10-13 16:55:23.726854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.726975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.448 [2024-10-13 16:55:23.727003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.727020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.727239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.727390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.727431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.727450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.729854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.738972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.739387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.739566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.739595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.739612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.739777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.739964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.739987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.740002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.742202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.751576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.751945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.752078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.752106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.752124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.752305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.752510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.752535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.752550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.754827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.764255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.764561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.764768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.764818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.764836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.765002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.765170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.765193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.765208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.767505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.776905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.777256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.777411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.777441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.777459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.777624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.777756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.777779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.777794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.780148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.789475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.789810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.790026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.790082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.790099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.790262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.790423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.790453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.790468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.792896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.801975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.802309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.802410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.802440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.802458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.802623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.802792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.802815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.802829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.805174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.814495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.814893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.815087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.815116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.815133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.815297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.815474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.815498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.815513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.449 [2024-10-13 16:55:23.817814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.449 [2024-10-13 16:55:23.827067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.449 [2024-10-13 16:55:23.827449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.449 [2024-10-13 16:55:23.827561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.449 [2024-10-13 16:55:23.827577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.449 [2024-10-13 16:55:23.827774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.449 [2024-10-13 16:55:23.827921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.449 [2024-10-13 16:55:23.827941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.449 [2024-10-13 16:55:23.827959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.830265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.839606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.840011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.840115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.840141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.840157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.840350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.840580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.840603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.840616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.842663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.852384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.852668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.852833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.852862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.852879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.853044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.853158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.853181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.853196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.855590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.864808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.865179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.865333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.865362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.865380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.865557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.865762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.865785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.865800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.868260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.877369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.877664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.877859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.877904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.877922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.878068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.878183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.878205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.878220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.880534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.889767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.890063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.890188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.890216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.890234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.890425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.890577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.890596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.890609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.892792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.902322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.902685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.902845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.902873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.902891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.903056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.903206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.903229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.903243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.905708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.914778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.915082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.915186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.915216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.450 [2024-10-13 16:55:23.915234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.450 [2024-10-13 16:55:23.915408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.450 [2024-10-13 16:55:23.915578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.450 [2024-10-13 16:55:23.915601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.450 [2024-10-13 16:55:23.915615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.450 [2024-10-13 16:55:23.918001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.450 [2024-10-13 16:55:23.927252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.450 [2024-10-13 16:55:23.927600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.450 [2024-10-13 16:55:23.927825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.451 [2024-10-13 16:55:23.927865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.451 [2024-10-13 16:55:23.927881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.451 [2024-10-13 16:55:23.928050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.451 [2024-10-13 16:55:23.928219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.451 [2024-10-13 16:55:23.928241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.451 [2024-10-13 16:55:23.928256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.451 [2024-10-13 16:55:23.930580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:23.939860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:23.940154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.940302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.940327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:23.940344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:23.940547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:23.940700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:23.940722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:23.940737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.710 [2024-10-13 16:55:23.943069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:23.952531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:23.952787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.952920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.952949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:23.952967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:23.953133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:23.953320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:23.953344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:23.953359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.710 [2024-10-13 16:55:23.955669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:23.965096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:23.965388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.965537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.965563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:23.965579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:23.965796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:23.965965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:23.965988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:23.966003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.710 [2024-10-13 16:55:23.968270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:23.977524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:23.977831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.977957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.977985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:23.978003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:23.978149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:23.978353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:23.978376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:23.978391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.710 [2024-10-13 16:55:23.980515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:23.989926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:23.990232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.990382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:23.990444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:23.990462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:23.990642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:23.990822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:23.990846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:23.990860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.710 [2024-10-13 16:55:23.993212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.710 [2024-10-13 16:55:24.002431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.710 [2024-10-13 16:55:24.002796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:24.002926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.710 [2024-10-13 16:55:24.002954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.710 [2024-10-13 16:55:24.002973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.710 [2024-10-13 16:55:24.003210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.710 [2024-10-13 16:55:24.003379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.710 [2024-10-13 16:55:24.003413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.710 [2024-10-13 16:55:24.003429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.005757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.015065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.015445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.015555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.015584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.015603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.015750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.015919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.015942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.015958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.018242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.027622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.027908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.028037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.028067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.028090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.028221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.028371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.028407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.028435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.030764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.040074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.040410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.040574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.040603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.040621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.040785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.040954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.040978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.040993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.043161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.052624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.052941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.053061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.053090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.053107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.053308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.053508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.053532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.053547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.055856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.065289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.065589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.065709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.065738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.065755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.065889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.066022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.066045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.066060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.068272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.077888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.078203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.078354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.078382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.078417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.078589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.078758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.078781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.078796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.080988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.090456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.090746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.090884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.090908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.090923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.091092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.091297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.091321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.091336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.093775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.102888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.103199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.103333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.103362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.103380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.103554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.103751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.103775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.103790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.106183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.115357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.115640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.115769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.115798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.115815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.115962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.116149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.711 [2024-10-13 16:55:24.116172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.711 [2024-10-13 16:55:24.116187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.711 [2024-10-13 16:55:24.118485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.711 [2024-10-13 16:55:24.127945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.711 [2024-10-13 16:55:24.128255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.128381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.711 [2024-10-13 16:55:24.128431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.711 [2024-10-13 16:55:24.128448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.711 [2024-10-13 16:55:24.128595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.711 [2024-10-13 16:55:24.128804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.128827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.128842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.131312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.140474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.140822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.140930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.140959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.140977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.141142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.141292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.141320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.141336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.143665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.153074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.153338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.153441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.153471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.153489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.153671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.153820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.153844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.153858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.156078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.165601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.165889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.166043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.166071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.166088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.166235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.166439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.166464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.166480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.168859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.178150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.178445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.178568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.178597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.178615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.178779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.178948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.178971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.178992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.181273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.190884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.191214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.191319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.191348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.191366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.191530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.191718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.191741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.191756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.194161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.712 [2024-10-13 16:55:24.203554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.712 [2024-10-13 16:55:24.203842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.203943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.712 [2024-10-13 16:55:24.203984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.712 [2024-10-13 16:55:24.204000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.712 [2024-10-13 16:55:24.204157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.712 [2024-10-13 16:55:24.204387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.712 [2024-10-13 16:55:24.204427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.712 [2024-10-13 16:55:24.204445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.712 [2024-10-13 16:55:24.206681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.216077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.216367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.216531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.216560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.216577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.216687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.216838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.216861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.216875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.219184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.228473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.228779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.228931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.228959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.228977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.229141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.229273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.229296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.229310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.231582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.241003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.241339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.241451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.241482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.241500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.241646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.241869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.241892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.241907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.244270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.253708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.254017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.254184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.254209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.254224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.254365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.254596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.254620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.254635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.256959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.265989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.266284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.266376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.266419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.266442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.266572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.266776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.266800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.266815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.269090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.278679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.278973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.279061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.279090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.279109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.279292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.279529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.279554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.972 [2024-10-13 16:55:24.279569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.972 [2024-10-13 16:55:24.281861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.972 [2024-10-13 16:55:24.291113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.972 [2024-10-13 16:55:24.291448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.291549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.972 [2024-10-13 16:55:24.291577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.972 [2024-10-13 16:55:24.291594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.972 [2024-10-13 16:55:24.291759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.972 [2024-10-13 16:55:24.291964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.972 [2024-10-13 16:55:24.291987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.292001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.294495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.303515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.303847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.304003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.304032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.304049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.304196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.304364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.304387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.304415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.306788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.316092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.316410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.316613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.316639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.316655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.316849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.317036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.317059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.317073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.319284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.328616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.328932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.329074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.329103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.329120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.329285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.329491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.329516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.329531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.331840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.341136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.341431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.341587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.341630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.341649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.341868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.342018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.342041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.342055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.344507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.354038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.354389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.354550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.354578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.354595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.354741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.354873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.354895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.354910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.357354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.366549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.366836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.366961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.366986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.367002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.367159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.367382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.367422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.367456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.369776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.379124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.379455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.379597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.379639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.379660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.379869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.380010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.380034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.380049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.382368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.391574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.391868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.392021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.392049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.392067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.392213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.392381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.392427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.392446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.394830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.404246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.404534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.404676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.404704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.404721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.404904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.405072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.405095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.973 [2024-10-13 16:55:24.405110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.973 [2024-10-13 16:55:24.407416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.973 [2024-10-13 16:55:24.416873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.973 [2024-10-13 16:55:24.417201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.417327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.973 [2024-10-13 16:55:24.417355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.973 [2024-10-13 16:55:24.417373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.973 [2024-10-13 16:55:24.417540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.973 [2024-10-13 16:55:24.417693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.973 [2024-10-13 16:55:24.417717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.974 [2024-10-13 16:55:24.417732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.974 [2024-10-13 16:55:24.420007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.974 [2024-10-13 16:55:24.429470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.974 [2024-10-13 16:55:24.429772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.429873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.429901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.974 [2024-10-13 16:55:24.429918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.974 [2024-10-13 16:55:24.430118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.974 [2024-10-13 16:55:24.430287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.974 [2024-10-13 16:55:24.430311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.974 [2024-10-13 16:55:24.430326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.974 [2024-10-13 16:55:24.432562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.974 [2024-10-13 16:55:24.442245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.974 [2024-10-13 16:55:24.442520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.442675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.442704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.974 [2024-10-13 16:55:24.442721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.974 [2024-10-13 16:55:24.442870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.974 [2024-10-13 16:55:24.443073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.974 [2024-10-13 16:55:24.443097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.974 [2024-10-13 16:55:24.443111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.974 [2024-10-13 16:55:24.445638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.974 [2024-10-13 16:55:24.454931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.974 [2024-10-13 16:55:24.455224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.455318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.455346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.974 [2024-10-13 16:55:24.455364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.974 [2024-10-13 16:55:24.455544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.974 [2024-10-13 16:55:24.455739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.974 [2024-10-13 16:55:24.455763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.974 [2024-10-13 16:55:24.455778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.974 [2024-10-13 16:55:24.457886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:58.974 [2024-10-13 16:55:24.467471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:58.974 [2024-10-13 16:55:24.467772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.467896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:58.974 [2024-10-13 16:55:24.467921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:58.974 [2024-10-13 16:55:24.467937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:58.974 [2024-10-13 16:55:24.468094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:58.974 [2024-10-13 16:55:24.468245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:58.974 [2024-10-13 16:55:24.468268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:58.974 [2024-10-13 16:55:24.468283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:58.974 [2024-10-13 16:55:24.470569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.233 [2024-10-13 16:55:24.480014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.233 [2024-10-13 16:55:24.480360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.480509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.480536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.233 [2024-10-13 16:55:24.480552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.233 [2024-10-13 16:55:24.480766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.233 [2024-10-13 16:55:24.480963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.233 [2024-10-13 16:55:24.480986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.233 [2024-10-13 16:55:24.481001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.233 [2024-10-13 16:55:24.483383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.233 [2024-10-13 16:55:24.492548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.233 [2024-10-13 16:55:24.492850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.493019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.493044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.233 [2024-10-13 16:55:24.493060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.233 [2024-10-13 16:55:24.493251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.233 [2024-10-13 16:55:24.493428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.233 [2024-10-13 16:55:24.493460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.233 [2024-10-13 16:55:24.493475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.233 [2024-10-13 16:55:24.495727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.233 [2024-10-13 16:55:24.505002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.233 [2024-10-13 16:55:24.505336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.505461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.505490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.233 [2024-10-13 16:55:24.505506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.233 [2024-10-13 16:55:24.505696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.233 [2024-10-13 16:55:24.505865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.233 [2024-10-13 16:55:24.505888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.233 [2024-10-13 16:55:24.505903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.233 [2024-10-13 16:55:24.508319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.233 [2024-10-13 16:55:24.517431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.233 [2024-10-13 16:55:24.517691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.517817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.517870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.233 [2024-10-13 16:55:24.517889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.233 [2024-10-13 16:55:24.518071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.233 [2024-10-13 16:55:24.518257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.233 [2024-10-13 16:55:24.518281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.233 [2024-10-13 16:55:24.518296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.233 [2024-10-13 16:55:24.520720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.233 [2024-10-13 16:55:24.529977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.233 [2024-10-13 16:55:24.530228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.530358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.233 [2024-10-13 16:55:24.530387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.233 [2024-10-13 16:55:24.530422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.233 [2024-10-13 16:55:24.530610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.233 [2024-10-13 16:55:24.530797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.530820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.530842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.533316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.542619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.543015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.543165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.543193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.543210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.543440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.543628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.543651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.543666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.545936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.554961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.555332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.555525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.555554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.555572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.555755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.555941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.555964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.555979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.558308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.567474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.567762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.567968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.567998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.568016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.568181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.568385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.568426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.568445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.570817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.579984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.580411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.580573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.580620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.580638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.580802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.581006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.581029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.581044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.583355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.592378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.592838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.592968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.592999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.593018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.593219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.593370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.593404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.593433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.595779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.604875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.605155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.605286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.605314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.605332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.605471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.605623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.605646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.605661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.607824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.617303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.617607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.617741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.617770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.617787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.617934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.618103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.618126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.618141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.620666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.629867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.630150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.630282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.630311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.234 [2024-10-13 16:55:24.630328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.234 [2024-10-13 16:55:24.630498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.234 [2024-10-13 16:55:24.630705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.234 [2024-10-13 16:55:24.630728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.234 [2024-10-13 16:55:24.630743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.234 [2024-10-13 16:55:24.633074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.234 [2024-10-13 16:55:24.642410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.234 [2024-10-13 16:55:24.642695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.234 [2024-10-13 16:55:24.642789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.642817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.642834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.642981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.643149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.643173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.643188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.645345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.655023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.655352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.655502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.655531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.655549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.655732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.655918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.655942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.655957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.658322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.667587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.667944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.668095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.668124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.668141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.668323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.668550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.668576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.668592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.670811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.680131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.680424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.680614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.680678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.680695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.680913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.681099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.681122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.681137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.683520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.692617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.692853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.692980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.693017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.693035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.693236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.693443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.693469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.693484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.695609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.705068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.705447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.705478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.705497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.705644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.705831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.705855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.705870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.708199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.717695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.717970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.718083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.718107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.718123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.718326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.718519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.718545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.718560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.235 [2024-10-13 16:55:24.720813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.235 [2024-10-13 16:55:24.730348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.235 [2024-10-13 16:55:24.730660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.730784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.235 [2024-10-13 16:55:24.730813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.235 [2024-10-13 16:55:24.730836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.235 [2024-10-13 16:55:24.731002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.235 [2024-10-13 16:55:24.731135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.235 [2024-10-13 16:55:24.731157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.235 [2024-10-13 16:55:24.731172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.733577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.743031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.743284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.743417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.743450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.743468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.743616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.743766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.743789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.743804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.746130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.755546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.755799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.755968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.755997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.756015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.756161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.756294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.756317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.756331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.758676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.768150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.768436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.768533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.768562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.768580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.768805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.768974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.768997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.769012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.771196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.780900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.781187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.781351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.781379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.781407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.781556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.781741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.781764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.781779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.784140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.793549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.793811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.793941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.793969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.793987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.794152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.794284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.794306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.794322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.796719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.806257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.806587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.806734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.806760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.806776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.806905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.807099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.807123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.807138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.809626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.818988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.819280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.819413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.819448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.819468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.819650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.819818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.819841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.819856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.822054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.831599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.831829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.831977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.832006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.832023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.832188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.832403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.832433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.832449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.834848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.843946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.495 [2024-10-13 16:55:24.844249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.844386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.495 [2024-10-13 16:55:24.844429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.495 [2024-10-13 16:55:24.844450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.495 [2024-10-13 16:55:24.844614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.495 [2024-10-13 16:55:24.844836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.495 [2024-10-13 16:55:24.844865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.495 [2024-10-13 16:55:24.844880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.495 [2024-10-13 16:55:24.847293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.495 [2024-10-13 16:55:24.856387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.856700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.856852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.856880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.856898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.857044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.857176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.857199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.857214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.859616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.868870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.869173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.869332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.869361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.869378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.869556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.869711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.869734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.869750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.872309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.881719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.882042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.882143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.882167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.882182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.882343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.882569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.882591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.882610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.884908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.894222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.894531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.894633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.894675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.894693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.894857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.894991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.895013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.895028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.897327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.906562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.906882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.907034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.907062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.907080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.907245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.907432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.907471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.907484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.909811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.919197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.919512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.919633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.919658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.919689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.919873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.920005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.920028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.920043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.922528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.931541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.931868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.932019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.932047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.932065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.932211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.932410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.932434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.932449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.934538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.944117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.944422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.944559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.944599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.944616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.944841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.945064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.945088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.945102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.947375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.956757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.957023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.957176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.957204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.957222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.957386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.957547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.957570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.957585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.959902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.496 [2024-10-13 16:55:24.969325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.496 [2024-10-13 16:55:24.969607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.969707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.496 [2024-10-13 16:55:24.969733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.496 [2024-10-13 16:55:24.969748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.496 [2024-10-13 16:55:24.969880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.496 [2024-10-13 16:55:24.970017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.496 [2024-10-13 16:55:24.970038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.496 [2024-10-13 16:55:24.970051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.496 [2024-10-13 16:55:24.972519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.497 [2024-10-13 16:55:24.982029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.497 [2024-10-13 16:55:24.982359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.497 [2024-10-13 16:55:24.982505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.497 [2024-10-13 16:55:24.982531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.497 [2024-10-13 16:55:24.982547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.497 [2024-10-13 16:55:24.982713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.497 [2024-10-13 16:55:24.982881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.497 [2024-10-13 16:55:24.982904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.497 [2024-10-13 16:55:24.982919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.497 [2024-10-13 16:55:24.985256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.497 [2024-10-13 16:55:24.994629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:24.994943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:24.995104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:24.995132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:24.995150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:24.995314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:24.995477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:24.995500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:24.995514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:24.997719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.007140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.007447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.007596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.007621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.007637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.007814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:25.008037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:25.008060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:25.008074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:25.010376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.019756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.020034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.020163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.020193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.020210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.020429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:25.020586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:25.020609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:25.020624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:25.022914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.032308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.032618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.032836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.032861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.032877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.033039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:25.033226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:25.033248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:25.033262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:25.035521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.044823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.045227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.045350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.045384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.045413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.045597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:25.045766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:25.045789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:25.045805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:25.048149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.057481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.057795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.057953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.057982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.058000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.058165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.754 [2024-10-13 16:55:25.058334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.754 [2024-10-13 16:55:25.058357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.754 [2024-10-13 16:55:25.058372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.754 [2024-10-13 16:55:25.060553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.754 [2024-10-13 16:55:25.069943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.754 [2024-10-13 16:55:25.070272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.070430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.754 [2024-10-13 16:55:25.070458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.754 [2024-10-13 16:55:25.070474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.754 [2024-10-13 16:55:25.070588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.070709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.070732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.070747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.073053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.082385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.082715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.082812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.082841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.082865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.083031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.083218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.083250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.083265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.085573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.094944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.095210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.095328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.095358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.095376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.095568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.095719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.095743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.095758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.098102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.107504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.107774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.107893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.107921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.107939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.108122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.108309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.108332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.108347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.110836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.120052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.120344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.120453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.120483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.120501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.120636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.120786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.120809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.120824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.123072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.132513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.132816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.132936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.132963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.132981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.133127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.133277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.133300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.133315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.135773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.145197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.145522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.145675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.145710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.145728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.145874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.146043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.146065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.146081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.148637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.157808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.158093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.158244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.158273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.158291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.158446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.158586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.158609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.158624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.161013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.170545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.170832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.170960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.170989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.171007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.171153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.171303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.171326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.171341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.173561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.183067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.183359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.183495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.183525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.183542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.183689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.183857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.183880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.183895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.186274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.195681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.196012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.196164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.196192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.196209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.196422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.196573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.196603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.196619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.199034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.208176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.208510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.208663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.208691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.208709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.208874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.209024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.209047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.209061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.211366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.220951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.221213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.221435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.221462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.221479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.221649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.221800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.221822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.221837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.224282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.233744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.234125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.234297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.234326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.234343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.234472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.234661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.234684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.234704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.237278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:59.755 [2024-10-13 16:55:25.246352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:59.755 [2024-10-13 16:55:25.246615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.246770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:59.755 [2024-10-13 16:55:25.246799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:30:59.755 [2024-10-13 16:55:25.246817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:30:59.755 [2024-10-13 16:55:25.246999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:30:59.755 [2024-10-13 16:55:25.247171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:59.755 [2024-10-13 16:55:25.247194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:59.755 [2024-10-13 16:55:25.247209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:59.755 [2024-10-13 16:55:25.249582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.259133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.259445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.259567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.259595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.259612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.259777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.259946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.259969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.259984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.262248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.271627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.271920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.272123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.272149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.272165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.272280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.272500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.272525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.272540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.274874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.284124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.284424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.284550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.284579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.284596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.284725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.284875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.284898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.284913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.287203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.296677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.296972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.297144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.297169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.297185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.297330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.297530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.297555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.297570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.299859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.309274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.309720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.309882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.309908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.309923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.310152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.310320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.310343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.310358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.312610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.321944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.322290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.322514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.322569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.322587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.322752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.322920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.322943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.322957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.325227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.334493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.334751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.334869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.334897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.334915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.335097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.335284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.335306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.335321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.337717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.347123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.347467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.347622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.347650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.347668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.014 [2024-10-13 16:55:25.347832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.014 [2024-10-13 16:55:25.347982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.014 [2024-10-13 16:55:25.348005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.014 [2024-10-13 16:55:25.348020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.014 [2024-10-13 16:55:25.350508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.014 [2024-10-13 16:55:25.359355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.014 [2024-10-13 16:55:25.359704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.359857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.014 [2024-10-13 16:55:25.359886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.014 [2024-10-13 16:55:25.359903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.360068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.360200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.360223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.360238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.362494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.371943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.372274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.372429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.372460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.372477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.372660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.372864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.372887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.372902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.374938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.384507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.384784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.384906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.384934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.384951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.385116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.385266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.385288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.385303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.387576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.397074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.397386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.397517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.397550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.397569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.397733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.397920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.397943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.397958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.400368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.409647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.409944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.410099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.410128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.410145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.410328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.410479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.410504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.410519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.413041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.422276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.422553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.422746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.422762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.422875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.423041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.423064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.423080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.425309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.434710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.435002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.435122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.435150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.435173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.435357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.435579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.435605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.435620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.437835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.447105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.447414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.447539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.447568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.447586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.447732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.447883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.447907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.447921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.450312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.459847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.460164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.460314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.460339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.460355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.460600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.460771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.460794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.460809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.463280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.472282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.472662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.472805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.472836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.015 [2024-10-13 16:55:25.472853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.015 [2024-10-13 16:55:25.473006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.015 [2024-10-13 16:55:25.473210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.015 [2024-10-13 16:55:25.473234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.015 [2024-10-13 16:55:25.473249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.015 [2024-10-13 16:55:25.475593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.015 [2024-10-13 16:55:25.484749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.015 [2024-10-13 16:55:25.485074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.015 [2024-10-13 16:55:25.485255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.016 [2024-10-13 16:55:25.485272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.016 [2024-10-13 16:55:25.485493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.016 [2024-10-13 16:55:25.485664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.016 [2024-10-13 16:55:25.485687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.016 [2024-10-13 16:55:25.485701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.016 [2024-10-13 16:55:25.488082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.016 [2024-10-13 16:55:25.497507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.016 [2024-10-13 16:55:25.497792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-10-13 16:55:25.497997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-10-13 16:55:25.498023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.016 [2024-10-13 16:55:25.498039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.016 [2024-10-13 16:55:25.498236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.016 [2024-10-13 16:55:25.498480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.016 [2024-10-13 16:55:25.498506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.016 [2024-10-13 16:55:25.498521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.016 [2024-10-13 16:55:25.500959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.016 [2024-10-13 16:55:25.510139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.016 [2024-10-13 16:55:25.510452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-10-13 16:55:25.510562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.016 [2024-10-13 16:55:25.510591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.016 [2024-10-13 16:55:25.510608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.016 [2024-10-13 16:55:25.510773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.016 [2024-10-13 16:55:25.510929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.016 [2024-10-13 16:55:25.510953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.016 [2024-10-13 16:55:25.510968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.016 [2024-10-13 16:55:25.513283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.275 [2024-10-13 16:55:25.522657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.275 [2024-10-13 16:55:25.522914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.523067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.523095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.275 [2024-10-13 16:55:25.523112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.275 [2024-10-13 16:55:25.523312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.275 [2024-10-13 16:55:25.523483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.275 [2024-10-13 16:55:25.523508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.275 [2024-10-13 16:55:25.523524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.275 [2024-10-13 16:55:25.525832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.275 [2024-10-13 16:55:25.535013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.275 [2024-10-13 16:55:25.535296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.535445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.535476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.275 [2024-10-13 16:55:25.535494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.275 [2024-10-13 16:55:25.535623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.275 [2024-10-13 16:55:25.535774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.275 [2024-10-13 16:55:25.535797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.275 [2024-10-13 16:55:25.535812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.275 [2024-10-13 16:55:25.538063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.275 [2024-10-13 16:55:25.547509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.275 [2024-10-13 16:55:25.547787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.547935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.547960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.275 [2024-10-13 16:55:25.547976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.275 [2024-10-13 16:55:25.548120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.275 [2024-10-13 16:55:25.548302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.275 [2024-10-13 16:55:25.548331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.275 [2024-10-13 16:55:25.548346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.275 [2024-10-13 16:55:25.550681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.275 [2024-10-13 16:55:25.560055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.275 [2024-10-13 16:55:25.560316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.560472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.560503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.275 [2024-10-13 16:55:25.560520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.275 [2024-10-13 16:55:25.560685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.275 [2024-10-13 16:55:25.560854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.275 [2024-10-13 16:55:25.560877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.275 [2024-10-13 16:55:25.560892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.275 [2024-10-13 16:55:25.563330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.275 [2024-10-13 16:55:25.572784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.275 [2024-10-13 16:55:25.573133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.573299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.275 [2024-10-13 16:55:25.573328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.275 [2024-10-13 16:55:25.573345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.275 [2024-10-13 16:55:25.573547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.275 [2024-10-13 16:55:25.573718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.573741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.573756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.575994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.585506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.585768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.585947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.586001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.586018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.586201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.586351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.586374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.586405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.588656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.598127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.598429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.598656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.598721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.598739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.598921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.599089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.599111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.599126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.601582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.610722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.611068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.611195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.611220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.611236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.611361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.611528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.611553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.611568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.613982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.623369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.623682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.623908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.623962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.623980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.624126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.624312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.624335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.624350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.626823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.635873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.636239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.636372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.636420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.636444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.636626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.636779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.636801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.636816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.639161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.648408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.648743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.648858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.648883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.648899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.649092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.649223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.649246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.649260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.651608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.660795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.661070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.661235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.661260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.661276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.661457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.661609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.661632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.661647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.664010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.673443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.673747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.673933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.673985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.674002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.674202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.674389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.674430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.674447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.676828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.685754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.686039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.686183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.276 [2024-10-13 16:55:25.686213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.276 [2024-10-13 16:55:25.686230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.276 [2024-10-13 16:55:25.686409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.276 [2024-10-13 16:55:25.686586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.276 [2024-10-13 16:55:25.686609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.276 [2024-10-13 16:55:25.686625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.276 [2024-10-13 16:55:25.688985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.276 [2024-10-13 16:55:25.698292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.276 [2024-10-13 16:55:25.698612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.698765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.698794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.698811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.698940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.699089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.699112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.699128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.701494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.710879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.711171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.711303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.711331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.711348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.711550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.711703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.711726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.711741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.714087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.723556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.723883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.724051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.724103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.724121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.724302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.724489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.724515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.724530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.726925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.736235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.736578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.736764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.736817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.736835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.736999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.737185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.737209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.737224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.739255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.748813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.749088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.749216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.749252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.749271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.749456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.749609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.749632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.749647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.751643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.761264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.761585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.761711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.761739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.761756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.761884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.762106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.762130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.762144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.277 [2024-10-13 16:55:25.764434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.277 [2024-10-13 16:55:25.773845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.277 [2024-10-13 16:55:25.774149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.774279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.277 [2024-10-13 16:55:25.774307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.277 [2024-10-13 16:55:25.774325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.277 [2024-10-13 16:55:25.774509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.277 [2024-10-13 16:55:25.774662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.277 [2024-10-13 16:55:25.774685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.277 [2024-10-13 16:55:25.774700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.776902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.786269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.786536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.786656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.786683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.786705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.786821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.786936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.786958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.786973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.789468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.798822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.799099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.799220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.799248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.799266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.799460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.799647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.799670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.799684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.801879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.811368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.811660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.811789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.811817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.811835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.812053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.812222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.812245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.812259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.814502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.823849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.824137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.824284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.824312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.824330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.824489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.824636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.824655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.824668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.826861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.836247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.836564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.836714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.836743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.836760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.836906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.837020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.837043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.837057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.839320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.848789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.849062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.849188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.849218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.849236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.849412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.849560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.849580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.537 [2024-10-13 16:55:25.849592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.537 [2024-10-13 16:55:25.851893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.537 [2024-10-13 16:55:25.861538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.537 [2024-10-13 16:55:25.861842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.861945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.537 [2024-10-13 16:55:25.861972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.537 [2024-10-13 16:55:25.861987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.537 [2024-10-13 16:55:25.862126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.537 [2024-10-13 16:55:25.862322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.537 [2024-10-13 16:55:25.862345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.862359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.864801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.873968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.874275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.874374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.874413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.874434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.874615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.874771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.874794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.874808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.876902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.886531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.886843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.886948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.886978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.886996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.887178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.887329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.887351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.887366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.889714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.898793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.899080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.899210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.899238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.899256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.899445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.899609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.899634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.899648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.901954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.911226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.911538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.911673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.911703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.911721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.911849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.912018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.912041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.912056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.914314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.923961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.924255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.924403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.924431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.924449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.924642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.924848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.924871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.924885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.927228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.936451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.936772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.936891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.936919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.936937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.937119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.937323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.937346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.937367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.939656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.949135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.949482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.949617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.949645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.949663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.949863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.950031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.950054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.950069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.952439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.961677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.961954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.962112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.962129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.962294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.962501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.962522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.962535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.964792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.974155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.974480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.974602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.974630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.974647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.974810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.975014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.538 [2024-10-13 16:55:25.975037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.538 [2024-10-13 16:55:25.975053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.538 [2024-10-13 16:55:25.977375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.538 [2024-10-13 16:55:25.986951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.538 [2024-10-13 16:55:25.987250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.987375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.538 [2024-10-13 16:55:25.987415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.538 [2024-10-13 16:55:25.987434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.538 [2024-10-13 16:55:25.987599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.538 [2024-10-13 16:55:25.987749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.539 [2024-10-13 16:55:25.987772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.539 [2024-10-13 16:55:25.987787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.539 [2024-10-13 16:55:25.990166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.539 [2024-10-13 16:55:25.999346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.539 [2024-10-13 16:55:25.999665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:25.999848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:25.999874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.539 [2024-10-13 16:55:25.999891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.539 [2024-10-13 16:55:26.000069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.539 [2024-10-13 16:55:26.000220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.539 [2024-10-13 16:55:26.000243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.539 [2024-10-13 16:55:26.000258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.539 [2024-10-13 16:55:26.002496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.539 [2024-10-13 16:55:26.011815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.539 [2024-10-13 16:55:26.012163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:26.012312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:26.012340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.539 [2024-10-13 16:55:26.012358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.539 [2024-10-13 16:55:26.012551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.539 [2024-10-13 16:55:26.012702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.539 [2024-10-13 16:55:26.012725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.539 [2024-10-13 16:55:26.012740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.539 [2024-10-13 16:55:26.014959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.539 [2024-10-13 16:55:26.024282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.539 [2024-10-13 16:55:26.024534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:26.024638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.539 [2024-10-13 16:55:26.024666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.539 [2024-10-13 16:55:26.024684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.539 [2024-10-13 16:55:26.024830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.539 [2024-10-13 16:55:26.024999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.539 [2024-10-13 16:55:26.025022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.539 [2024-10-13 16:55:26.025038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.539 [2024-10-13 16:55:26.027356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.798 [2024-10-13 16:55:26.036907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.798 [2024-10-13 16:55:26.037195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.798 [2024-10-13 16:55:26.037354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.798 [2024-10-13 16:55:26.037382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.798 [2024-10-13 16:55:26.037411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.798 [2024-10-13 16:55:26.037561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.798 [2024-10-13 16:55:26.037765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.798 [2024-10-13 16:55:26.037788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.798 [2024-10-13 16:55:26.037802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.798 [2024-10-13 16:55:26.040097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.798 [2024-10-13 16:55:26.049298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.798 [2024-10-13 16:55:26.049595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.798 [2024-10-13 16:55:26.049702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.798 [2024-10-13 16:55:26.049730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.798 [2024-10-13 16:55:26.049748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.798 [2024-10-13 16:55:26.049912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.798 [2024-10-13 16:55:26.050062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.798 [2024-10-13 16:55:26.050086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.798 [2024-10-13 16:55:26.050101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.052595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.061655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.061932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.062085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.062114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.062132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.062278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.062423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.062459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.062472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.064914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.074071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.074392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.074559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.074584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.074600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.074768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.074882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.074905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.074920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.077344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.086614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.086897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.087049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.087097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.087114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.087297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.087513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.087537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.087551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.089747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.099327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.099675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.099836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.099870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.099888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.100052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.100202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.100225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.100240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.102343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.111983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.112345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.112522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.112548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.112564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.112760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.112959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.112982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.112997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.115447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.124387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.124686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.124819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.124847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.124865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.125028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.125197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.125219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.125234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.127445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.137070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.137404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.137529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.137557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.137580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.137745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.137895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.137918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.137933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.140314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.149470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.149719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.149845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.149872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.149890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.150017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.150240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.150263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.150278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.152504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.162105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.162406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.162556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.162585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.799 [2024-10-13 16:55:26.162602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.799 [2024-10-13 16:55:26.162766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.799 [2024-10-13 16:55:26.162898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.799 [2024-10-13 16:55:26.162921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.799 [2024-10-13 16:55:26.162936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.799 [2024-10-13 16:55:26.165248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.799 [2024-10-13 16:55:26.174534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.799 [2024-10-13 16:55:26.174827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.799 [2024-10-13 16:55:26.174953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.174981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.174998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.175168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.175355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.175378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.175403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.177642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.187089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.187445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.187591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.187617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.187632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.187829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.188015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.188038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.188053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.190449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.199783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.200115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.200242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.200270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.200288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.200511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.200639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.200658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.200671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.202906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.212352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.212713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.212894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.212919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.212950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.213073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.213292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.213315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.213331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.215565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.224865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.225172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.225323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.225352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.225369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.225562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.225695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.225718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.225733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.227980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.237486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.237796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.237927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.237956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.237974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.238157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.238325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.238348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.238364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.240638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1327450 Killed "${NVMF_APP[@]}" "$@" 00:31:00.800 16:55:26 -- host/bdevperf.sh@36 -- # tgt_init 00:31:00.800 16:55:26 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:31:00.800 16:55:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:00.800 16:55:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:00.800 16:55:26 -- common/autotest_common.sh@10 -- # set +x 00:31:00.800 [2024-10-13 16:55:26.250131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.250470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.250589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.250614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.250636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.250784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.250970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.250993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.251008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 16:55:26 -- nvmf/common.sh@469 -- # nvmfpid=1328563 00:31:00.800 16:55:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:00.800 16:55:26 -- nvmf/common.sh@470 -- # waitforlisten 1328563 00:31:00.800 16:55:26 -- common/autotest_common.sh@819 -- # '[' -z 1328563 ']' 00:31:00.800 16:55:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:00.800 16:55:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:00.800 16:55:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:00.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:00.800 16:55:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:00.800 [2024-10-13 16:55:26.253290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 16:55:26 -- common/autotest_common.sh@10 -- # set +x 00:31:00.800 [2024-10-13 16:55:26.263024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.263320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.263474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.263500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.800 [2024-10-13 16:55:26.263516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.800 [2024-10-13 16:55:26.263632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.800 [2024-10-13 16:55:26.263830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.800 [2024-10-13 16:55:26.263853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.800 [2024-10-13 16:55:26.263868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.800 [2024-10-13 16:55:26.266309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.800 [2024-10-13 16:55:26.275556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.800 [2024-10-13 16:55:26.275815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.275955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.800 [2024-10-13 16:55:26.275981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.801 [2024-10-13 16:55:26.275996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.801 [2024-10-13 16:55:26.276144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.801 [2024-10-13 16:55:26.276296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.801 [2024-10-13 16:55:26.276316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.801 [2024-10-13 16:55:26.276335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.801 [2024-10-13 16:55:26.278518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.801 [2024-10-13 16:55:26.287708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:00.801 [2024-10-13 16:55:26.287944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.801 [2024-10-13 16:55:26.288077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:00.801 [2024-10-13 16:55:26.288102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:00.801 [2024-10-13 16:55:26.288118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:00.801 [2024-10-13 16:55:26.288334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:00.801 [2024-10-13 16:55:26.288524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:00.801 [2024-10-13 16:55:26.288546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:00.801 [2024-10-13 16:55:26.288560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:00.801 [2024-10-13 16:55:26.290515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.801 [2024-10-13 16:55:26.295626] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:31:00.801 [2024-10-13 16:55:26.295701] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:01.061 [2024-10-13 16:55:26.300167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.300503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.300620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.300646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.300662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.300825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.301015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.301035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.301047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.303014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.312375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.312688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.312806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.312831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.312847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.312959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.313120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.313145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.313158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.315265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.324568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.324849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.325026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.325051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.325066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.325243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.325387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.325428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.325442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.327507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 EAL: No free 2048 kB hugepages reported on node 1 00:31:01.061 [2024-10-13 16:55:26.336650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.337019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.337144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.337170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.337186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.337362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.337567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.337588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.337601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.339990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.349112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.349458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.349555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.349581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.349597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.349776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.349955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.349985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.350000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.352324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.361592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.361876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.361997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.362025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.362043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.362189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.362357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.362380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.362404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.364759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.365188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:01.061 [2024-10-13 16:55:26.374144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.374650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.374852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.374878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.374896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.375075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.375221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.375244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.375261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.377584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.386793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.387252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.387406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.387434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.387451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.387603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.061 [2024-10-13 16:55:26.387814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.061 [2024-10-13 16:55:26.387837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.061 [2024-10-13 16:55:26.387862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.061 [2024-10-13 16:55:26.390041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.061 [2024-10-13 16:55:26.399463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.061 [2024-10-13 16:55:26.399806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.399936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-10-13 16:55:26.399964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.061 [2024-10-13 16:55:26.399982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.061 [2024-10-13 16:55:26.400165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.400316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.400339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.400354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.402637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.412164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.412546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.412661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.412687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.412704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.412900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.413028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.413052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.413068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.415357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.424655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.425155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.425264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.425293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.425314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.425510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.425703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.425728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.425745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.427975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.436997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.437291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.437422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.437467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.437484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.437661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.437852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.437876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.437891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.440092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.449577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.449900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.450036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.450061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.450077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.450285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.450441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.450462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.450475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.452543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.454944] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:01.062 [2024-10-13 16:55:26.455069] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:01.062 [2024-10-13 16:55:26.455087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:01.062 [2024-10-13 16:55:26.455100] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:01.062 [2024-10-13 16:55:26.455155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:01.062 [2024-10-13 16:55:26.455216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:01.062 [2024-10-13 16:55:26.455219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:01.062 [2024-10-13 16:55:26.462082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.462484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.462602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.462628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.462654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.462841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.462992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.463013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.463028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.465011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.474542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.475024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.475157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.475184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.475202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.475326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.475485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.475507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.475523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.477366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.486846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.487247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.487435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.487463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.487483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.487640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.487795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.487816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.487831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.489892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.499197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.499641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.499785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.499812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.499831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.499966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.500150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.500187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.500203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.502298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.062 [2024-10-13 16:55:26.511606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.062 [2024-10-13 16:55:26.511946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.512083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-10-13 16:55:26.512109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.062 [2024-10-13 16:55:26.512127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.062 [2024-10-13 16:55:26.512264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.062 [2024-10-13 16:55:26.512385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.062 [2024-10-13 16:55:26.512414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.062 [2024-10-13 16:55:26.512430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.062 [2024-10-13 16:55:26.514638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.063 [2024-10-13 16:55:26.524037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.063 [2024-10-13 16:55:26.524481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.524598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.524626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.063 [2024-10-13 16:55:26.524645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.063 [2024-10-13 16:55:26.524888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.063 [2024-10-13 16:55:26.525056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.063 [2024-10-13 16:55:26.525076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.063 [2024-10-13 16:55:26.525092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.063 [2024-10-13 16:55:26.527006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.063 [2024-10-13 16:55:26.536526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.063 [2024-10-13 16:55:26.536837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.536941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.536967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.063 [2024-10-13 16:55:26.536984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.063 [2024-10-13 16:55:26.537105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.063 [2024-10-13 16:55:26.537267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.063 [2024-10-13 16:55:26.537288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.063 [2024-10-13 16:55:26.537302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.063 [2024-10-13 16:55:26.539290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.063 [2024-10-13 16:55:26.548858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.063 [2024-10-13 16:55:26.549108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.549232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-10-13 16:55:26.549258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.063 [2024-10-13 16:55:26.549273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.063 [2024-10-13 16:55:26.549389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.063 [2024-10-13 16:55:26.549534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.063 [2024-10-13 16:55:26.549555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.063 [2024-10-13 16:55:26.549568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.063 [2024-10-13 16:55:26.551619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.322 [2024-10-13 16:55:26.561213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.322 [2024-10-13 16:55:26.561520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.561621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.561646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.322 [2024-10-13 16:55:26.561662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.322 [2024-10-13 16:55:26.561826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.322 [2024-10-13 16:55:26.561978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.322 [2024-10-13 16:55:26.561998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.322 [2024-10-13 16:55:26.562011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.322 [2024-10-13 16:55:26.563925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.322 [2024-10-13 16:55:26.573504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.322 [2024-10-13 16:55:26.573836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.573953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.573979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.322 [2024-10-13 16:55:26.573995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.322 [2024-10-13 16:55:26.574159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.322 [2024-10-13 16:55:26.574356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.322 [2024-10-13 16:55:26.574405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.322 [2024-10-13 16:55:26.574422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.322 [2024-10-13 16:55:26.576403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.322 [2024-10-13 16:55:26.585853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.322 [2024-10-13 16:55:26.586137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.586256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.322 [2024-10-13 16:55:26.586281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.322 [2024-10-13 16:55:26.586297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.322 [2024-10-13 16:55:26.586454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.322 [2024-10-13 16:55:26.586623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.322 [2024-10-13 16:55:26.586644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.322 [2024-10-13 16:55:26.586657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.322 [2024-10-13 16:55:26.588736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.598297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.598560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.598658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.598685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.598700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.598881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.599046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.599066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.599079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.601118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.610601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.610899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.610992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.611019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.611035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.611183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.611363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.611408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.611429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.613520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.622931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.623226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.623322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.623347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.623363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.623506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.623642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.623662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.623675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.625736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.635243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.635515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.635603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.635630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.635646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.635795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.635960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.635980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.635992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.638015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.647438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.647694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.647813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.647840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.647856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.648004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.648184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.648204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.648217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.650225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.659695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.659926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.660043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.660068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.660084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.660232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.660422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.660444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.660457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.662434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.671826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.672128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.672214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.672241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.672257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.672390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.672583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.672604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.672617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.674764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.684056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.684330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.684424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.684451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.684467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.684599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.684732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.684752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.684765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.686851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.696326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.696556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.696680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.696705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.696722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.696870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.697035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.697056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.697069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.323 [2024-10-13 16:55:26.699113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.323 [2024-10-13 16:55:26.708804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.323 [2024-10-13 16:55:26.709075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.709193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.323 [2024-10-13 16:55:26.709219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.323 [2024-10-13 16:55:26.709235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.323 [2024-10-13 16:55:26.709425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.323 [2024-10-13 16:55:26.709577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.323 [2024-10-13 16:55:26.709598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.323 [2024-10-13 16:55:26.709611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.711566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.720959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.721240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.721380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.721411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.721428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.721576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.721743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.721762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.721775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.723837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.733172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.733482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.733577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.733603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.733619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.733768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.733901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.733921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.733934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.736063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.745518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.745831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.745914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.745939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.745955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.746167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.746314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.746335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.746348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.748436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.757788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.758077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.758166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.758191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.758207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.758354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.758483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.758504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.758517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.760418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.770112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.770421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.770516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.770561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.770577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.770710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.770874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.770894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.770907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.772951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.782292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.782580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.782694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.782719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.782735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.782867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.782987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.783008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.783022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.785133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.794764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.795008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.795154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.795179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.795195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.795326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.795454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.795476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.795489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.797464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.807160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.807424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.807518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.807544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.807564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.807794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.807941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.807961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.807974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.324 [2024-10-13 16:55:26.809877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.324 [2024-10-13 16:55:26.819561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.324 [2024-10-13 16:55:26.819832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.819929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.324 [2024-10-13 16:55:26.819954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.324 [2024-10-13 16:55:26.819970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.324 [2024-10-13 16:55:26.820150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.324 [2024-10-13 16:55:26.820285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.324 [2024-10-13 16:55:26.820306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.324 [2024-10-13 16:55:26.820319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.583 [2024-10-13 16:55:26.822352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.583 [2024-10-13 16:55:26.831921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.583 [2024-10-13 16:55:26.832193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.583 [2024-10-13 16:55:26.832338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.583 [2024-10-13 16:55:26.832363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.583 [2024-10-13 16:55:26.832379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.583 [2024-10-13 16:55:26.832518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.583 [2024-10-13 16:55:26.832717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.583 [2024-10-13 16:55:26.832737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.583 [2024-10-13 16:55:26.832750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.583 [2024-10-13 16:55:26.834772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.583 [2024-10-13 16:55:26.844099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.583 [2024-10-13 16:55:26.844375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.583 [2024-10-13 16:55:26.844501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.583 [2024-10-13 16:55:26.844527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.583 [2024-10-13 16:55:26.844543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.583 [2024-10-13 16:55:26.844696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.583 [2024-10-13 16:55:26.844845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.583 [2024-10-13 16:55:26.844866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.583 [2024-10-13 16:55:26.844878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.583 [2024-10-13 16:55:26.846902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.583 [2024-10-13 16:55:26.856369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.583 [2024-10-13 16:55:26.856651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.583 [2024-10-13 16:55:26.856769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.856795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.856810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.856958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.857154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.857174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.857186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.859226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.868847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.869153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.869265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.869291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.869307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.869463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.869632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.869652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.869666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.871805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.881040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.881358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.881510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.881536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.881552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.881732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.881887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.881907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.881920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.883985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.893313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.893616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.893739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.893764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.893780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.893895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.894061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.894081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.894094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.896179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.905616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.905924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.906014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.906039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.906055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.906186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.906336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.906356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.906369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.908215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.917948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.918249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.918368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.918403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.918420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.918568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.918736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.918761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.918775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.920893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.930115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.930354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.930471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.930497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.930513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.930662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.930827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.930847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.930860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.932981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.942257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.942594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.942684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.942711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.942726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.942874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.943054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.943075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.943088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.945233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.954531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.954803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.954919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.954944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.954960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.955107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.955256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.955277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.955295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.957405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.966942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.967210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.967303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.584 [2024-10-13 16:55:26.967328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.584 [2024-10-13 16:55:26.967343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.584 [2024-10-13 16:55:26.967483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.584 [2024-10-13 16:55:26.967699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.584 [2024-10-13 16:55:26.967720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.584 [2024-10-13 16:55:26.967733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.584 [2024-10-13 16:55:26.969667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.584 [2024-10-13 16:55:26.978973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.584 [2024-10-13 16:55:26.979261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:26.979400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:26.979426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:26.979441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:26.979589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:26.979708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:26.979743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:26.979756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:26.981862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:26.991214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:26.991478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:26.991558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:26.991583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:26.991598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:26.991747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:26.991880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:26.991899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:26.991913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:26.993844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.003579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.003862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.003979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.004005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.004022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.004186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.004351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.004371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.004409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.006359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.015787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.016056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.016199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.016225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.016241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.016389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.016518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.016539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.016552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.018512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.028164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.028421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.028541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.028566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.028582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.028730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.028926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.028946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.028959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.031061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.040476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.040791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.040875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.040901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.040917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.041065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.041249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.041270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.041284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.043488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.052760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.053030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.053119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.053144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.053160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.053308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.053501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.053522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.053536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.055657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.064964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.065234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.065351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.065377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.065400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.065518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.065685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.065720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.065733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.067945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.585 [2024-10-13 16:55:27.077042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.585 [2024-10-13 16:55:27.077358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.077485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.585 [2024-10-13 16:55:27.077512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.585 [2024-10-13 16:55:27.077528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.585 [2024-10-13 16:55:27.077676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.585 [2024-10-13 16:55:27.077842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.585 [2024-10-13 16:55:27.077862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.585 [2024-10-13 16:55:27.077875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.585 [2024-10-13 16:55:27.080134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.845 [2024-10-13 16:55:27.089418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.845 [2024-10-13 16:55:27.089653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.089734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.089759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.845 [2024-10-13 16:55:27.089775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.845 [2024-10-13 16:55:27.089890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.845 [2024-10-13 16:55:27.090041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.845 [2024-10-13 16:55:27.090061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.845 [2024-10-13 16:55:27.090074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.845 [2024-10-13 16:55:27.092243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.845 [2024-10-13 16:55:27.101722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.845 [2024-10-13 16:55:27.102031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.102146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.102171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.845 [2024-10-13 16:55:27.102187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.845 [2024-10-13 16:55:27.102318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.845 [2024-10-13 16:55:27.102446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.845 [2024-10-13 16:55:27.102467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.845 [2024-10-13 16:55:27.102480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.845 [2024-10-13 16:55:27.104644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.845 [2024-10-13 16:55:27.113900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.845 [2024-10-13 16:55:27.114200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.114337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.114368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.845 [2024-10-13 16:55:27.114385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.845 [2024-10-13 16:55:27.114575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.845 [2024-10-13 16:55:27.114757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.845 [2024-10-13 16:55:27.114777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.845 [2024-10-13 16:55:27.114791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.845 [2024-10-13 16:55:27.116906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.845 [2024-10-13 16:55:27.126040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.845 [2024-10-13 16:55:27.126296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.845 [2024-10-13 16:55:27.126440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.126466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.126482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.126614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.126764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.126784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.126797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.128880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.138283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.138570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.138688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.138715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.138731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.138906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.139105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.139126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.139139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.140988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.150665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.150964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.151115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.151141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.151162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.151263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.151384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.151413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.151428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.153444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.162899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.163192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.163316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.163341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.163357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.163560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.163743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.163767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.163779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.165667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.174940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.175181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.175274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.175300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.175316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.175489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.175658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.175679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.175708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.177795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.187190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.187482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.187573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.187599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.187615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.187769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.187959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.187980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.187993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.189984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.199546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.199888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.199981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.200006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.200022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.200186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.200433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.200455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.200468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.202791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.211992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.212268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.212386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.212425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.212441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.212589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.212740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.212761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.212774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.214792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.224335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.224689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.224823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.224861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.224877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.225009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.225148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.225169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.225182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.227252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.236483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.236866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.236988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.237013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.846 [2024-10-13 16:55:27.237029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.846 [2024-10-13 16:55:27.237193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.846 [2024-10-13 16:55:27.237418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.846 [2024-10-13 16:55:27.237440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.846 [2024-10-13 16:55:27.237454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.846 [2024-10-13 16:55:27.239452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.846 [2024-10-13 16:55:27.248776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.846 [2024-10-13 16:55:27.249022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.846 [2024-10-13 16:55:27.249116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.249142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.249158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.249290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.249438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.249459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.249473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.251677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.261056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.261335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.261432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.261459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.261475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.261607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.261775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.261800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.261815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.264139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 16:55:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:01.847 16:55:27 -- common/autotest_common.sh@852 -- # return 0 00:31:01.847 16:55:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:01.847 16:55:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:01.847 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:01.847 [2024-10-13 16:55:27.273422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.273708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.273797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.273825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.273842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.274007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.274186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.274206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.274219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.276419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.285669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.285999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.286117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.286142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.286158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.286322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.286497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.286519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.286532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 16:55:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:01.847 16:55:27 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:01.847 16:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:01.847 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:01.847 [2024-10-13 16:55:27.288663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.291252] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:01.847 16:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:01.847 16:55:27 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:01.847 16:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:01.847 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:01.847 [2024-10-13 16:55:27.297924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.298145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.298238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.298269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.298289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.298449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.298655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.298681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.298694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.300974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.310231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.310525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.310621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.310646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.310662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.310811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.310977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.310996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.311008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.313032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.322470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.322777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.322874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.322900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.322917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.323083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.323249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.323269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.323283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.325446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 [2024-10-13 16:55:27.334813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:01.847 [2024-10-13 16:55:27.335265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.335406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.847 [2024-10-13 16:55:27.335433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:01.847 [2024-10-13 16:55:27.335453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:01.847 [2024-10-13 16:55:27.335626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:01.847 [2024-10-13 16:55:27.335825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:01.847 [2024-10-13 16:55:27.335846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:01.847 [2024-10-13 16:55:27.335862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:01.847 [2024-10-13 16:55:27.337875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:01.847 Malloc0 00:31:01.847 16:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:01.847 16:55:27 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:01.847 16:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:01.847 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:02.105 16:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:02.105 16:55:27 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:02.105 16:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:02.105 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:02.105 [2024-10-13 16:55:27.347281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:02.105 [2024-10-13 16:55:27.347492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.105 [2024-10-13 16:55:27.347598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.105 [2024-10-13 16:55:27.347624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ebf1d0 with addr=10.0.0.2, port=4420 00:31:02.105 [2024-10-13 16:55:27.347641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf1d0 is same with the state(5) to be set 00:31:02.105 [2024-10-13 16:55:27.347741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ebf1d0 (9): Bad file descriptor 00:31:02.105 [2024-10-13 16:55:27.347909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:02.105 [2024-10-13 16:55:27.347930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:02.105 [2024-10-13 16:55:27.347944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:02.105 [2024-10-13 16:55:27.349995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:02.105 16:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:02.105 16:55:27 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:02.105 16:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:02.105 16:55:27 -- common/autotest_common.sh@10 -- # set +x 00:31:02.105 [2024-10-13 16:55:27.358726] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:02.105 [2024-10-13 16:55:27.359752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:02.105 16:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:02.105 16:55:27 -- host/bdevperf.sh@38 -- # wait 1327754 00:31:02.105 [2024-10-13 16:55:27.394917] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:10.221 00:31:10.221 Latency(us) 00:31:10.221 [2024-10-13T14:55:35.722Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:10.221 [2024-10-13T14:55:35.722Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:10.221 Verification LBA range: start 0x0 length 0x4000 00:31:10.221 Nvme1n1 : 15.01 9430.20 36.84 15940.73 0.00 5030.25 606.81 19029.71 00:31:10.221 [2024-10-13T14:55:35.722Z] =================================================================================================================== 00:31:10.221 [2024-10-13T14:55:35.722Z] Total : 9430.20 36.84 15940.73 0.00 5030.25 606.81 19029.71 00:31:10.479 16:55:35 -- host/bdevperf.sh@39 -- # sync 00:31:10.479 16:55:35 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:10.479 16:55:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:10.479 16:55:35 -- common/autotest_common.sh@10 -- # set +x 00:31:10.479 16:55:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:10.479 16:55:35 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:31:10.479 16:55:35 -- host/bdevperf.sh@44 -- # nvmftestfini 00:31:10.479 16:55:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:10.479 16:55:35 -- nvmf/common.sh@116 -- # sync 00:31:10.479 16:55:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:10.479 16:55:35 -- nvmf/common.sh@119 -- # set +e 00:31:10.479 16:55:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:10.479 16:55:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:10.479 rmmod nvme_tcp 00:31:10.479 rmmod nvme_fabrics 00:31:10.479 rmmod nvme_keyring 00:31:10.737 16:55:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:10.737 16:55:35 -- nvmf/common.sh@123 -- # set -e 00:31:10.737 16:55:35 -- nvmf/common.sh@124 -- # return 0 00:31:10.737 16:55:35 -- nvmf/common.sh@477 -- # '[' -n 1328563 ']' 00:31:10.737 16:55:35 -- nvmf/common.sh@478 -- # killprocess 1328563 00:31:10.737 16:55:35 -- common/autotest_common.sh@926 -- # '[' -z 1328563 ']' 00:31:10.737 16:55:35 -- common/autotest_common.sh@930 -- # kill -0 1328563 00:31:10.737 16:55:35 -- common/autotest_common.sh@931 -- # uname 00:31:10.737 16:55:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:10.737 16:55:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1328563 00:31:10.737 16:55:36 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:31:10.737 16:55:36 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:31:10.737 16:55:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1328563' 00:31:10.737 killing process with pid 1328563 00:31:10.737 16:55:36 -- common/autotest_common.sh@945 -- # kill 1328563 00:31:10.737 16:55:36 -- common/autotest_common.sh@950 -- # wait 1328563 00:31:10.995 16:55:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:10.996 16:55:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:10.996 16:55:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:10.996 16:55:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:10.996 16:55:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:10.996 16:55:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:10.996 16:55:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:10.996 16:55:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:12.898 16:55:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:12.898 00:31:12.898 real 0m22.951s 00:31:12.898 user 1m2.353s 00:31:12.899 sys 0m4.146s 00:31:12.899 16:55:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:12.899 16:55:38 -- common/autotest_common.sh@10 -- # set +x 00:31:12.899 ************************************ 00:31:12.899 END TEST nvmf_bdevperf 00:31:12.899 ************************************ 00:31:12.899 16:55:38 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:31:12.899 16:55:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:12.899 16:55:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:12.899 16:55:38 -- common/autotest_common.sh@10 -- # set +x 00:31:12.899 ************************************ 00:31:12.899 START TEST nvmf_target_disconnect 00:31:12.899 ************************************ 00:31:12.899 16:55:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:31:12.899 * Looking for test storage... 00:31:12.899 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:31:12.899 16:55:38 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:12.899 16:55:38 -- nvmf/common.sh@7 -- # uname -s 00:31:12.899 16:55:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:12.899 16:55:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:12.899 16:55:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:12.899 16:55:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:12.899 16:55:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:12.899 16:55:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:12.899 16:55:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:12.899 16:55:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:12.899 16:55:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:12.899 16:55:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:12.899 16:55:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:12.899 16:55:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:12.899 16:55:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:12.899 16:55:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:12.899 16:55:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:12.899 16:55:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:12.899 16:55:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:12.899 16:55:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:12.899 16:55:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:12.899 16:55:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.899 16:55:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.899 16:55:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.899 16:55:38 -- paths/export.sh@5 -- # export PATH 00:31:12.899 16:55:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.899 16:55:38 -- nvmf/common.sh@46 -- # : 0 00:31:12.899 16:55:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:12.899 16:55:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:12.899 16:55:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:12.899 16:55:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:12.899 16:55:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:12.899 16:55:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:12.899 16:55:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:12.899 16:55:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:12.899 16:55:38 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:31:12.899 16:55:38 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:31:12.899 16:55:38 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:31:12.899 16:55:38 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:31:12.899 16:55:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:12.899 16:55:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:12.899 16:55:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:12.899 16:55:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:12.899 16:55:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:12.899 16:55:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:12.899 16:55:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:12.899 16:55:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:12.899 16:55:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:12.899 16:55:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:12.899 16:55:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:12.899 16:55:38 -- common/autotest_common.sh@10 -- # set +x 00:31:15.429 16:55:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:15.429 16:55:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:15.429 16:55:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:15.429 16:55:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:15.429 16:55:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:15.429 16:55:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:15.429 16:55:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:15.429 16:55:40 -- nvmf/common.sh@294 -- # net_devs=() 00:31:15.429 16:55:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:15.429 16:55:40 -- nvmf/common.sh@295 -- # e810=() 00:31:15.429 16:55:40 -- nvmf/common.sh@295 -- # local -ga e810 00:31:15.429 16:55:40 -- nvmf/common.sh@296 -- # x722=() 00:31:15.429 16:55:40 -- nvmf/common.sh@296 -- # local -ga x722 00:31:15.429 16:55:40 -- nvmf/common.sh@297 -- # mlx=() 00:31:15.429 16:55:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:15.429 16:55:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:15.429 16:55:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:15.429 16:55:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:15.429 16:55:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:15.429 16:55:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:15.429 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:15.429 16:55:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:15.429 16:55:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:15.429 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:15.429 16:55:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:15.429 16:55:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:15.429 16:55:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:15.429 16:55:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:15.429 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:15.429 16:55:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:15.429 16:55:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:15.429 16:55:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:15.429 16:55:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:15.429 16:55:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:15.429 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:15.429 16:55:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:15.429 16:55:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:15.429 16:55:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:15.429 16:55:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:15.429 16:55:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:15.429 16:55:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:15.429 16:55:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:15.429 16:55:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:15.429 16:55:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:15.429 16:55:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:15.429 16:55:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:15.429 16:55:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:15.429 16:55:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:15.429 16:55:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:15.429 16:55:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:15.430 16:55:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:15.430 16:55:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:15.430 16:55:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:15.430 16:55:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:15.430 16:55:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:15.430 16:55:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:15.430 16:55:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:15.430 16:55:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:15.430 16:55:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:15.430 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:15.430 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:31:15.430 00:31:15.430 --- 10.0.0.2 ping statistics --- 00:31:15.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:15.430 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:31:15.430 16:55:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:15.430 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:15.430 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:31:15.430 00:31:15.430 --- 10.0.0.1 ping statistics --- 00:31:15.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:15.430 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:31:15.430 16:55:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:15.430 16:55:40 -- nvmf/common.sh@410 -- # return 0 00:31:15.430 16:55:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:15.430 16:55:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:15.430 16:55:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:15.430 16:55:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:15.430 16:55:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:15.430 16:55:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:15.430 16:55:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:15.430 16:55:40 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:31:15.430 16:55:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:15.430 16:55:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:15.430 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:31:15.430 ************************************ 00:31:15.430 START TEST nvmf_target_disconnect_tc1 00:31:15.430 ************************************ 00:31:15.430 16:55:40 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:31:15.430 16:55:40 -- host/target_disconnect.sh@32 -- # set +e 00:31:15.430 16:55:40 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:31:15.430 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.430 [2024-10-13 16:55:40.641259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:15.430 [2024-10-13 16:55:40.641528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:15.430 [2024-10-13 16:55:40.641570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8d8270 with addr=10.0.0.2, port=4420 00:31:15.430 [2024-10-13 16:55:40.641624] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:31:15.430 [2024-10-13 16:55:40.641666] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:31:15.430 [2024-10-13 16:55:40.641692] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:31:15.430 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:31:15.430 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:31:15.430 Initializing NVMe Controllers 00:31:15.430 16:55:40 -- host/target_disconnect.sh@33 -- # trap - ERR 00:31:15.430 16:55:40 -- host/target_disconnect.sh@33 -- # print_backtrace 00:31:15.430 16:55:40 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:31:15.430 16:55:40 -- common/autotest_common.sh@1132 -- # return 0 00:31:15.430 16:55:40 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:31:15.430 16:55:40 -- host/target_disconnect.sh@41 -- # set -e 00:31:15.430 00:31:15.430 real 0m0.092s 00:31:15.430 user 0m0.032s 00:31:15.430 sys 0m0.060s 00:31:15.430 16:55:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:15.430 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:31:15.430 ************************************ 00:31:15.430 END TEST nvmf_target_disconnect_tc1 00:31:15.430 ************************************ 00:31:15.430 16:55:40 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:31:15.430 16:55:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:15.430 16:55:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:15.430 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:31:15.430 ************************************ 00:31:15.430 START TEST nvmf_target_disconnect_tc2 00:31:15.430 ************************************ 00:31:15.430 16:55:40 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:31:15.430 16:55:40 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:31:15.430 16:55:40 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:31:15.430 16:55:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:15.430 16:55:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:15.430 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:31:15.430 16:55:40 -- nvmf/common.sh@469 -- # nvmfpid=1331632 00:31:15.430 16:55:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:31:15.430 16:55:40 -- nvmf/common.sh@470 -- # waitforlisten 1331632 00:31:15.430 16:55:40 -- common/autotest_common.sh@819 -- # '[' -z 1331632 ']' 00:31:15.430 16:55:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:15.430 16:55:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:15.430 16:55:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:15.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:15.430 16:55:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:15.430 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:31:15.430 [2024-10-13 16:55:40.733050] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:31:15.430 [2024-10-13 16:55:40.733143] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:15.430 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.430 [2024-10-13 16:55:40.803988] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:15.430 [2024-10-13 16:55:40.900870] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:15.430 [2024-10-13 16:55:40.901038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:15.430 [2024-10-13 16:55:40.901059] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:15.430 [2024-10-13 16:55:40.901073] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:15.430 [2024-10-13 16:55:40.901184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:15.430 [2024-10-13 16:55:40.901248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:15.430 [2024-10-13 16:55:40.901302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:15.430 [2024-10-13 16:55:40.901305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:16.416 16:55:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:16.416 16:55:41 -- common/autotest_common.sh@852 -- # return 0 00:31:16.416 16:55:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:16.416 16:55:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 16:55:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:16.416 16:55:41 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 Malloc0 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 [2024-10-13 16:55:41.749039] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 [2024-10-13 16:55:41.777283] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:16.416 16:55:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:16.416 16:55:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.416 16:55:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:16.416 16:55:41 -- host/target_disconnect.sh@50 -- # reconnectpid=1331793 00:31:16.416 16:55:41 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:31:16.416 16:55:41 -- host/target_disconnect.sh@52 -- # sleep 2 00:31:16.416 EAL: No free 2048 kB hugepages reported on node 1 00:31:18.314 16:55:43 -- host/target_disconnect.sh@53 -- # kill -9 1331632 00:31:18.314 16:55:43 -- host/target_disconnect.sh@55 -- # sleep 2 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Write completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.314 starting I/O failed 00:31:18.314 [2024-10-13 16:55:43.800761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:18.314 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 [2024-10-13 16:55:43.801147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Write completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 Read completed with error (sct=0, sc=8) 00:31:18.315 starting I/O failed 00:31:18.315 [2024-10-13 16:55:43.801444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:18.315 [2024-10-13 16:55:43.801591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.801754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.801781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.801945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.802282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.802589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.802742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.802896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.803266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.803596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.803807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.803952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.804179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.804479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.804680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.804821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.804905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.805197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.805433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.315 qpair failed and we were unable to recover it. 00:31:18.315 [2024-10-13 16:55:43.805706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.315 [2024-10-13 16:55:43.805883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.806031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.806260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.806496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.806719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.806857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.807001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.807197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.807429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.807631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.807805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.807883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.808185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.808419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.808652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.808776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.808958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.809196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.809431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.809663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.809924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.810066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.810347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.810572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.810822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.810932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.811024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.811336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.811533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.811734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.811956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.812376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.812601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.812838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.812949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.813058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.813161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.813187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.316 [2024-10-13 16:55:43.813310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.813450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.316 [2024-10-13 16:55:43.813476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.316 qpair failed and we were unable to recover it. 00:31:18.317 [2024-10-13 16:55:43.813559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.813644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.813671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.317 qpair failed and we were unable to recover it. 00:31:18.317 [2024-10-13 16:55:43.813818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.813926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.813952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.317 qpair failed and we were unable to recover it. 00:31:18.317 [2024-10-13 16:55:43.814039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.814152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.814178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.317 qpair failed and we were unable to recover it. 00:31:18.317 [2024-10-13 16:55:43.814262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.814348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.317 [2024-10-13 16:55:43.814373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.317 qpair failed and we were unable to recover it. 00:31:18.317 [2024-10-13 16:55:43.814473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.814652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.814849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.814964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.815078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.815327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.815568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.815770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.815904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.816028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.816257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.816528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.816797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.816962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.817108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.817324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.817561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.817777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.817906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.817994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.818178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.818414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.818636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.818779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.818923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.819174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.819377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.819580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.819782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.819890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.819986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.820201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.820455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.594 [2024-10-13 16:55:43.820622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.594 qpair failed and we were unable to recover it. 00:31:18.594 [2024-10-13 16:55:43.820746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.820884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.820910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.821017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.821311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.821556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.821816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.821923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.822065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.822320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.822600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.822774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.822892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.823171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.823500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.823726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.823853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.823966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.824159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.824459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.824697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.824866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.824943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.825182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.825445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.825650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.825797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.825914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.826203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.826424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.826614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.826895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.826997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.827108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.827388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.827672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.827781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.827869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.828006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.828031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.828145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.828225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.828250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.595 qpair failed and we were unable to recover it. 00:31:18.595 [2024-10-13 16:55:43.828405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.595 [2024-10-13 16:55:43.828552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.828578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.828697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.828808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.828834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.828947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.829193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.829419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.829652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.829818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.829904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.830125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.830425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.830698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.830799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.830880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.831137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.831337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.831568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.831735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.831872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.832149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.832411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.832728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.832909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.833049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.833295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.833521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.833808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.833972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.834112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.834368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.834591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.834815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.834998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.835104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.835334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.835563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.835875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.835986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.836011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.596 [2024-10-13 16:55:43.836130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.836248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.596 [2024-10-13 16:55:43.836273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.596 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.836387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.836507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.836532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.836671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.836786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.836811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.836918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.837196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.837421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.837715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.837846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.837932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.838245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.838480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.838701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.838820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.838936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.839164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.839437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.839655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.839901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.839984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.840122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.840382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.840639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.840890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.840997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.841075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.841565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.841766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.841907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.842035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.842252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.842492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.842712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.842846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.842965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.843212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.843469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.597 [2024-10-13 16:55:43.843610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.597 qpair failed and we were unable to recover it. 00:31:18.597 [2024-10-13 16:55:43.843813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.843922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.843947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.844060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.844289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.844523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.844790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.844935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.845017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.845200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.845424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.845684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.845789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.845930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.846159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.846416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.846665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.846863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.846994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.847080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.847327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.847566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.847815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.847951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.848045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.848227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.848479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.848696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.848837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.848957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.849186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.849386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.598 qpair failed and we were unable to recover it. 00:31:18.598 [2024-10-13 16:55:43.849671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.598 [2024-10-13 16:55:43.849782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.849892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.849969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.849994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.850084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.850340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.850535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.850772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.850909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.851017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.851248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.851507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.851748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.851865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.852254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.852487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.852749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.852871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.853038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.853335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.853540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.853750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.853858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.853984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.854202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.854410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.854627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.854799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.854883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.855117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.855302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.855580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.855801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.855937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.856049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.856303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.856566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.599 qpair failed and we were unable to recover it. 00:31:18.599 [2024-10-13 16:55:43.856794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.599 [2024-10-13 16:55:43.856926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.857005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.857304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.857529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.857810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.857916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.858024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.858264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.858521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.858742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.858880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.858987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.859290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.859567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.859787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.859900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.860200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.860466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.860819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.860988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.861079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.861288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.861517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.861776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.861877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.861993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.862218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.862482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.862773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.862920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.863035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.863279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.863544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.863781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.863890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.863999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.864326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.600 [2024-10-13 16:55:43.864553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.600 [2024-10-13 16:55:43.864662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.600 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.864772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.864875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.864900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.865012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.865263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.865555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.865797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.865946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.866072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.866265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.866496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.866702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.866817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.866909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.867136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.867351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.867579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.867794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.867929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.868015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.868234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.868433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.868659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.868858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.868977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.869082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.869365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.869624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.869869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.869983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.870073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.870269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.870492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.870710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.870822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.870938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.871162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.871406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.601 qpair failed and we were unable to recover it. 00:31:18.601 [2024-10-13 16:55:43.871629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.601 [2024-10-13 16:55:43.871713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.871737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.871814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.871887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.871913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.872027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.872302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.872541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.872760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.872903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.872990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.873189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.873383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.873583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.873765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.873875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.873993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.874208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.874476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.874740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.874854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.874939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.875224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.875411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.875628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.875805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.875922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.876031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.876250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.876489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.876699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.876892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.876998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.877121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.877204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.877230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.877313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.877426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.602 [2024-10-13 16:55:43.877452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.602 qpair failed and we were unable to recover it. 00:31:18.602 [2024-10-13 16:55:43.877596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.877679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.877705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.877790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.877905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.877932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.878083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.878274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.878496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.878741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.878851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.878972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.879196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.879412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.879627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.879831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.879936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.880025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.880295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.880512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.880758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.880933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.881022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.881366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.881595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.881838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.881993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.882158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.882502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.882782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.882890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.882973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.883217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.883442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.883716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.883854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.883991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.884216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.884424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.884710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.884816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.603 qpair failed and we were unable to recover it. 00:31:18.603 [2024-10-13 16:55:43.884897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.885071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.603 [2024-10-13 16:55:43.885097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.885205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.885436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.885658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.885880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.885977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.886067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.886359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.886543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.886735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.886849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.886924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.887178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.887407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.887605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.887818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.887958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.888125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.888378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.888609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.888849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.888990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.889105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.889406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.889651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.889884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.889999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.890151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.890628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.890821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.890984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.891063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.891270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.891467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.891664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.891825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.891957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.892084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.892111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.892251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.892389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.892419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.604 qpair failed and we were unable to recover it. 00:31:18.604 [2024-10-13 16:55:43.892523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.604 [2024-10-13 16:55:43.892634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.892659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.892740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.892818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.892844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.892956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.893215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.893505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.893813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.893954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.894116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.894386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.894613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.894787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.894949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.895187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.895488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.895754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.895927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.896031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.896334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.896625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.896795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.896934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.897137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.897417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.897692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.897867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.898021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.898286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.898576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.898833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.898964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.899079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.899316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.899564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.899857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.899975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.900104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.900301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.605 qpair failed and we were unable to recover it. 00:31:18.605 [2024-10-13 16:55:43.900578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.605 [2024-10-13 16:55:43.900718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.900847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.900961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.900989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.901102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.901371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.901583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.901730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.901859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.902114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.902365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.902576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.902841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.902984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.903066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.903293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.903522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.903774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.903915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.904065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.904333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.904549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.904801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.904909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.904989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.905211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.905405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.905695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.905887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.905993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.906125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.906406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.906621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.906803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.906939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.907147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.907383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.907677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.907850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.606 qpair failed and we were unable to recover it. 00:31:18.606 [2024-10-13 16:55:43.907950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.908064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.606 [2024-10-13 16:55:43.908090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.908172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.908470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.908686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.908815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.908928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.909238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.909529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.909769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.909907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.910034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.910287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.910573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.910757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.910862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.910936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.911199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.911481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.911714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.911848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.911962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.912217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.912510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.912744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.912948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.913062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.913237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.913510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.913786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.913896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.914000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.914259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.914461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.607 [2024-10-13 16:55:43.914749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.607 [2024-10-13 16:55:43.914885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.607 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.915039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.915325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.915545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.915716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.915850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.915929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.916220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.916505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.916753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.916869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.916976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.917222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.917527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.917793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.917955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.918067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.918339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.918630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.918853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.918975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.919091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.919306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.919554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.919761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.919904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.920039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.920322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.920595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.920745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.920904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.921133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.921373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.921636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.921771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.921899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.922158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.922479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.608 qpair failed and we were unable to recover it. 00:31:18.608 [2024-10-13 16:55:43.922738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.608 [2024-10-13 16:55:43.922820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.922845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.922985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.923261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.923518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.923766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.923925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.924032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.924279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.924570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.924815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.924951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.925064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.925297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.925552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.925771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.925954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.926090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.926345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.926546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.926773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.926890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.926998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.927214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.927420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.927657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.927822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.927956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.928222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.928511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.928801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.928993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.929138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.929368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.929633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.929799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.929949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.930231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.930492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.609 [2024-10-13 16:55:43.930631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.609 qpair failed and we were unable to recover it. 00:31:18.609 [2024-10-13 16:55:43.930749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.930826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.930851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.930965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.931230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.931490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.931695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.931917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.931997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.932141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.932391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.932624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.932848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.932983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.933100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.933355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.933625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.933867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.933976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.934099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.934352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.934582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.934853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.934978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.935116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.935363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.935577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.935817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.935980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.936157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.936421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.936641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.936797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.936917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.937158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.937361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.937701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.937831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.937943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.938092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.938120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.610 [2024-10-13 16:55:43.938232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.938343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.610 [2024-10-13 16:55:43.938371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.610 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.938506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.938590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.938617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.938757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.938837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.938865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.939013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.939294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.939567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.939792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.939910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.940029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.940283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.940549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.940793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.940957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.941050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.941368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.941660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.941780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.941900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.942170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.942422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.942672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.942890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.942980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.943108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.943344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.943594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.943735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.943890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.944128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.944436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.944685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.944785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.944917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.945045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.945073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.611 [2024-10-13 16:55:43.945159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.945314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.611 [2024-10-13 16:55:43.945342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.611 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.945479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.945593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.945618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.945711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.945810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.945837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.945938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.946164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.946462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.946710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.946824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.946946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.947243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.947515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.947802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.947940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.948091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.948322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.948588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.948831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.948987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.949152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.949403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.949596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.949731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.949887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.950179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.950403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.950652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.950866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.950988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.951110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.951379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.951685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.951850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.951962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.952166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.952476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.952727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.952905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.953028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.953131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.953157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.612 qpair failed and we were unable to recover it. 00:31:18.612 [2024-10-13 16:55:43.953264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.953375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.612 [2024-10-13 16:55:43.953408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.953533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.953646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.953673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.953756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.953885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.953910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.953995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.954214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.954572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.954795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.954903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.955021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.955209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.955495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.955712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.955872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.956023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.956314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.956537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.956728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.956866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.957148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.957373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.957634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.957919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.957999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.958109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.958375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.958639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.958804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.958947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.959209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.959455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.959712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.959875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.960009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.960263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.960502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.960719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.960837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.960968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.961109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.961133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.613 qpair failed and we were unable to recover it. 00:31:18.613 [2024-10-13 16:55:43.961233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.613 [2024-10-13 16:55:43.961353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.961381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.961479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.961560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.961588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.961682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.961788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.961813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.961887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.962126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.962382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.962653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.962897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.962975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.963140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.963346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.963596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.963868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.963974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.964108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.964403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.964633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.964996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.965073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.965358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.965566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.965727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.965886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.966158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.966454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.966697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.966812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.966946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.967203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.967421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.967668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.967859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.967972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.968056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.968294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.968527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.614 [2024-10-13 16:55:43.968669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.614 qpair failed and we were unable to recover it. 00:31:18.614 [2024-10-13 16:55:43.968756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.968874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.968903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.969008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.969206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.969523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.969736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.969908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.970039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.970241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.970473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.970709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.970853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.971006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.971249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.971508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.971774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.971924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.972055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.972320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.972536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.972768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.972869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.972968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.973268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.973496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.973691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.973844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.973922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.974207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.974463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.974749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.974874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.975001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.975140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.975164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.615 [2024-10-13 16:55:43.975267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.975415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.615 [2024-10-13 16:55:43.975459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.615 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.975584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.975711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.975752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.975893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.975971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.975997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.976099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.976370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.976610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.976795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.976929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.977046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.977326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.977589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.977803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.977960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.978093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.978368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.978645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.978910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.978999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.979163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.979434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.979648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.979787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.979921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.980196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.980460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.980701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.980815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.980935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.981209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.981484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.981716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.981846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.981980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.982231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.982516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.982770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.982914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.983005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.983119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.983144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.616 qpair failed and we were unable to recover it. 00:31:18.616 [2024-10-13 16:55:43.983232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.983337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.616 [2024-10-13 16:55:43.983379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.983554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.983667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.983708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.983838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.983997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.984136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.984387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.984653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.984793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.984916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.985189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.985425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.985637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.985831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.985972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.986228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.986478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.986686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.986788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.986896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.987134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.987331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.987535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.987752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.987864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.987965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.988223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.988485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.988825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.988994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.989125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.989407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.989652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.989825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.989945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.990195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.990483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.990805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.990943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.991033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.991132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.991160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.617 qpair failed and we were unable to recover it. 00:31:18.617 [2024-10-13 16:55:43.991289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.617 [2024-10-13 16:55:43.991377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.991408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.991493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.991609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.991634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.991774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.991896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.991925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.992074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.992284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.992557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.992807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.992917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.993030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.993236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.993539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.993755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.993884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.993980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.994290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.994511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.994784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.994926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.995022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.995257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.995565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.995783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.995895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.995970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.996230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.996543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.996805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.996954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.997116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.997363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.997557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.997844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.997992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.998086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.998337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.998572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.998824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.618 [2024-10-13 16:55:43.998986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.618 qpair failed and we were unable to recover it. 00:31:18.618 [2024-10-13 16:55:43.999117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:43.999350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:43.999607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:43.999862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:43.999983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.000092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.000383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.000660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.000769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.000896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.001182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.001422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.001671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.001916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.001992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.002132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.002430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.002681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.002794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.002922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.003157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.003477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.003730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.003888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.003969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.004188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.004431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.004737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.004885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.005020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.005273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.005508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.005734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.005901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.005976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.006073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.006100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.619 qpair failed and we were unable to recover it. 00:31:18.619 [2024-10-13 16:55:44.006221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.006320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.619 [2024-10-13 16:55:44.006350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.006466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.006576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.006602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.006709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.006806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.006833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.006928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.007172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.007399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.007666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.007843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.008003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.008229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.008497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.008744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.008888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.009004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.009320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.009612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.009853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.009995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.010119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.010363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.010590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.010780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.010920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.011195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.011490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.011707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.011855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.011967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.012254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.012508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.012739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.012865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.012977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.013284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.013530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.620 qpair failed and we were unable to recover it. 00:31:18.620 [2024-10-13 16:55:44.013718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.620 [2024-10-13 16:55:44.013855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.013970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.014209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.014477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.014703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.014823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.014922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.015189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.015427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.015714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.015858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.015983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.016218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.016518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.016766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.016909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.017073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.017262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.017498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.017683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.017862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.017990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.018271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.018517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.018728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.018891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.019003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.019231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.019488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.019690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.019799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.019926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.020208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.020478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.020750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.020945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.021059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.021201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.021226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.621 [2024-10-13 16:55:44.021303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.021380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.621 [2024-10-13 16:55:44.021413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.621 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.021544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.021636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.021664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.021828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.021946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.021971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.022117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.022342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.022622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.022838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.022998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.023091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.023383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.023618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.023827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.023978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.024100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.024276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.024536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.024870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.024984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.025122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.025381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.025665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.025802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.025925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.026140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.026442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.026673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.026813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.026892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.027152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.027389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.027633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.027781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.027875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.028136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.028337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.028618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.028871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.028979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.029004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.622 qpair failed and we were unable to recover it. 00:31:18.622 [2024-10-13 16:55:44.029088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.622 [2024-10-13 16:55:44.029161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.029298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.029503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.029693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.029800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.029932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.030231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.030469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.030665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.030802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.030924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.031190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.031476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.031716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.031857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.031953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.032216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.032442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.032734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.032870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.032977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.033244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.033804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.033936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.034030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.034288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.034576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.034841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.034989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.035112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.035552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.035795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.035977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.036122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.036325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.036598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.623 [2024-10-13 16:55:44.036771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.623 qpair failed and we were unable to recover it. 00:31:18.623 [2024-10-13 16:55:44.036871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.036979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.037135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.037344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.037652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.037786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.037900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.038143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.038425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.038608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.038845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.038992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.039094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.039372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.039617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.039839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.039968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.040049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.040327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.040576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.040793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.040951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.041040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.041332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.041576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.041818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.041968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.042070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.042349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.042657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.042806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.042885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.043109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.043361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.624 qpair failed and we were unable to recover it. 00:31:18.624 [2024-10-13 16:55:44.043613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.624 [2024-10-13 16:55:44.043686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.043710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.043830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.043937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.043962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.044052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.044315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.044555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.044830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.044947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.045041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.045287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.045552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.045783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.045911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.045991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.046277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.046617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.046819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.046993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.047115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.047406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.047621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.047862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.047984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.048079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.048186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.048211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Write completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 Read completed with error (sct=0, sc=8) 00:31:18.625 starting I/O failed 00:31:18.625 [2024-10-13 16:55:44.048561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:18.625 [2024-10-13 16:55:44.048680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.048793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.048823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.048974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.049217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.049497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.625 [2024-10-13 16:55:44.049608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.625 qpair failed and we were unable to recover it. 00:31:18.625 [2024-10-13 16:55:44.049702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.049797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.049825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.049969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.050229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.050534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.050762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.050896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.051046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.051317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.051590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.051855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.051981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.052114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.052359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.052692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.052790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.052881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.053156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.053373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.053602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.053829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.053991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.054073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.054304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.054555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.054795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.054965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.055075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.055292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.055542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.055821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.055962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.056061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.056312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.056543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.056774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.056937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.057042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.057128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.057153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.626 qpair failed and we were unable to recover it. 00:31:18.626 [2024-10-13 16:55:44.057298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.057376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.626 [2024-10-13 16:55:44.057408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.057521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.057592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.057617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.057724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.057805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.057830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.057923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.058182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.058492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.058739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.058879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.058994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.059236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.059467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.059650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.059782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.059911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.060147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.060366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.060715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.060871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.060949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.061193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.061480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.061747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.061847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.061927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.062214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.062500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.062696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.062819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.062912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.063206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.063400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.063612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.063901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.063979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.064123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.064377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.064649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.627 qpair failed and we were unable to recover it. 00:31:18.627 [2024-10-13 16:55:44.064867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.627 [2024-10-13 16:55:44.064974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.064999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.065115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.065412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.065608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.065796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.065911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.066024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.066239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.066557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.066774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.066888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.066979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.067219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.067455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.067656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.067819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.067904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.068146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.068387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.068642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.068800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.068938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.069188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.069495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.069689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.069879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.069987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.070074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.070349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.070572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.070822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.070943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.071079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.071196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.071221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.628 qpair failed and we were unable to recover it. 00:31:18.628 [2024-10-13 16:55:44.071314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.071409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.628 [2024-10-13 16:55:44.071445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.071531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.071689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.071714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.071825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.071914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.071939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.072024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.072251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.072454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.072662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.072887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.072997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.073103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.073292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.073498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.073769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.073874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.073961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.074197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.074403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.074604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.074834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.074961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.075075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.075266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.075493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.075740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.629 [2024-10-13 16:55:44.075851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.629 qpair failed and we were unable to recover it. 00:31:18.629 [2024-10-13 16:55:44.075947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.076169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.076405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.076638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.076844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.076980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.077112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.077333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.077583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.077826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.077932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.078017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.078311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.078574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.078815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.078957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.079051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.079290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.079545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.079779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.079919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.080014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.080290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.080557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.080864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.080975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.081121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.081456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.081766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.908 [2024-10-13 16:55:44.081910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.908 qpair failed and we were unable to recover it. 00:31:18.908 [2024-10-13 16:55:44.082005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.082276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.082598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.082757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.082935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.083291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.083546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.083823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.083994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.084166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.084495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.084756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.084969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.085124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.085419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.085669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.085834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.085989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.086273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.086547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.086720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.086884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.087255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.087515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.087774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.087933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.088110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.088413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.088640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.088814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.088942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.089209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.089450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.089759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.089888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.089991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.090113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.090143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.909 [2024-10-13 16:55:44.090269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.090438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.909 [2024-10-13 16:55:44.090466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.909 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.090559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.090668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.090707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.090867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.090950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.090997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.091098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.091416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.091739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.091915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.092049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.092361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.092682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.092877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.093024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.093277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.093601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.093755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.093868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.094189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.094476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.094725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.094887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.095029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.095272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.095565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.095745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.095885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.096204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.096518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.096899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.096984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.097102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.097379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.097602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.097745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.097903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.098159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.098436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.098676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.098793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.910 [2024-10-13 16:55:44.098909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.099002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.910 [2024-10-13 16:55:44.099031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.910 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.099152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.099481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.099714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.099895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.100021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.100298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.100573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.100769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.100910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.101037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.101299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.101590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.101808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.101987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.102110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.102409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.102715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.102855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.102984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.103234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.103519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.103804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.103951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.104096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.104368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.104646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.104809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.104919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.105247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.105559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.105836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.105992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.106096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.106281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.911 [2024-10-13 16:55:44.106536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.911 [2024-10-13 16:55:44.106672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.911 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.106819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.106901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.106929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.107072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.107376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.107625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.107758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.107872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.108175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.108379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.108682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.108830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.108955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.109202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.109437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.109734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.109896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.110048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.110414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.110707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.110855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.111012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.111260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.111540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.111810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.111934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.112065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.112375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.112630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.112879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.112995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.113143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.113455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.912 qpair failed and we were unable to recover it. 00:31:18.912 [2024-10-13 16:55:44.113758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.912 [2024-10-13 16:55:44.113869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.113972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.114230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.114548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.114825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.114974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.115136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.115425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.115677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.115833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.115934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.116185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.116463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.116770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.116966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.117098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.117332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.117579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.117826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.117983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.118086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.118352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.118630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.118885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.118982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.119120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.119322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.119549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.119768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.119904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.119987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.120251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.120494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.913 [2024-10-13 16:55:44.120724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.913 [2024-10-13 16:55:44.120825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.913 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.120940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.121135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.121314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.121531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.121729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.121870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.121975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.122220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.122480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.122695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.122816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.122926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.123147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.123367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.123614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.123850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.123966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.124047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.124271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.124522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.124796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.124903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.124993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.125217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.125413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.125657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.125879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.125983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.126098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.126324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.126543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.126766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.126907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.127019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.127107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.127133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.914 qpair failed and we were unable to recover it. 00:31:18.914 [2024-10-13 16:55:44.127253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.127368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.914 [2024-10-13 16:55:44.127399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.127491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.127569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.127594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.127702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.127780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.127805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.127920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.128211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.128498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.128697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.128832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.128922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.129175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.129381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.129650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.129852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.129991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.130098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.130311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.130545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.130759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.130864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.130978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.131201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.131424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.131610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.131801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.131922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.132002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.132239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.132460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.132671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.132838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.132929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.133125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.133341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.133557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.133777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.133884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.915 qpair failed and we were unable to recover it. 00:31:18.915 [2024-10-13 16:55:44.133968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.915 [2024-10-13 16:55:44.134078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.134192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.134408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.134648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.134777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.134922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.135131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.135352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.135547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.135758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.135912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.136014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.136251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.136499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.136752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.136898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.136997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.137240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.137476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.137752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.137874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.137968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.138198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.138429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.138738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.138861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.138986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.139254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.139523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.139741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.139881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.140012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.140250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.140528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.140843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.916 [2024-10-13 16:55:44.140996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.916 qpair failed and we were unable to recover it. 00:31:18.916 [2024-10-13 16:55:44.141115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.141381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.141607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.141885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.141980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.142107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.142334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.142600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.142831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.142942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.143065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.143305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.143553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.143833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.143956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.144050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.144248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.144476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.144698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.144817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.144939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.145186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.145405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.145625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.145806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.145927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.146183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.146410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.146662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.146865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.917 [2024-10-13 16:55:44.146993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.147133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.917 [2024-10-13 16:55:44.147166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.917 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.147285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.147578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.147810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.147982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.148125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.148443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.148729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.148869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.149043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.149311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.149536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.149791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.149987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.150121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.150399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.150629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.150794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.150949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.151293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.151540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.151835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.151956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.152108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.152334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.152590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.152760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.152878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.153153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.153418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.153685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.153909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.154058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.154386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.154628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.918 qpair failed and we were unable to recover it. 00:31:18.918 [2024-10-13 16:55:44.154838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.918 [2024-10-13 16:55:44.154986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.155133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.155389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.155625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.155850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.155976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.156155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.156449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.156656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.156798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.156895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.157288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.157582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.157841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.157995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.158160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.158499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.158757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.158937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.159084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.159424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.159621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.159894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.159994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.160025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.160161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15a3e00 is same with the state(5) to be set 00:31:18.919 [2024-10-13 16:55:44.160364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.160509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.160546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.160718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.160843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.160891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.161010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.161357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.161616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.161865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.161981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.162067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.162296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.162559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.162729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.162920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.163006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.163036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.163192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.163327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.919 [2024-10-13 16:55:44.163361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.919 qpair failed and we were unable to recover it. 00:31:18.919 [2024-10-13 16:55:44.163529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.163660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.163710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.163808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.163935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.163964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.164084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.164437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.164690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.164842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.164954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.165219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.165527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.165837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.165998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.166181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.166501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.166792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.166952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.167099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.167358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.167613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.167817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.167959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.168066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.168410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.168605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.168786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.168926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.169184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.169492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.169713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.169845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.169957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.170257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.170505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.170817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.170968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.171077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.171166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.920 [2024-10-13 16:55:44.171200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.920 qpair failed and we were unable to recover it. 00:31:18.920 [2024-10-13 16:55:44.171307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.171562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.171792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.171925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.172060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.172441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.172694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.172864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.172995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.173242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.173473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.173736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.173856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.173968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.174222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.174445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.174632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.174868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.174984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.175066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.175261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.175507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.175724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.175857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.175933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.176158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.176435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.176683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.176826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.176965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.177058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.177087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.177190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.177279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.177305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.921 qpair failed and we were unable to recover it. 00:31:18.921 [2024-10-13 16:55:44.177427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.921 [2024-10-13 16:55:44.177519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.177545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.177633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.177724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.177753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.177884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.177968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.177998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.178091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.178336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.178565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.178785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.178940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.179083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.179315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.179586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.179800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.179958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.180086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.180290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.180527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.180737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.180852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.180942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.181183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.181451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.181687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.181818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.181905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.182193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.182445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.182676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.182782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.182901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.183127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.183423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.183650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.183799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.183898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.184144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.184399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.922 qpair failed and we were unable to recover it. 00:31:18.922 [2024-10-13 16:55:44.184592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.922 [2024-10-13 16:55:44.184687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.184713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.184810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.184926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.184956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.185050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.185279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.185512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.185750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.185897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.186043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.186332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.186567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.186832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.186954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.187054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.187257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.187501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.187770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.187924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.188002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.188244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.188497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.188768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.188880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.189008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.189259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.189483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.189749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.189927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.190025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.190286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.190543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.190764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.190916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.923 [2024-10-13 16:55:44.191029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.191195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.923 [2024-10-13 16:55:44.191232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.923 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.191353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.191622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.191832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.191992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.192097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.192339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.192553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.192794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.192935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.193024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.193239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.193478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.193748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.193884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.193993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.194415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.194610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.194838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.194948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.195064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.195284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.195576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.195828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.195934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.196016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.196256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.196509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.196766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.196906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.197015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.197264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.197485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.197708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.924 [2024-10-13 16:55:44.197815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.924 qpair failed and we were unable to recover it. 00:31:18.924 [2024-10-13 16:55:44.197924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.197997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.198134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.198374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.198594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.198809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.198978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.199061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.199304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.199603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.199779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.199896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.200152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.200439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.200697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.200805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.200930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.201146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.201361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.201581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.201836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.201982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.202123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.202351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.202565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.202855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.202985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.203105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.203408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.203612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.203852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.203998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.204159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.204408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.204602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.925 [2024-10-13 16:55:44.204748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.925 qpair failed and we were unable to recover it. 00:31:18.925 [2024-10-13 16:55:44.204831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.204945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.204977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.205099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.205332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.205538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.205787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.205926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.206012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.206236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.206526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.206763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.206909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.206989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.207245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.207519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.207771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.207955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.208090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.208294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.208601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.208866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.208983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.209126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.209415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.209682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.209826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.209997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.210291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.210824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.210949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.211091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.211203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.211229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.926 qpair failed and we were unable to recover it. 00:31:18.926 [2024-10-13 16:55:44.211312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.926 [2024-10-13 16:55:44.211418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.211445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.211543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.211615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.211641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.211757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.211866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.211892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.211986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.212305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.212544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.212733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.212852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.212940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.213188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.213410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.213672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.213812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.213894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.214155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.214424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.214625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.214873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.214985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.215102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.215326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.215597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.215849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.215975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.216064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.216326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.216585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.216880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.216977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.217127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.217358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.217685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.217851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.217983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.218120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.218145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.927 qpair failed and we were unable to recover it. 00:31:18.927 [2024-10-13 16:55:44.218270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.927 [2024-10-13 16:55:44.218388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.218429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.218539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.218654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.218680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.218775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.218895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.218921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.219012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.219339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.219595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.219854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.219995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.220127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.220388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.220719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.220889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.221001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.221208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.221411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.221641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.221871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.221994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.222158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.222432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.222657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.222799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.222920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.223176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.223427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.223650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.223808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.223959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.224235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.224439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.224799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.224932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.225043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.225280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.225549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.225800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.928 [2024-10-13 16:55:44.225904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.928 qpair failed and we were unable to recover it. 00:31:18.928 [2024-10-13 16:55:44.226016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.226271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.226526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.226749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.226894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.227032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.227284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.227594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.227804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.227989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.228103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.228446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.228739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.228928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.229329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.229616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.229740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.229903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.230168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.230437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.230730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.230864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.230950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.231208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.231434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.231634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.231852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.231960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.232067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.232299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.232524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.232793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.232904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.929 [2024-10-13 16:55:44.233019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.233130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.929 [2024-10-13 16:55:44.233157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.929 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.233249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.233583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.233842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.233960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.234132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.234391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.234681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.234855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.235001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.235305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.235611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.235843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.235949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.236057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.236312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.236596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.236778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.236935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.237207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.237471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.237728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.237840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.237964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.238222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.238488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.238802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.238973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.239083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.239312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.239557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.239835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.239946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.240053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.240171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.240196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.930 qpair failed and we were unable to recover it. 00:31:18.930 [2024-10-13 16:55:44.240278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.240404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.930 [2024-10-13 16:55:44.240435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.240577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.240734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.240767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.240857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.240965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.240991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.241103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.241385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.241673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.241823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.241908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.242155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.242441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.242640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.242815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.242930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.243208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.243474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.243735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.243910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.244027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.244260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.244522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.244723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.244873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.245015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.245298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.245560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.245810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.245972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.246131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.246425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.246720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.246858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.931 qpair failed and we were unable to recover it. 00:31:18.931 [2024-10-13 16:55:44.246950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.931 [2024-10-13 16:55:44.247051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.247193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.247424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.247732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.247888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.248021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.248251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.248511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.248796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.248914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.249010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.249336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.249623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.249878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.249989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.250146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.250442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.250683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.250803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.250922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.251159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.251385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.251648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.251854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.251988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.252069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.252274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.252519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.252721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.252855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.252950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.253198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.253456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.253729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.253837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.932 qpair failed and we were unable to recover it. 00:31:18.932 [2024-10-13 16:55:44.253975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.254090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.932 [2024-10-13 16:55:44.254115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.254266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.254539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.254838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.254975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.255058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.255379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.255627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.255842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.255982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.256161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.256427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.256697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.256874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.256957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.257170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.257426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.257680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.257851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.258028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.258280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.258541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.258747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.258899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.259027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.259321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.259544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.259742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.259879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.259986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.260202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.260473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.260740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.260849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.260964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.261216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.261483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.933 qpair failed and we were unable to recover it. 00:31:18.933 [2024-10-13 16:55:44.261732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.933 [2024-10-13 16:55:44.261874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.261899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.262022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.262262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.262545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.262786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.262917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.262990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.263188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.263459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.263725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.263835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.263950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.264229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.264529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.264822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.264972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.265084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.265377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.265614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.265829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.265995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.266130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.266454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.266685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.266797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.266935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.267264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.267528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.267797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.267911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.268025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.268284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.268599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.934 [2024-10-13 16:55:44.268714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.934 qpair failed and we were unable to recover it. 00:31:18.934 [2024-10-13 16:55:44.268835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.268946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.268972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.269086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.269326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.269559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.269783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.269893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.269979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.270235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.270545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.270746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.270889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.270972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.271195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.271470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.271731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.271840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.271955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.272189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.272450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.272685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.272875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.272987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.273217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.273494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.273753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.273853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.274137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.274412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.274694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.274825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.935 [2024-10-13 16:55:44.274964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.275053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.935 [2024-10-13 16:55:44.275078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.935 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.275227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.275497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.275749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.275889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.276005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.276286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.276539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.276802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.276956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.277079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.277353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.277619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.277866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.277972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.278060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.278277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.278590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.278818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.278972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.279051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.279336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.279583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.279847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.279993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.280080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.280343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.280596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.280857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.280996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.281137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.281338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.281576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.281824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.281936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.282050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.282197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.282227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.936 [2024-10-13 16:55:44.282362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.282544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.936 [2024-10-13 16:55:44.282571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.936 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.282661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.282780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.282807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.282890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.283137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.283330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.283617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.283779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.283936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.284220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.284514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.284757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.284909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.285025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.285247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.285536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.285782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.285886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.285999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.286221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.286538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.286772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.286915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.287013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.287241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.287488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.287748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.287880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.287974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.288221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.288466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.288717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.288856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.288942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.289257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.289572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.937 [2024-10-13 16:55:44.289843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.937 [2024-10-13 16:55:44.289964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.937 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.290101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.290298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.290531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.290835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.290999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.291114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.291302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.291542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.291799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.291929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.292036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.292284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.292558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.292755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.292892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.293031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.293251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.293486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.293760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.293931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.294020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.294273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.294513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.294703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.294840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.294932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.295154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.295435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.295655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.295880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.295992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.296130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.296411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.296652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.938 [2024-10-13 16:55:44.296790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.938 qpair failed and we were unable to recover it. 00:31:18.938 [2024-10-13 16:55:44.296918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.296991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.297166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.297384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.297728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.297839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.297989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.298210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.298497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.298769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.298964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.299080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.299408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.299657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.299852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.299972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.300224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.300522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.300763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.300918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.301003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.301346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.301608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.301829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.301940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.302027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.302303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.302558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.302805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.302915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.302997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.303102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.939 [2024-10-13 16:55:44.303127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.939 qpair failed and we were unable to recover it. 00:31:18.939 [2024-10-13 16:55:44.303236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.303427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.303615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.303848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.303952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.304034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.304252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.304435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.304628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.304874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.304985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.305070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.305253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.305487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.305701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.305877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.305984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.306092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.306315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.306530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.306739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.306842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.306920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.307155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.307354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.307586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.307810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.307942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.308053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.308135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.308160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.308267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.308356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.308386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.940 qpair failed and we were unable to recover it. 00:31:18.940 [2024-10-13 16:55:44.308489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.940 [2024-10-13 16:55:44.308605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.308630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.308723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.308806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.308831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.308918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.309110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.309333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.309526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.309710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.309848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.309996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.310247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.310500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.310728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.310869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.310957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.311178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.311407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.311642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.311867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.311980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.312064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.312270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.312529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.312756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.312895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.313009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.313230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.313491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.313712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.313818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.313899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.314189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.314387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.314604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.941 [2024-10-13 16:55:44.314842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.941 [2024-10-13 16:55:44.314980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.941 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.315090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.315343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.315539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.315766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.315900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.315979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.316235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.316441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.316657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.316849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.316984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.317100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.317328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.317567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.317792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.317903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.318022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.318236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.318464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.318669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.318860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.318966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.319048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.319313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.319534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.319769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.319905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.319998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.320192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.320388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.320636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.320836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.320966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.942 [2024-10-13 16:55:44.321052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.321160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.942 [2024-10-13 16:55:44.321185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.942 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.321264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.321495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.321732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.321879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.321972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.322223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.322513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.322759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.322880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.323079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.323362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.323609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.323777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.323907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.324192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.324481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.324782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.324996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.325128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.325386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.325662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.325861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.325993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.326108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.326376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.326580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.326809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.326926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.327040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.327265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.327517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.327720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.327840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.943 qpair failed and we were unable to recover it. 00:31:18.943 [2024-10-13 16:55:44.327944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.943 [2024-10-13 16:55:44.328027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.328143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.328427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.328632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.328875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.328986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.329072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.329258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.329550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.329783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.329926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.330043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.330237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.330498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.330730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.330835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.330948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.331205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.331402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.331621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.331831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.331990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.332115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.332369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.332581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.332843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.332960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.333057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.333287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.333577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.333723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.333861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.334132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.944 qpair failed and we were unable to recover it. 00:31:18.944 [2024-10-13 16:55:44.334359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.944 [2024-10-13 16:55:44.334512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.334599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.334690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.334717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.334831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.334920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.334946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.335029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.335222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.335462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.335693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.335832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.335967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.336236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.336525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.336782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.336978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.337186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.337507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.337846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.337980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.338089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.338371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.338623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.338877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.339160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.339429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.339641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.339899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.339989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.340126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.340368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.340592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.340792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.340916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.341209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.341485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.945 [2024-10-13 16:55:44.341615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.945 qpair failed and we were unable to recover it. 00:31:18.945 [2024-10-13 16:55:44.341717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.341879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.341913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.342096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.342309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.342596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.342855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.342976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.343134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.343434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.343692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.343849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.343988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.344266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.344508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.344719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.344864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.344960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.345258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.345608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.345850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.345970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.346088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.346366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.346641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.346811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.346988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.347199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.347425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.347707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.347836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.347983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.348303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.348623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.348884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.348972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.349001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.349123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.349245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.349274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.946 qpair failed and we were unable to recover it. 00:31:18.946 [2024-10-13 16:55:44.349374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.946 [2024-10-13 16:55:44.349486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.349514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.349636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.349785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.349817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.349955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.350229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.350545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.350786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.350938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.351025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.351253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.351489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.351726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.351875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.351970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.352173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.352401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.352633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.352784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.352934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.353273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.353628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.353796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.353922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.354139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.354424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.354695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.354898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.354985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.355115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.355404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.355621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.355841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.355987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.356087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.356300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.356553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.356815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.947 [2024-10-13 16:55:44.356961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.947 qpair failed and we were unable to recover it. 00:31:18.947 [2024-10-13 16:55:44.357105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.357348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.357557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.357811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.357986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.358135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.358430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.358688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.358818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.358943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.359246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.359541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.359827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.359960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.360089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.360339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.360565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.360782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.360898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.361032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.361298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.361588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.361804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.361956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.362065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.362337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.362617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.362768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.362889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.363165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.363414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.363641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.363791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.363907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.364006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.364032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.364119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.364215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.364241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.948 qpair failed and we were unable to recover it. 00:31:18.948 [2024-10-13 16:55:44.364335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.948 [2024-10-13 16:55:44.364430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.364462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.364557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.364639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.364667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.364747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.364870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.364898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.364993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.365223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.365528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.365731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.365879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.366048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.366327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.366578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.366829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.366955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.367073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.367339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.367568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.367762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.367872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.367992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.368205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.368474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.368725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.368895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.368985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.369294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.369541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.369816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.369945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.370066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.370185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.370230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.949 qpair failed and we were unable to recover it. 00:31:18.949 [2024-10-13 16:55:44.370369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.949 [2024-10-13 16:55:44.370488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.370520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.370637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.370720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.370750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.370861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.370993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.371243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.371528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.371814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.371933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.372095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.372358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.372651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.372795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.372902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.373260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.373645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.373781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.373951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.374184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.374445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.374688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.374812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.374959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.375306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.375611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.375856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.375969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.376086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.376337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.376551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.376768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.376996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.377167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.377392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.377704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.950 qpair failed and we were unable to recover it. 00:31:18.950 [2024-10-13 16:55:44.377906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.377994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.950 [2024-10-13 16:55:44.378022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.378129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.378384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.378663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.378788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.378883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.379160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.379482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.379772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.379886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.380002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.380261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.380510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.380752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.380879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.380994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.381230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.381483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.381690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.381836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.381958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.382187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.382403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.382648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.382794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.382915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.383188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.383471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.383696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.383844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.383974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.384219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.384422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.384679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.384792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.384890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.385157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.385421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.951 [2024-10-13 16:55:44.385569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.951 qpair failed and we were unable to recover it. 00:31:18.951 [2024-10-13 16:55:44.385655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.385769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.385800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.385895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.386189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.386440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.386735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.386852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.386990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.387209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.387512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:18.952 [2024-10-13 16:55:44.387639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:18.952 qpair failed and we were unable to recover it. 00:31:18.952 [2024-10-13 16:55:44.387740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.387868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.387897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.388008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.388218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.388458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.388661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.388906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.388996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.389164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.389406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.389654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.389867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.389984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.390083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.390286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.390531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.390754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.390882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.391009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.391254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.391512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.391754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.391882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.391985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.392297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.392567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.392825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.392974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.393068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.393307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.393510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.393751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.393898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.232 qpair failed and we were unable to recover it. 00:31:19.232 [2024-10-13 16:55:44.394067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.232 [2024-10-13 16:55:44.394180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.394206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.394344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.394472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.394500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.394614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.394762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.394789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.394936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.395233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.395498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.395785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.395923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.396035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.396273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.396581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.396853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.396976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.397154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.397507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.397793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.397929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.398013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.398306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.398555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.398821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.398993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.399093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.399380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.399727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.399903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.400005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.400286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.400587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.400764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.400897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.401201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.401489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.401760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.401922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.402085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.402253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.402278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.402418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.402553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.402581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.233 qpair failed and we were unable to recover it. 00:31:19.233 [2024-10-13 16:55:44.402721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.233 [2024-10-13 16:55:44.402834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.402860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.403016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.403288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.403646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.403886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.403998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.404117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.404415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.404717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.404870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.404994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.405221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.405487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.405764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.405944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.406066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.406363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.406683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.406833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.406957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.407157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.407471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.407693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.407855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.407964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.408208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.408429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.408701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.408851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.408998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.409311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.409518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.409752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.409905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.410008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.410227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.410447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.234 qpair failed and we were unable to recover it. 00:31:19.234 [2024-10-13 16:55:44.410709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.234 [2024-10-13 16:55:44.410848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.411007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.411262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.411543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.411879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.411989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.412133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.412455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.412752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.412864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.412952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.413195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.413435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.413710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.413900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.414021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.414281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.414511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.414774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.414937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.415076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.415340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.415615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.415751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.415880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.416159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.416434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.416705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.416830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.416943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.417205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.417406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.417699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.417882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.418046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.418324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.418590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.418895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.418976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.235 [2024-10-13 16:55:44.419001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.235 qpair failed and we were unable to recover it. 00:31:19.235 [2024-10-13 16:55:44.419107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.419405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.419687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.419827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.419930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.420179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.420506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.420758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.420857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.420970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.421230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.421526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.421838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.421987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.422121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.422374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.422595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.422729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.422862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.423134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.423352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.423607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.423749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.423877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.424153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.424473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.424797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.424955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.425106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.425368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.425566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.236 [2024-10-13 16:55:44.425785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.236 [2024-10-13 16:55:44.425926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.236 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.426012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.426219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.426522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.426865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.426974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.427112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.427387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.427735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.427848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.427982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.428281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.428570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.428816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.428939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.429033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.429268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.429560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.429864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.429986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.430142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.430475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.430742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.430885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.431020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.431292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.431622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.431868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.431980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.432064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.432288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.432567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.432815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.432979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.433139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.433422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.433630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.433798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.433922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.434050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.237 [2024-10-13 16:55:44.434078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.237 qpair failed and we were unable to recover it. 00:31:19.237 [2024-10-13 16:55:44.434216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.434402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.434691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.434833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.434923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.435209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.435484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.435720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.435855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.436019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.436268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.436593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.436825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.436973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.437121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.437407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.437594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.437807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.437968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.438128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.438401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.438670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.438818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.438927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.439111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.439347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.439664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.439801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.439909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.440196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.440503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.440818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.440989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.441115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.441384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.441636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.238 [2024-10-13 16:55:44.441858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.238 [2024-10-13 16:55:44.441993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.238 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.442110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.442332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.442587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.442794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.442943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.443061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.443263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.443544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.443757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.443862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.444000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.444253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.444539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.444769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.444955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.445054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.445291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.445564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.445787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.445923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.446022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.446236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.446529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.446810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.446957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.447084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.447330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.447551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.447843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.447949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.448064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.448268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.448515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.448793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.448920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.449050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.449147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.449175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.449288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.449382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.449420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.239 qpair failed and we were unable to recover it. 00:31:19.239 [2024-10-13 16:55:44.449558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.239 [2024-10-13 16:55:44.449665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.449689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.449775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.449936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.449965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.450070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.450318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.450570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.450804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.450955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.451089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.451318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.451521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.451824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.451929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.452062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.452324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.452562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.452808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.452971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.453045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.453276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.453464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.453710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.453826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.453962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.454207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.454419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.454680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.454879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.454983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.455073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.455318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.455512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.240 [2024-10-13 16:55:44.455732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.240 [2024-10-13 16:55:44.455855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.240 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.455958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.456213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.456489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.456774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.456911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.457029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.457251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.457474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.457689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.457814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.457930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.458161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.458456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.458718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.458869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.458973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.459194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.459445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.459777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.459904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.460034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.460273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.460545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.460813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.460981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.461093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.461357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.461597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.461817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.461981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.462090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.462315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.462580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.462869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.462986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.463074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.463209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.463235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.463345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.463498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.463541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.241 qpair failed and we were unable to recover it. 00:31:19.241 [2024-10-13 16:55:44.463658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.241 [2024-10-13 16:55:44.463760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.463786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.463922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.464187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.464480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.464754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.464902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.465068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.465349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.465582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.465847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.465983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.466090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.466348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.466668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.466829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.466991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.467278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.467548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.467816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.467978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.468080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.468348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.468667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.468833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.468912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.469150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.469470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.469772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.469937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.470102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.470388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.470703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.470828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.470954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.471210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.471464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.471688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.471801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.242 qpair failed and we were unable to recover it. 00:31:19.242 [2024-10-13 16:55:44.471913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.242 [2024-10-13 16:55:44.472051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.472219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.472526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.472804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.472920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.473046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.473320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.473583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.473859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.473978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.474085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.474356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.474549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.474782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.474939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.475049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.475290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.475538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.475778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.475942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.476064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.476411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.476629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.476792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.476891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.477227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.477504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.477790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.477943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.478060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.478311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.478598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.478868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.478992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.479138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.479440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.479713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.479832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.243 [2024-10-13 16:55:44.479944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.480062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.243 [2024-10-13 16:55:44.480087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.243 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.480174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.480527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.480790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.480953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.481114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.481405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.481664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.481777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.481903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.482174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.482458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.482767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.482916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.483005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.483335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.483608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.483788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.483910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.484198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.484449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.484695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.484863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.485003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.485280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.485525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.485815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.485948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.486101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.486432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.486680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.486810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.486974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.487239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.487519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.487813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.487982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.488095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.488251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.488279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.488448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.488559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.488584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.244 qpair failed and we were unable to recover it. 00:31:19.244 [2024-10-13 16:55:44.488721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.244 [2024-10-13 16:55:44.488815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.488843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.488936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.489190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.489440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.489658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.489805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.489918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.490133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.490417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.490699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.490863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.490999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.491276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.491598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.491845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.491996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.492082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.492308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.492497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.492710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.492850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.492928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.493168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.493444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.493724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.493831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.494001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.494223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.494519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.494779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.494907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.495014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.495260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.245 qpair failed and we were unable to recover it. 00:31:19.245 [2024-10-13 16:55:44.495567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.245 [2024-10-13 16:55:44.495687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.495801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.495949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.495977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.496110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.496307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.496547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.496733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.496871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.496950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.497204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.497473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.497746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.497900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.498023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.498273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.498485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.498743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.498918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.499026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.499296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.499531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.499754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.499859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.499930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.500216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.500519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.500794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.500937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.501037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.501332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.501606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.501876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.501997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.502158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.502442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.502681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.502800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.502963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.503049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.503075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.503195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.503336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.246 [2024-10-13 16:55:44.503361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.246 qpair failed and we were unable to recover it. 00:31:19.246 [2024-10-13 16:55:44.503536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.503662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.503690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.503818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.503896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.503921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.504056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.504276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.504596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.504850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.504982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.505070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.505351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.505615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.505867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.505994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.506104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.506425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.506672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.506820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.506986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.507255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.507553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.507837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.507975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.508100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.508312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.508606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.508855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.508971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.509119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.509435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.509686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.509812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.509951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.510198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.510475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.510754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.510908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.511020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.511138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.511163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.511285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.511418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.511448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.247 qpair failed and we were unable to recover it. 00:31:19.247 [2024-10-13 16:55:44.511575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.247 [2024-10-13 16:55:44.511697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.511723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.511807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.511916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.511945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.512088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.512343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.512684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.512867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.512957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.513232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.513511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.513818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.513934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.514026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.514322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.514607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.514865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.514958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.515139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.515406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.515679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.515828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.515957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.516214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.516524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.516756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.516916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.517045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.517320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.517582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.517785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.517931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.518055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.518311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.518610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.518848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.518971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.519071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.519180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.519206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.519352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.519521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.519550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.248 qpair failed and we were unable to recover it. 00:31:19.248 [2024-10-13 16:55:44.519674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.248 [2024-10-13 16:55:44.519797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.519825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.519929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.520131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.520355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.520657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.520792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.520915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.521182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.521508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.521740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.521870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.522009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.522237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.522440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.522747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.522936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.523076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.523318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.523618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.523866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.523971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.524098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.524376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.524576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.524793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.524927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.525088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.525347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.525661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.525772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.525921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.526188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.526428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.249 [2024-10-13 16:55:44.526538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.249 qpair failed and we were unable to recover it. 00:31:19.249 [2024-10-13 16:55:44.526623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.526737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.526762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.526907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.527191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.527415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.527661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.527885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.527997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.528119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.528407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.528658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.528818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.528919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.529192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.529435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.529740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.529884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.530017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.530207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.530450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.530789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.530938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.531053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.531659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.531790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.531953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.532225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.532450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.532665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.532831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.532918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.533257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.533581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.533825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.533941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.534081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.534370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.250 qpair failed and we were unable to recover it. 00:31:19.250 [2024-10-13 16:55:44.534668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.250 [2024-10-13 16:55:44.534817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.534952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.535226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.535542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.535859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.535997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.536178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.536457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.536739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.536877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.537034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.537308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.537596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.537840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.537958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.538108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.538390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.538653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.538807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.538908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.539163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.539434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.539739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.539865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.539940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.540208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.540492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.540750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.540891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.540971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.541264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.541545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.541802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.541953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.542066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.542287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.542592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.542823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.251 [2024-10-13 16:55:44.542972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.251 qpair failed and we were unable to recover it. 00:31:19.251 [2024-10-13 16:55:44.543119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.543337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.543577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.543828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.543936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.544093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.544400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.544663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.544916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.544997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.545112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.545385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.545652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.545802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.545952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.546182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.546410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.546682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.546832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.546933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.547206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.547488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.547714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.547878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.548009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.548294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.548588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.548772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.548940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.549097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.549415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.549717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.549895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.550026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.550282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.550631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.550853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.550971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.551001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.252 qpair failed and we were unable to recover it. 00:31:19.252 [2024-10-13 16:55:44.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.252 [2024-10-13 16:55:44.551265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.551293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.551483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.551583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.551615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.551771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.551914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.551948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.552123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.552400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.552700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.552816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.552914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.553148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.553380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.553686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.553815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.553946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.554225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.554500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.554708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.554890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.554985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.555309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.555531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.555834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.555955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.556077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.556327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.556566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.556775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.556942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.557045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.557300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.557618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.557896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.557991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.558017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.558113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.558206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.558235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.253 qpair failed and we were unable to recover it. 00:31:19.253 [2024-10-13 16:55:44.558362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.253 [2024-10-13 16:55:44.558455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.558483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.558622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.558724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.558754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.558901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.559176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.559417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.559664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.559805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.559902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.560143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.560421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.560747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.560892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.561037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.561328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.561605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.561787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.561908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.562146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.562427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.562676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.562897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.562988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.563176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.563419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.563650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.563834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.563976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.564240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.564547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.564854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.564970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.565105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.565405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.565648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.565869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.565979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.566010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.566146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.566276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.566305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.254 [2024-10-13 16:55:44.566417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.566506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.254 [2024-10-13 16:55:44.566533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.254 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.566624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.566719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.566747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.566882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.566979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.567106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.567352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.567639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.567869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.567990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.568083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.568343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.568575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.568856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.568999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.569136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.569432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.569708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.569856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.569975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.570250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.570522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.570785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.570910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.571012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.571264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.571548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.571809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.571956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.572073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.572331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.572587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.572835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.572975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.573132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.573438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.573699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.573870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.573969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.574067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.574097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.574215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.574308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.574342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.255 qpair failed and we were unable to recover it. 00:31:19.255 [2024-10-13 16:55:44.574447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.255 [2024-10-13 16:55:44.574545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.574574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.574681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.574765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.574794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.574894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.574986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.575162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.575375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.575623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.575767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.575891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.576168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.576442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.576648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.576787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.576901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.577182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.577430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.577678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.577801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.577891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.578160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.578361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.578653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.578817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.578938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.579260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.579534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.579758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.579895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.579986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.580209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.580442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.580756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.580950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.581050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.581341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.581635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.581897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.581984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.582014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.256 [2024-10-13 16:55:44.582132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.582250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.256 [2024-10-13 16:55:44.582278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.256 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.582377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.582503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.582534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.582626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.582710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.582740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.582851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.582977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.583108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.583421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.583638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.583809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.583931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.584203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.584546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.584803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.584938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.585039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.585309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.585534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.585815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.585925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.586041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.586297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.586591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.586839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.586985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.587149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.587428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.587684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.587801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.587940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.588194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.588544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.588811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.588975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.589109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.589242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.589272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.257 [2024-10-13 16:55:44.589385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.589545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.257 [2024-10-13 16:55:44.589575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.257 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.589670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.589786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.589813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.589921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.590182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.590523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.590794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.590910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.591050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.591305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.591527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.591731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.591881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.591979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.592276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.592533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.592776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.592929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.593047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.593326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.593616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.593872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.593998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.594166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.594455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.594717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.594870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.595012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.595304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.595578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.595763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.595861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.596169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.596497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.596773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.596973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.597084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.597215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.597250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.597399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.597485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.597512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.258 qpair failed and we were unable to recover it. 00:31:19.258 [2024-10-13 16:55:44.597608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.258 [2024-10-13 16:55:44.597701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.597740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.597874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.597964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.597991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.598124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.598405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.598694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.598814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.598921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.599185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.599421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.599679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.599817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.599942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.600180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.600420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.600689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.600840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.600963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.601248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.601558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.601809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.601943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.602033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.602280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.602577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.602896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.602987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.603174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.603435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.603674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.603802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.603921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.604230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.604550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.604780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.604928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.605036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.605328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.259 [2024-10-13 16:55:44.605550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.259 [2024-10-13 16:55:44.605707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.259 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.605802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.605908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.605939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.606066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.606333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.606570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.606816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.606962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.607102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.607411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.607694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.607832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.607933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.608174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.608438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.608680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.608805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.608929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.609176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.609416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.609681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.609847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.609993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.610212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.610485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.610724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.610910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.611071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.611339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.611611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.611864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.611980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.612104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.612367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.612659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.612889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.612999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.613139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.613414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.260 qpair failed and we were unable to recover it. 00:31:19.260 [2024-10-13 16:55:44.613683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.260 [2024-10-13 16:55:44.613802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.613829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.613975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.614214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.614422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.614705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.614825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.614959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.615182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.615425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.615659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.615901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.615980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.616116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.616369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.616616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.616874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.616998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.617142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.617368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.617683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.617805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.617939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.618231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.618587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.618835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.618982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.619068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.619292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.619528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.619779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.619912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.620027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.620276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.620576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.620810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.620926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.621021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.621118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.621144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.261 qpair failed and we were unable to recover it. 00:31:19.261 [2024-10-13 16:55:44.621251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.261 [2024-10-13 16:55:44.621370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.621412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.621506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.621597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.621628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.621751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.621865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.621909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.622037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.622297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.622563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.622787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.622900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.623017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.623244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.623464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.623724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.623856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.623950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.624197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.624429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.624664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.624897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.624998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.625117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.625323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.625552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.625768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.625882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.626002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.626273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.626491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.626751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.626893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.626999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.627244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.627528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.262 qpair failed and we were unable to recover it. 00:31:19.262 [2024-10-13 16:55:44.627771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.262 [2024-10-13 16:55:44.627896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.627924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.628020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.628233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.628509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.628795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.628919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.629064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.629309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.629554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.629863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.629998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.630152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.630403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.630662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.630789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.630921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.631155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.631373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.631691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.631839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.631933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.632154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.632375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.632620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.632862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.632987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.633105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.633370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.633589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.633807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.633950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.634074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.634276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.634516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.634731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.634852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.263 [2024-10-13 16:55:44.634950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.635063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.263 [2024-10-13 16:55:44.635093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.263 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.635195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.635434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.635699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.635822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.635944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.636161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.636466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.636705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.636821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.636935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.637204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.637446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.637675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.637883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.637979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.638121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.638448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.638727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.638874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.638988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.639301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.639591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.639839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.639995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.640115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.640327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.640582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.640880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.640971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.641091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.641338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.641582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.641824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.641931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.642061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.642384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.642652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.264 qpair failed and we were unable to recover it. 00:31:19.264 [2024-10-13 16:55:44.642858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.264 [2024-10-13 16:55:44.642982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.643112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.643371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.643675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.643803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.643903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.644181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.644437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.644703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.644819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.644944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.645191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.645452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.645704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.645861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.646006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.646275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.646558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.646783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.646905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.646990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.647221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.647495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.647777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.647923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.648075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.648287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.648539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.648787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.648943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.649053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.649353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.649659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.649787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.649937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.650248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.650474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.265 [2024-10-13 16:55:44.650710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.265 [2024-10-13 16:55:44.650823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.265 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.650933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.651169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.651375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.651631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.651861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.651977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.652087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.652350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.652616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.652817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.652976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.653128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.653422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.653683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.653859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.653970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.654215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.654509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.654754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.654875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.655046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.655341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.655630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.655753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.655873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.656170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.656424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.656737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.656889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.657037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.657371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.657629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.657770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.266 qpair failed and we were unable to recover it. 00:31:19.266 [2024-10-13 16:55:44.657892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.658004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.266 [2024-10-13 16:55:44.658038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.658208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.658487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.658770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.658896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.659040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.659334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.659650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.659827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.659949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.660169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.660482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.660733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.660885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.661047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.661262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.661568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.661783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.661925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.662039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.662311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.662609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.662877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.662999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.663147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.663424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.663674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.663794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.663952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.664197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.664400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.664672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.664811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.664975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.665303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.665599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.665818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.665990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.666082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.666194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.267 [2024-10-13 16:55:44.666223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.267 qpair failed and we were unable to recover it. 00:31:19.267 [2024-10-13 16:55:44.666375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.666478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.666506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.666607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.666688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.666718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.666876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.666997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.667170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.667431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.667675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.667820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.667942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.668157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.668411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.668680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.668859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.668983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.669259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.669509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.669722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.669864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.669959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.670202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.670457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.670742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.670855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.670998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.671235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.671528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.671744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.671889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.672023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.672332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.672618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.672767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.672873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.673134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.673431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.673736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.673856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.673973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.674090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.268 [2024-10-13 16:55:44.674117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.268 qpair failed and we were unable to recover it. 00:31:19.268 [2024-10-13 16:55:44.674261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.674577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.674826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.674936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.675086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.675302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.675594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.675844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.675990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.676175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.676434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.676683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.676827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.676915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.677171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.677427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.677630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.677894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.677987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.678117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.678367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.678695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.678886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.679023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.679247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.679482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.679719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.679855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.679938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.680233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.680430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.680674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.680826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.680973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.681208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.681425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.681743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.681867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.269 qpair failed and we were unable to recover it. 00:31:19.269 [2024-10-13 16:55:44.681974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.269 [2024-10-13 16:55:44.682086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.682206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.682477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.682757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.682897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.683059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.683296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.683559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.683862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.683979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.684118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.684364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.684621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.684822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.684961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.685093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.685407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.685696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.685832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.685947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.686189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.686458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.686738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.686875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.687016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.687255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.687555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.687831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.687949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.688047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.688318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.688542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.688781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.688893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.270 qpair failed and we were unable to recover it. 00:31:19.270 [2024-10-13 16:55:44.689042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.270 [2024-10-13 16:55:44.689145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.689325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.689595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.689847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.689958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.690046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.690259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.690585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.690787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.690923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.691063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.691314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.691569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.691806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.691954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.692121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.692343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.692547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.692791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.692930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.693066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.693366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.693733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.693871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.693959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.694287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.694579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.694831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.694947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.695056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.695321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.695595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.695845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.695998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.696133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.696382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.696616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.696782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.271 qpair failed and we were unable to recover it. 00:31:19.271 [2024-10-13 16:55:44.696929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.697011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.271 [2024-10-13 16:55:44.697035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.697165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.697451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.697777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.697891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.698033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.698351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.698689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.698853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.698957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.699263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.699555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.699817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.699953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.700036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.700327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.700573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.700749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.700897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.701203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.701526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.701806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.701982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.702083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.702364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.702692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.702838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.702940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.703156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.703373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.703682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.703825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.703914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.704189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.704521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.704833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.704969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.705050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.705163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.705188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.272 [2024-10-13 16:55:44.705346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.705501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.272 [2024-10-13 16:55:44.705526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.272 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.705621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.705730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.705754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.705868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.705952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.705977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.706092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.706296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.706531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.706795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.706924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.707007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.707215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.707520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.707761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.707943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.708061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.708327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.708537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.708765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.708916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.709023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.709222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.709440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.709702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.709874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.710031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.710276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.273 [2024-10-13 16:55:44.710548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.273 [2024-10-13 16:55:44.710693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.273 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.710772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.710861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.710887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.711004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.711265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.711539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.711757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.711931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.712040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.712308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.712578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.712833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.712954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.713052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.713337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.713586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.713833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.713976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.714107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.714404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.714687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.714814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.714927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.715179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.715468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.715765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.715946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.716028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.716109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.716135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.716247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.716355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.716405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.554 qpair failed and we were unable to recover it. 00:31:19.554 [2024-10-13 16:55:44.716526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.554 [2024-10-13 16:55:44.716669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.716694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.716833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.716972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.717175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.717464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.717783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.717925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.718027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.718354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.718606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.718828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.718951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.719072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.719321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.719565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.719817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.719974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.720100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.720341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.720570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.720841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.720985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.721149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.721431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.721662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.721862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.721972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.722085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.722403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.722722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.722849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.722973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.723314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.723606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.723857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.723979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.724008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.724122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.724256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.724282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.724363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.724482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.555 [2024-10-13 16:55:44.724512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.555 qpair failed and we were unable to recover it. 00:31:19.555 [2024-10-13 16:55:44.724631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.724756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.724786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.724922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.725147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.725458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.725777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.725945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.726074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.726325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.726581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.726847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.726998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.727130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.727385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.727626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.727867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.727989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.728182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.728441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.728654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.728799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.728956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.729179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.729453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.729727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.729896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.730036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.730311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.730533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.730774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.730953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.731044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.731343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.731588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.731836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.731999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.732139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.732256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.732280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.732405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.732535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.732564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.556 qpair failed and we were unable to recover it. 00:31:19.556 [2024-10-13 16:55:44.732715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.556 [2024-10-13 16:55:44.732837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.732864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.732995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.733336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.733588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.733833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.733964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.734114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.734384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.734641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.734787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.734947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.735256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.735548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.735844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.735994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.736115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.736422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.736688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.736832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.736980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.737263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.737589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.737852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.737973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.738091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.738365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.738678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.738840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.738944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.739276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.739536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.739866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.739979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.740174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.740466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.740745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.557 [2024-10-13 16:55:44.740880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.557 qpair failed and we were unable to recover it. 00:31:19.557 [2024-10-13 16:55:44.740958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.741210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.741480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.741733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.741871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.741996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.742272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.742480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.742793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.742952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.743064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.743311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.743539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.743804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.743941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.744028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.744286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.744565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.744780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.744918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.744995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.745268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.745534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.745751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.745888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.746030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.746145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.746170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.746272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.746423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.558 [2024-10-13 16:55:44.746452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.558 qpair failed and we were unable to recover it. 00:31:19.558 [2024-10-13 16:55:44.746553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.746675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.746703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.746806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.746894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.746920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.747034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.747295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.747645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.747819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.747954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.748218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.748522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.748801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.748965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.749116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.749427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.749701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.749851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.749945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.750221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.750524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.750795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.750912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.751077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.751307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.751651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.751771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.751901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.752150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.752439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.752729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.752840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.752976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.753212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.753474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.753703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.753824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.753949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.754211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.754533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.559 qpair failed and we were unable to recover it. 00:31:19.559 [2024-10-13 16:55:44.754803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.559 [2024-10-13 16:55:44.754929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.754957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.755069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.755361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.755673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.755847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.755953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.756247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.756603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.756895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.756982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.757148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.757433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.757663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.757826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.757959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.758242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.758481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.758731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.758867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.758971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.759287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.759550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.759847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.759981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.760090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.760346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.760615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.760842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.760984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.761100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.761355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.560 qpair failed and we were unable to recover it. 00:31:19.560 [2024-10-13 16:55:44.761622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.560 [2024-10-13 16:55:44.761761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.761843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.761978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.762173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.762521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.762798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.762910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.763029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.763286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.763540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.763771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.763932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.764072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.764298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.764542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.764803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.764936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.765047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.765354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.765683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.765858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.765994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.766229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.766507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.766754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.766903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.767036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.767362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.767661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.767853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.767948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.768211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.768491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.768837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.768986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.561 qpair failed and we were unable to recover it. 00:31:19.561 [2024-10-13 16:55:44.769118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.561 [2024-10-13 16:55:44.769207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.769350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.769593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.769837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.769940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.770022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.770350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.770656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.770800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.770937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.771152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.771408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.771736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.771879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.772038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.772280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.772541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.772791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.772976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.773067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.773366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.773726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.773879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.773982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.774241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.774525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.774773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.774921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.775053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.775348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.775642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.775895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.775984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.776012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.776134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.776232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.562 [2024-10-13 16:55:44.776260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.562 qpair failed and we were unable to recover it. 00:31:19.562 [2024-10-13 16:55:44.776399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.776556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.776582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.776691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.776789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.776817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.776920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.777168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.777384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.777627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.777862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.777997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.778137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.778387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.778636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.778867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.778988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.779109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.779408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.779642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.779771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.779915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.780173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.780452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.780725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.780845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.780985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.781282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.781582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.781727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.781888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.782163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.782390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.563 [2024-10-13 16:55:44.782746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.563 [2024-10-13 16:55:44.782885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.563 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.782987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.783260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.783535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.783768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.783893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.784044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.784277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.784536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.784857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.784982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.785140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.785339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.785637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.785775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.785931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.786197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.786458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.786666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.786803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.786942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.787212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.787526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.787758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.787902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.787996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.788300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.788592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.788829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.788979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.789093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.789376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.789728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.789867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.564 [2024-10-13 16:55:44.789973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.790076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.564 [2024-10-13 16:55:44.790101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.564 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.790223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.790459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.790718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.790830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.790972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.791188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.791476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.791722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.791860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.791941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.792186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.792446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.792743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.792890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.793035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.793287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.793505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.793777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.793941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.794030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.794243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.794577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.794774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.794922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.795008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.795262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.795495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.795711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.795820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.795929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.796184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.796502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.796834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.796950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.565 qpair failed and we were unable to recover it. 00:31:19.565 [2024-10-13 16:55:44.797083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.565 [2024-10-13 16:55:44.797203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.797348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.797636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.797857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.797977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.798129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.798376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.798652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.798838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.798948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.799265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.799492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.799768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.799943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.800043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.800280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.800586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.800850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.800989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.801073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.801347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.801639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.801795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.801950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.802236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.802539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.802837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.802968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.803102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.803374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.803630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.803900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.803987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.804137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.804391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.804633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.566 [2024-10-13 16:55:44.804758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.566 qpair failed and we were unable to recover it. 00:31:19.566 [2024-10-13 16:55:44.804905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.805214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.805468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.805709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.805824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.805911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.806159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.806477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.806738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.806865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.807014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.807213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.807441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.807762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.807882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.807982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.808225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.808558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.808810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.808953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.809040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.809255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.809500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.809762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.809914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.810056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.810326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.810627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.810858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.810972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.811131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.811410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.811658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.811772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.567 qpair failed and we were unable to recover it. 00:31:19.567 [2024-10-13 16:55:44.811902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.812012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.567 [2024-10-13 16:55:44.812042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.812167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.812438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.812736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.812927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.813034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.813298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.813574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.813845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.813952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.814040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.814306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.814552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.814802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.814947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.815118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.815350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.815632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.815864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.815971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.816075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.816285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.816546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.816759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.816906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.817014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.817329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.817618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.568 qpair failed and we were unable to recover it. 00:31:19.568 [2024-10-13 16:55:44.817854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.568 [2024-10-13 16:55:44.817973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.818103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.818366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.818638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.818841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.818957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.819190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.819424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.819665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.819807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.819933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.820171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.820427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.820776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.820900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.821104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.821403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.821648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.821768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.821897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.822137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.822411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.822779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.822913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.823055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.823297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.823542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.823770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.823923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.824049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.824286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.824592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.824806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.824978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.825071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.825192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.825220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.825316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.825430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.825461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.569 qpair failed and we were unable to recover it. 00:31:19.569 [2024-10-13 16:55:44.825611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.569 [2024-10-13 16:55:44.825726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.825756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.825844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.825962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.825989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.826078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.826290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.826593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.826872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.826996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.827097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.827350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.827598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.827817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.827932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.828022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.828265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.828512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.828767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.828925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.829060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.829349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.829590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.829815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.829971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.830074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.830292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.830526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.830737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.830856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.830946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.831219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.831464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.831669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.831819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.831909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.832179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.832421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.832716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.832838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.570 [2024-10-13 16:55:44.832935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.833058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.570 [2024-10-13 16:55:44.833087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.570 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.833198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.833452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.833724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.833872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.833992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.834231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.834502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.834728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.834867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.834991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.835240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.835517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.835790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.835939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.836062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.836333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.836603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.836777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.836900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.837212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.837472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.837752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.837893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.838014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.838246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.838511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.838761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.838942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.839028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.839295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.839512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.839799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.839963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.840114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.840343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.840596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.840821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.571 [2024-10-13 16:55:44.840961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.571 qpair failed and we were unable to recover it. 00:31:19.571 [2024-10-13 16:55:44.841072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.841298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.841526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.841778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.841886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.841985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.842207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.842474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.842697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.842899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.842980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.843093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.843280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.843539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.843758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.843921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.844047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.844282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.844520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.844707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.844846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.844952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.845180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.845408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.845692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.845908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.845996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.846165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.846406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.846660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.846866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.846970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.572 qpair failed and we were unable to recover it. 00:31:19.572 [2024-10-13 16:55:44.847041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.572 [2024-10-13 16:55:44.847120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.847233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.847457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.847691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.847794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.847879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.848159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.848386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.848603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.848875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.848992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.849130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.849337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.849590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.849778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.849940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.850052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.850295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.850525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.850742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.850883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.850988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.851198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.851401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.851620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.851891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.851990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.852096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.852337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.852546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.852752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.852890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.852983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.853170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.853392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.853624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.573 [2024-10-13 16:55:44.853835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.573 [2024-10-13 16:55:44.853987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.573 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.854112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.854335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.854592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.854833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.854960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.855043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.855321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.855584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.855819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.855921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.856008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.856269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.856539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.856745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.856854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.856945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.857166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.857480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.857670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.857818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.857897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.858148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.858453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.858671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.858808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.858914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.859136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.859356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.859562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.859761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.859909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.860027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.860217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.860477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.860767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.860906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.860989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.861064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.574 [2024-10-13 16:55:44.861089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.574 qpair failed and we were unable to recover it. 00:31:19.574 [2024-10-13 16:55:44.861176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.861417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.861657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.861819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.861899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.862138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.862367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.862630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.862764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.862946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.863150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.863403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.863645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.863868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.863999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.864079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.864301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.864507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.864709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.864857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.865038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.865312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.865603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.865807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.865921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.866033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.866277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.866547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.866810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.866975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.867082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.867353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.867616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.867760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.867907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.868209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.868477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.575 [2024-10-13 16:55:44.868603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.575 qpair failed and we were unable to recover it. 00:31:19.575 [2024-10-13 16:55:44.868699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.868799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.868833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.868953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.869222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.869448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.869684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.869840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.869984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.870314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.870593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.870831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.870952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.871047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.871286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.871520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.871806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.871966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.872161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.872372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.872587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.872812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.872926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.873019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.873271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.873622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.873773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.873911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.874169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.874417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.874663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.874811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.874907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.875146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.875366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.875593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.576 qpair failed and we were unable to recover it. 00:31:19.576 [2024-10-13 16:55:44.875852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.576 [2024-10-13 16:55:44.875964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.876091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.876343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.876565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.876848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.876971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.877139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.877405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.877660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.877815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.877941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.878181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.878468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.878739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.878923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.879072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.879342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.879667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.879848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.880002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.880237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.880488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.880709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.880829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.880944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.881220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.881510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.881730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.881842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.881941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.882257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.882509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.882801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.882942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.883073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.883196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.883232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.577 [2024-10-13 16:55:44.883351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.883471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.577 [2024-10-13 16:55:44.883503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.577 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.883614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.883712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.883740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.883860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.883934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.883959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.884106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.884348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.884609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.884823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.884933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.885012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.885213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.885407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.885662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.885805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.885913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.886138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.886423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.886664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.886847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.886986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.887101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.887349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.887636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.887879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.887975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.888127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.888372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.888626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.888867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.888978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.889051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.889268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.889487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.889698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.889807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.889938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.890067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.890095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.578 qpair failed and we were unable to recover it. 00:31:19.578 [2024-10-13 16:55:44.890197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.578 [2024-10-13 16:55:44.890288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.890442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.890685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.890916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.890999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.891133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.891345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.891572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.891809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.891920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.892079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.892320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.892577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.892764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.892894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.893001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.893253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.893491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.893749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.893879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.893981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.894213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.894498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.894706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.894855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.894949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.895261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.895551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.895796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.895969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.896093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.896329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.896569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.896888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.896988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.897018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.897109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.897201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.579 [2024-10-13 16:55:44.897227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.579 qpair failed and we were unable to recover it. 00:31:19.579 [2024-10-13 16:55:44.897330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.897560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.897811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.897915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.898003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.898198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.898466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.898682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.898795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.898936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.899117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.899407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.899651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.899877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.899982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.900066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.900289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.900539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.900809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.900933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.901047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.901247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.901471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.901768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.901922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.902027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.902288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.902567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.902699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.902840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.903183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.903418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.903650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.903787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.903900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.904204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.904421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.580 qpair failed and we were unable to recover it. 00:31:19.580 [2024-10-13 16:55:44.904678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.580 [2024-10-13 16:55:44.904762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.904788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.904908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.905130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.905385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.905647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.905844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.905981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.906059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.906309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.906660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.906807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.906934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.907135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.907452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.907656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.907911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.907998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.908143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.908386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.908687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.908849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.908981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.909362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.909651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.909906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.909990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.910162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.910436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.910730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.910850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.910968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.911219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.581 [2024-10-13 16:55:44.911545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.581 [2024-10-13 16:55:44.911652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.581 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.911805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.911900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.911944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.912045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.912325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.912603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.912846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.912999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.913114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.913413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.913698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.913830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.913953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.914215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.914472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.914765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.914904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.915089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.915373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.915722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.915846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.916034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.916349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.916601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.916793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.916943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.917224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.917464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.917751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.917893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.918027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.918266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.918534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.918799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.918949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.919076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.919372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.919565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.919857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.919977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.920006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.582 qpair failed and we were unable to recover it. 00:31:19.582 [2024-10-13 16:55:44.920191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.582 [2024-10-13 16:55:44.920314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.920343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.920449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.920523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.920549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.920643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.920756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.920783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.920938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.921175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.921471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.921781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.921945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.922064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.922304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.922586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.922727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.922837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.923150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.923444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.923739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.923902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.924021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.924287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.924621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.924806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.924956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.925237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.925546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.925830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.925978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.926095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.926401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.926732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.926887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.927016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.927290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.927564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.927851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.927962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.928070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.928346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.583 qpair failed and we were unable to recover it. 00:31:19.583 [2024-10-13 16:55:44.928600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.583 [2024-10-13 16:55:44.928721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.928851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.929114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.929372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.929640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.929820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.929943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.930204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.930434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.930711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.930820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.930930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.931168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.931405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.931695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.931794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.931877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.932194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.932465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.932731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.932849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.932947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.933238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.933535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.933856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.933971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.934153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.934435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.934673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.934839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.935006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.935247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.935514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.935831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.935996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.936138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.936417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.584 [2024-10-13 16:55:44.936672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.584 [2024-10-13 16:55:44.936779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.584 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.936857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.936935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.936961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.937075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.937340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.937571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.937742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.937853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.938207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.938466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.938768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.938911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.939042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.939326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.939530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.939811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.939919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.940042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.940317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.940579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.940815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.940974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.941097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.941327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.941635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.941791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.941944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.942172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.942505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.942770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.942891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.943058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.943288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.943606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.585 qpair failed and we were unable to recover it. 00:31:19.585 [2024-10-13 16:55:44.943832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.585 [2024-10-13 16:55:44.943922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.943949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.944039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.944349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.944655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.944804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.944915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.945131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.945457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.945805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.945952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.946078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.946402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.946678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.946797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.946878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.947150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.947426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.947676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.947856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.947992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.948211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.948548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.948776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.948946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.949086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.949386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.949642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.949778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.949883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.950165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.950504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.950731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.950885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.951040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.951281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.951505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.586 [2024-10-13 16:55:44.951642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.586 qpair failed and we were unable to recover it. 00:31:19.586 [2024-10-13 16:55:44.951723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.951877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.951906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.952068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.952313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.952574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.952854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.952988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.953149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.953438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.953721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.953840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.953981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.954264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.954515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.954731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.954919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.955049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.955360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.955581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.955882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.955999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.956093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.956372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.956605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.956869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.956976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.957087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.957340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.957661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.957771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.957912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.958210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.958439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.958674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.958833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.958959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.959119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.959145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.587 [2024-10-13 16:55:44.959227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.959340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.587 [2024-10-13 16:55:44.959367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.587 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.959457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.959596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.959622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.959712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.959807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.959840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.959974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.960199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.960456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.960687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.960822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.960920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.961185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.961465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.961725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.961845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.961970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.962225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.962487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.962725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.962877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.963023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.963250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.963528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.963813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.963923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.964033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.964328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.964647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.964779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.964879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.965163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.965429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.965752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.965864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.966015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.966279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.966589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.966840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.966958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.588 [2024-10-13 16:55:44.967061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.967167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.588 [2024-10-13 16:55:44.967192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.588 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.967344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.967592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.967819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.967954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.968084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.968374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.968636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.968800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.968947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.969237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.969487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.969762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.969887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.970020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.970268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.970552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.970744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.970895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.971234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.971576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.971850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.971960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.972073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.972402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.972643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.972829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.972987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.973231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.973560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.973842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.973980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.974090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.974377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.974658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.974789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.974916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.975253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.589 [2024-10-13 16:55:44.975593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.589 [2024-10-13 16:55:44.975731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.589 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.975915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.976154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.976484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.976751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.976929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.977052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.977334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.977660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.977814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.977898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.978187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.978430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.978726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.978832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.978922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.979156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.979414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.979744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.979911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.980069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.980291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.980571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.980777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.980891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.981052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.981322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.981573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.981796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.981963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.982105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.982665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.590 [2024-10-13 16:55:44.982822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.590 qpair failed and we were unable to recover it. 00:31:19.590 [2024-10-13 16:55:44.982964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.983234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.983497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.983730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.983899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.984033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.984280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.984599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.984794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.984894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.985173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.985443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.985704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.985849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.985953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.986245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.986550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.986853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.986977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.987137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.987426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.987734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.987886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.988030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.988291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.988585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.988810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.988941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.989018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.989303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.989595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.989846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.989991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.990109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.990484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.990802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.990971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.991085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.991208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.991236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.591 qpair failed and we were unable to recover it. 00:31:19.591 [2024-10-13 16:55:44.991404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.591 [2024-10-13 16:55:44.991542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.991567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.991714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.991836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.991864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.992013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.992285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.992542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.992812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.992926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.993055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.993284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.993537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.993888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.993994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.994127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.994385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.994721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.994876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.995043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.995302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.995567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.995817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.995981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.996133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.996384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.996695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.996857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.996974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.997291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.997545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.997810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.997928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.998021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.998256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.998570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.998882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.998997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.999023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.999156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.999286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.999316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.592 [2024-10-13 16:55:44.999408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.999559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.592 [2024-10-13 16:55:44.999587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.592 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:44.999699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:44.999820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:44.999845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:44.999978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.000224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.000535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.000816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.000963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.001052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.001312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.001594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.001826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.001974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.002132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.002389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.002699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.002809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.002926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.003144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.003443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.003694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.003808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.003935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.004226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.004553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.004791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.004903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.004988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.005252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.005501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.005748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.005930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.006039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.006287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.006497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.006817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.006952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.593 qpair failed and we were unable to recover it. 00:31:19.593 [2024-10-13 16:55:45.007119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.593 [2024-10-13 16:55:45.007233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.007377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.007619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.007863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.007991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.008173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.008406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.008675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.008787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.008909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.009155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.009410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.009720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.009866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.010002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.010234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.010471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.010800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.010907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.010999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.011239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.011476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.011704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.011836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.011931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.012171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.012459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.012727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.012911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.013023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.013136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.013161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.594 qpair failed and we were unable to recover it. 00:31:19.594 [2024-10-13 16:55:45.013300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.594 [2024-10-13 16:55:45.013425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.013454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.013572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.013694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.013722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.013823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.013927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.013952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.014074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.014284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.014573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.014786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.014893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.015009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.015258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.015520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.015756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.015901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.016001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.016275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.016554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.016794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.016927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.017039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.017309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.017582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.017749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.020545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.020665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.020697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.020856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.020983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.021143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.021383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.021665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.021856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.021964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.022211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.022484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.022738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.022875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.595 [2024-10-13 16:55:45.023032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.023145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.595 [2024-10-13 16:55:45.023173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.595 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.023331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.023589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.023823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.023974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.024055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.024301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.024559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.024757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.024880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.025150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.025428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.025698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.025802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.025879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.026144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.026439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.026653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.026866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.026998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.027109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.027351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.027637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.027779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.027940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.028212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.028471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.028773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.028937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.029069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.029259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.029525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.029794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.029972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.030071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.030315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.030566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.596 qpair failed and we were unable to recover it. 00:31:19.596 [2024-10-13 16:55:45.030800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.596 [2024-10-13 16:55:45.030915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.030991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.031237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.031508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.031811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.031963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.032050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.032146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.032171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.032285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.032416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.597 [2024-10-13 16:55:45.032445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.597 qpair failed and we were unable to recover it. 00:31:19.597 [2024-10-13 16:55:45.032545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.032639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.032667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.877 qpair failed and we were unable to recover it. 00:31:19.877 [2024-10-13 16:55:45.032771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.032870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.032896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.877 qpair failed and we were unable to recover it. 00:31:19.877 [2024-10-13 16:55:45.032988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.033071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.877 [2024-10-13 16:55:45.033096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.877 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.033176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.033436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.033656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.033817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.033903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.034139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.034327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.034582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.034851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.034986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.035074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.035271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.035669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.035807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.035898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.036135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.036414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.036679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.036802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.036924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.037190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.037441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.037752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.037870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.037976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.038228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.038513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.038758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.038896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.039002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.039275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.039582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.039796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.878 [2024-10-13 16:55:45.039937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.878 qpair failed and we were unable to recover it. 00:31:19.878 [2024-10-13 16:55:45.040034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.040371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.040653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.040815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.040967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.041228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.041515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.041771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.041925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.042057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.042249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.042463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.042705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.042875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.042972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.043203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.043529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.043813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.043997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.044082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.044355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.044623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.044846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.044963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.045060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.045284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.045609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.045767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.045929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.046201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.046445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.046693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.046798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.046872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.047024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.879 [2024-10-13 16:55:45.047050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.879 qpair failed and we were unable to recover it. 00:31:19.879 [2024-10-13 16:55:45.047154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.047357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.047626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.047783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.047906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.048194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.048378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.048658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.048760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.048867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.049161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.049436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.049701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.049831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.049913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.050205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.050473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.050668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.050800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.050926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.051201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.051475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.051672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.051815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.051941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.052190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.052401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.052625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.052831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.052939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.053030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.053272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.053527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.053734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.053908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.880 [2024-10-13 16:55:45.054057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.054172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.880 [2024-10-13 16:55:45.054202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.880 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.054319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.054458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.054494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.054598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.054726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.054761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.054903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.054995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.055146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.055384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.055623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.055889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.055977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.056123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.056333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.056690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.056815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.056950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.057285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.057556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.057780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.057959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.058073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.058279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.058568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.058822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.058997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.059121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.059346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.059616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.059849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.059987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.060117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.060404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.060728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.060845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.060927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.061135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.061362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.061584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.881 qpair failed and we were unable to recover it. 00:31:19.881 [2024-10-13 16:55:45.061825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.881 [2024-10-13 16:55:45.061911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.061941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.062034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.062302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.062551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.062809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.062951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.063041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.063361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.063671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.063797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.063920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.064183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.064451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.064663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.064894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.064975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.065126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.065363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.065640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.065861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.065976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.066102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.066329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.066574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.066817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.066996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.067108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.067350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.067654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.067872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.067980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.882 qpair failed and we were unable to recover it. 00:31:19.882 [2024-10-13 16:55:45.068102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.882 [2024-10-13 16:55:45.068226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.068358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.068594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.068867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.068980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.069159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.069430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.069682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.069850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.069979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.070254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.070499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.070759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.070883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.071015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.071295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.071562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.071834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.071954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.072047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.072307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.072545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.072755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.072898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.073028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.073262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.073535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.073881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.073975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.074157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.074418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.074628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.074896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.074994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.075024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.075135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.075245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.075273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.075371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.075486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.883 [2024-10-13 16:55:45.075515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.883 qpair failed and we were unable to recover it. 00:31:19.883 [2024-10-13 16:55:45.075611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.075707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.075734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.075850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.075941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.075971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.076056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.076307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.076565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.076791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.076942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.077058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.077291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.077526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.077805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.077917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.078053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.078307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.078563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.078846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.078997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.079123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.079417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.079661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.079803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.079948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.080185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.080428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.080661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.080865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.080972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.081088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.081323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.081572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.081831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.081978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.082091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.082176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.082203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.884 qpair failed and we were unable to recover it. 00:31:19.884 [2024-10-13 16:55:45.082336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.884 [2024-10-13 16:55:45.082422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.082452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.082534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.082628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.082659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.082749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.082827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.082854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.082952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.083219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.083508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.083727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.083888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.083980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.084244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.084479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.084727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.084866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.084948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.085258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.085514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.085760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.085876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.085965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.086211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.086492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.086766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.086876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.087006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.087329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.087556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.087793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.087917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.088055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.088307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.088567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.088820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.088948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.885 [2024-10-13 16:55:45.089071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.089165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.885 [2024-10-13 16:55:45.089195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.885 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.089288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.089382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.089418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.089542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.089693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.089723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.089865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.089980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.090107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.090352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.090629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.090801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.090941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.091230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.091530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.091690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.091862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.092222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.092515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.092756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.092896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.092983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.093233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.093533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.093813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.093970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.094143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.094430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.094694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.094848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.094985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.095243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.095546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.095814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.095982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.096121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.096403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.886 [2024-10-13 16:55:45.096641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.886 [2024-10-13 16:55:45.096765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.886 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.096910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.096994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.097116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.097470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.097854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.097954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.098175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.098486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.098714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.098890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.099065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.099326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.099633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.099777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.099895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.100213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.100489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.100739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.100868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.100965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.101251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.101588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.101894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.101975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.102095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.102313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.102592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.887 [2024-10-13 16:55:45.102738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.887 qpair failed and we were unable to recover it. 00:31:19.887 [2024-10-13 16:55:45.102872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.102978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.103117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.103452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.103712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.103854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.104003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.104254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.104512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.104733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.104885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.105033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.105275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.105530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.105782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.105933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.106025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.106293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.106594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.106765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.106894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.107169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.107391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.107618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.107866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.107985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.108140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.108382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.108637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.108874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.108975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.109131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.109426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.109673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.109785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.109909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.110024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.110051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.110132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.110241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.888 [2024-10-13 16:55:45.110269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.888 qpair failed and we were unable to recover it. 00:31:19.888 [2024-10-13 16:55:45.110420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.110557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.110587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.110705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.110798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.110832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.110951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.111157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.111424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.111659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.111785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.111917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.112211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.112525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.112761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.112912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.113023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.113249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.113473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.113725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.113832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.113925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.114252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.114542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.114748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.114909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.115012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.115243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.115510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.115763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.115928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.116044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.116247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.116484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.116738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.116843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.889 qpair failed and we were unable to recover it. 00:31:19.889 [2024-10-13 16:55:45.116927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.889 [2024-10-13 16:55:45.117014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.117150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.117336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.117545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.117747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.117855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.117967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.118197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.118451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.118699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.118813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.118923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.119144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.119339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.119531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.119783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.119885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.119962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.120170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.120405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.120653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.120785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.120895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.121107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.121358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.121640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.121833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.121948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.122045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.122221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.122447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.122680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.122792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.122906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.123017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.123043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.890 qpair failed and we were unable to recover it. 00:31:19.890 [2024-10-13 16:55:45.123156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.123259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.890 [2024-10-13 16:55:45.123284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.123357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.123582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.123797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.123934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.124023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.124283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.124522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.124738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.124878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.124993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.125188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.125444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.125693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.125826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.125967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.126201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.126453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.126714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.126857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.126942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.127252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.127527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.127723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.127874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.127968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.128174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.128410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.128608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.128830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.128966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.891 qpair failed and we were unable to recover it. 00:31:19.891 [2024-10-13 16:55:45.129106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.129229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.891 [2024-10-13 16:55:45.129254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.129335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.129549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.129773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.129916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.130024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.130219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.130453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.130702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.130840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.130951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.131202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.131430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.131660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.131860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.131970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.132054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.132332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.132556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.132813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.132916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.133026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.133254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.133505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.133706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.133817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.133962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.134214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.134430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.134691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.134840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.134988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.135213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.135459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.135767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.135933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.136017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.136273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.136536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.136755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.136871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.136992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.137077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.892 [2024-10-13 16:55:45.137104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.892 qpair failed and we were unable to recover it. 00:31:19.892 [2024-10-13 16:55:45.137224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.137463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.137683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.137906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.137985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.138128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.138380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.138614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.138802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.138914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.138999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.139254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.139539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.139766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.139872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.139990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.140202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.140418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.140633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.140875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.140984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.141066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.141307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.141571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.141815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.141958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.142047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.142264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.142539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.142804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.142967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.143054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.143245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.143541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.143764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.143881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.143973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.144166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.144416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.144621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.144909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.144993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.145163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.145368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.145631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.145814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.145923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.146003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.146117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.146143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.893 qpair failed and we were unable to recover it. 00:31:19.893 [2024-10-13 16:55:45.146236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.146382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.893 [2024-10-13 16:55:45.146423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.146510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.146594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.146622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.146730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.146844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.146870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.146948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.147172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.147461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.147703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.147809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.147900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.148128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.148351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.148605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.148855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.148967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.149082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.149296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.149527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.149785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.149912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.150080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.150308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.150577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.150824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.150940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.151033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.151298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.151532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.151724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.151886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.152020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.152239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.152572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.152814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.152938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.153062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.153272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.153535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.153768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.153937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.154037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.154295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.154576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.154810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.154969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.155103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.155345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.155575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.155792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.155945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.894 [2024-10-13 16:55:45.156079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.156222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.894 [2024-10-13 16:55:45.156251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.894 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.156373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.156498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.156524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.156613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.156733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.156776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.156886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.157141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.157380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.157636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.157871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.157992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.158141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.158405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.158685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.158802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.158921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.159174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.159366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.159630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.159784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.159951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.160233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.160468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.160670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.160802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.160936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.161182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.161448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.161651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.161867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.161977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.162085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.162321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.162589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.162848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.162963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.163043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.163308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.163621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.163765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.163892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.164175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.164384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.164652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.164786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.164917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.165069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.895 [2024-10-13 16:55:45.165098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.895 qpair failed and we were unable to recover it. 00:31:19.895 [2024-10-13 16:55:45.165199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.165459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.165682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.165815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.165926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.166142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.166422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.166667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.166876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.166976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.167116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.167382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.167631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.167827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.167975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.168305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.168569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.168803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.168928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.169079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.169290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.169565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.169796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.169905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.170042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.170342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.170589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.170821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.170965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.171054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.171302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.171541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.171837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.171979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.172083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.172299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.172581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.172802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.172962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.173047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.173285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.173575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.173855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.173980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.174071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.174311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.174554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.174777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.174934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.896 qpair failed and we were unable to recover it. 00:31:19.896 [2024-10-13 16:55:45.175051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.896 [2024-10-13 16:55:45.175165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.175313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.175560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.175808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.175957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.176060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.176305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.176582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.176719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.176874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.177148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.177391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.177671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.177901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.177983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.178125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.178370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.178611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.178749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.178881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.179119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.179378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.179726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.179858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.179985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.180228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.180572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.180855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.180993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.181090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.181381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.181612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.181822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.181954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.182039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.182251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.182526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.182782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.182888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.183051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.183324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.183517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.183840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.183976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.184085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.184350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.184583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.184910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.184990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.185015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.185104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.185207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.897 [2024-10-13 16:55:45.185236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.897 qpair failed and we were unable to recover it. 00:31:19.897 [2024-10-13 16:55:45.185350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.185526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.185554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.185690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.185801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.185826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.185936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.186175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.186447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.186684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.186827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.186959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.187221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.187541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.187865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.187997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.188075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.188340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.188630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.188785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.188941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.189261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.189559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.189786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.189966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.190080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.190350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.190591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.190811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.190987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.191079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.191343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.191604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.191824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.191952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.192049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.192312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.192560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.192866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.192985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.193137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.193366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.193616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.193769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.193899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.194163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.194427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.898 [2024-10-13 16:55:45.194640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.898 [2024-10-13 16:55:45.194749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.898 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.194861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.194996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.195145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.195414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.195622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.195914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.195997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.196153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.196386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.196611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.196856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.196991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.197096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.197346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.197576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.197721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.197764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15a3e00 (9): Bad file descriptor 00:31:19.899 [2024-10-13 16:55:45.197970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.198293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.198548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.198799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.198982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.199103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.199379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.199659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.199797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.199907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.200142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.200480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.200762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.200918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.201041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.201291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.201579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.201819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.201929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.202044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.202301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.202565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.202727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.202879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.203199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.203510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.203780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.203922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.204038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.204322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.204583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.204734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.204868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.205163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.899 qpair failed and we were unable to recover it. 00:31:19.899 [2024-10-13 16:55:45.205437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.899 [2024-10-13 16:55:45.205605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.205745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.205861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.205887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.206021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.206220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.206513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.206739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.206887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.206984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.207268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.207504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.207779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.207924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.208040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.208252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.208524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.208811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.208930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.209082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.209333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.209578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.209729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.209848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.210175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.210422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.210685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.210853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.210988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.211261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.211582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.211862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.211997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.212136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.212361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.212626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.212809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.212948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.213212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.213464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.213725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.213860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.213973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.214224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.214549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.214743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.214862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.215144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.215405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.215675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.215810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.215928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.216041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.216067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.900 [2024-10-13 16:55:45.216141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.216254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.900 [2024-10-13 16:55:45.216279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.900 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.216398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.216622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.216830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.216979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.217095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.217310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.217653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.217826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.217954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.218244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.218546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.218833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.218986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.219035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.219168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.219309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.219336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.223426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.223595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.223627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.223775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.223900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.223929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.224045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.224348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.224631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.224838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.224979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.225126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.225420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.225747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.225931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.226059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.226382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.226585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.226776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.226925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.227216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.227499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.227772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.227916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.228055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.228292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.228609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.228800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.228909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.229182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.229407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.229684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.229845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.229930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.230192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.901 [2024-10-13 16:55:45.230497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.901 [2024-10-13 16:55:45.230609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.901 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.230744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.230839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.230868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.230964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.231231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.231537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.231839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.231985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.232111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.232328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.232645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.232822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.232955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.233185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.233456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.233715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.233859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.233978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.234235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.234539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.234805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.234990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.235126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.235375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.235625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.235848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.235989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.236133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.236414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.236724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.236849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.237018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.237304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.237575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.237816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.237920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.238041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.238295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.238546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.238782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.238941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.239102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.239380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.239698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.239883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.239977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.240264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.240530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.240796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.240916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.241054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.241169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.241195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.902 qpair failed and we were unable to recover it. 00:31:19.902 [2024-10-13 16:55:45.241316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.241473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.902 [2024-10-13 16:55:45.241500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.241617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.241778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.241807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.241942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.242212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.242543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.242807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.242946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.243054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.243289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.243602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.243772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.243882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.244158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.244398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.244614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.244789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.244891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.245175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.245490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.245800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.245950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.246102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.246337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.246582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.246811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.246916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.246999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.247314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.247608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.247878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.247992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.248149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.248400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.248623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.248773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.248898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.249177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.249448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.249682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.249824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.249986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.250253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.250517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.250801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.250940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.251056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.251351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.251620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.251844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.251979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.252006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.252156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.252302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.903 [2024-10-13 16:55:45.252331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.903 qpair failed and we were unable to recover it. 00:31:19.903 [2024-10-13 16:55:45.252463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.252551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.252576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.252694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.252800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.252828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.252953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.253330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.253644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.253872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.253983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.254157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.254400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.254674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.254841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.254931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.255191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.255521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.255803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.255906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.256066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.256320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.256570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.256837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.256991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.257114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.257404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.257601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.257850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.257954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.258032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.258248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.258501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.258764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.258876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.258956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.259163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.259382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.259633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.259743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.259856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.260133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.260330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.260563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.260873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.260992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.261116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.261397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.261647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.261784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.261940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.262209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.262491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.904 qpair failed and we were unable to recover it. 00:31:19.904 [2024-10-13 16:55:45.262730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.904 [2024-10-13 16:55:45.262832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.262859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.262975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.263239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.263513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.263702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.263907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.263986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.264130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.264375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.264641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.264777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.264934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.265201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.265488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.265707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.265872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.265992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.266286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.266561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.266831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.266978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.267102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.267366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.267641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.267755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.267915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.268005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.268031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.268172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.268287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.268312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.268445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.268993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.269147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.269435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.269660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.269813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.269919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.270184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.270493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.270781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.270887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.270999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.271218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.271448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.271644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.271758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.271911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.272146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.905 qpair failed and we were unable to recover it. 00:31:19.905 [2024-10-13 16:55:45.272417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.905 [2024-10-13 16:55:45.272537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.272703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.272814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.272839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.272945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.273164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.273429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.273677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.273838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.273969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.274259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.274574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.274886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.274992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.275164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.275482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.275746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.275888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.276011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.276299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.276620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.276806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.276941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.277182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.277366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.277612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.277831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.277944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.278073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.278267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.278548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.278834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.278984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.279134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.279361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.279578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.279793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.279913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.280019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.280229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.280455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.280675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.280829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.280910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.281147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.281443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.281691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.281820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.281939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.282217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.282517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.906 [2024-10-13 16:55:45.282770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.906 [2024-10-13 16:55:45.282909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.906 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.283045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.283310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.283551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.283863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.283997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.284127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.284403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.284645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.284823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.284994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.285273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.285525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.285856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.285975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.286135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.286359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.286560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.286885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.286976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.287107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.287379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.287712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.287825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.287936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.288234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.288491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.288723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.288887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.289002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.289228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.289515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.289783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.289933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.290085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.290376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.290649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.290839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.290932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.291176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.291411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.291684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.291818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.291958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.292196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.292411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.292644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.292879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.292984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.293008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.293122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.293203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.293228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.907 qpair failed and we were unable to recover it. 00:31:19.907 [2024-10-13 16:55:45.293334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.293433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.907 [2024-10-13 16:55:45.293458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.293592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.293738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.293766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.293888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.294197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.294429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.294643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.294824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.294967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.295196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.295470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.295745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.295871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.296036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.296266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.296523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.296817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.296935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.297028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.297271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.297475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.297785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.297911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.298070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.298268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.298497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.298759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.298863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.298947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.299189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.299411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.299632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.299872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.299996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.300133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.300343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.300583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.300841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.300978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.301057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.301319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.301580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.301762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.301904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.302231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.302462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.908 qpair failed and we were unable to recover it. 00:31:19.908 [2024-10-13 16:55:45.302664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.908 [2024-10-13 16:55:45.302764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.302788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.302891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.303179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.303411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.303714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.303839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.303970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.304174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.304435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.304787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.304970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.305167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.305427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.305636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.305798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.305885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.306202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.306436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.306691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.306878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.306986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.307203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.307416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.307606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.307873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.307994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.308164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.308465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.308641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.308771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.308938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.309197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.309427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.309649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.309806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.309944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.310221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.310499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.310825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.310978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.311135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.311369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.311650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.311787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.311942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.312219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.312490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.312748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.909 [2024-10-13 16:55:45.312874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.909 qpair failed and we were unable to recover it. 00:31:19.909 [2024-10-13 16:55:45.313007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.313269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.313565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.313823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.313981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.314181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.314447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.314700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.314878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.315046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.315269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.315500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.315769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.315893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.316015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.316312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.316628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.316744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.316892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.317138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.317465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.317756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.317915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.318021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.318305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.318557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.318855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.318987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.319152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.319454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.319685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.319849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.319969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.320217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.320506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.320756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.320866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.320958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.321177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.321514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.321727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.321849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.321938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.322263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.322482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.322719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.322839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.323038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.323296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.323558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.910 [2024-10-13 16:55:45.323710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.910 qpair failed and we were unable to recover it. 00:31:19.910 [2024-10-13 16:55:45.323844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.323938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.323969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.324099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.324333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.324553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.324793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.324906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.325026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.325311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.325521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.325745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.325898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.326004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.326197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.326511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.326765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.326874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.326968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.327260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.327573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.327820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.327975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.328139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.328365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.328648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.328796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.328914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.329180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.329389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.329575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.329892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.329982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.330118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.330307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.330683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.330782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.330893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.331186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.331430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.331740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.331857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.331957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.332190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.332410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.332734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.332891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.911 [2024-10-13 16:55:45.333062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.333184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.911 [2024-10-13 16:55:45.333215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.911 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.333353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.333479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.333513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.333653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.333784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.333814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.333968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.334285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.334536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.334838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.334974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.335079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.335336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.335618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.335871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.335992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f4000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.336167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.336422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.336641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.336864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.336992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.337127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.337354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.337593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.337859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.337960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.338037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.338286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.338558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.338766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.338890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.339054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.339313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.339516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.339782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.339943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.340091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.340414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.340714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.340910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.341056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.341294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.341552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.341801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.341942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.342047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.342329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.342574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.342844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.342961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.343102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.343328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.343608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.343803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.912 qpair failed and we were unable to recover it. 00:31:19.912 [2024-10-13 16:55:45.343957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.912 [2024-10-13 16:55:45.344058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.344231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.344507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.344768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.344899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.344989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.345283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.345526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.345810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.345988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.346120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.346382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.346662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.346804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.347017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.347296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.347570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.347713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.347886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.348151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.348432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.348678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.348807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.348932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.349248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.349499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.349758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.349895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.349988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.350287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.350596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.350796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.350944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.351237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.351542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.351840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.351967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.352056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.352334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.352580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.352830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.352976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.353113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.353404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.353632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.353804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.353917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.354191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.354450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.354695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.354817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.913 qpair failed and we were unable to recover it. 00:31:19.913 [2024-10-13 16:55:45.354925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.913 [2024-10-13 16:55:45.355006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.355163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.355392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.355672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.355790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.355912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.356213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:19.914 [2024-10-13 16:55:45.356499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:19.914 [2024-10-13 16:55:45.356644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:19.914 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.356737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.356860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.356893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.356984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.357227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.357449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.357673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.357794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.357913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.358158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.358460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.358749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.358877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.359037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.359282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.359595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.359808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.359983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.360124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.360375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.360621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.360798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.360889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.361136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.361406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.196 qpair failed and we were unable to recover it. 00:31:20.196 [2024-10-13 16:55:45.361665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.196 [2024-10-13 16:55:45.361847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.361957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.362188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.362430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.362672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.362849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.362998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.363290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.363542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.363823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.363989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.364081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.364349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.364622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.364816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.364911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.365193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.365469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.365758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.365893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.366009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.366292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.366552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.366803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.366922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.367070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.367330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.367593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.367853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.367970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.368135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.368387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.368656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.368784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.368896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.369138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.369366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.197 qpair failed and we were unable to recover it. 00:31:20.197 [2024-10-13 16:55:45.369636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.197 [2024-10-13 16:55:45.369758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.369792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.369903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.370208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.370450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.370685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.370808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.370914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.371173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.371437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.371721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.371861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.371977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.372219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.372465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.372776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.372906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.373002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.373208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.373429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.373727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.373909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.374033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.374270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.374580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.374706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.374887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.375176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.375492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.375717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.375831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.375943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.376229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.376455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.376723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.376877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.377006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.377116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.198 [2024-10-13 16:55:45.377145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.198 qpair failed and we were unable to recover it. 00:31:20.198 [2024-10-13 16:55:45.377287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.377527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.377802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.377924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.378020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.378344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.378620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.378746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.378920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.379168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.379469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.379719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.379869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.379962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.380244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.380523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.380810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.380969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.381117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.381410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.381674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.381801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.381926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.382230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.382514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.382752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.382889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.382987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.383312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.383567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.383770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.383898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.384172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.384467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.384723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.384908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.199 qpair failed and we were unable to recover it. 00:31:20.199 [2024-10-13 16:55:45.385059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.199 [2024-10-13 16:55:45.385179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.385209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.385328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.385432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.385462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.385561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.385682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.385738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.385886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.386176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.386476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.386766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.386952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.387075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.387315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.387562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.387862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.387974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.388108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.388341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.388613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.388831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.388971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.389140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.389390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.389695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.389860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.390001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.390240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.390523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.390756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.390911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.391056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.391172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.200 [2024-10-13 16:55:45.391200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.200 qpair failed and we were unable to recover it. 00:31:20.200 [2024-10-13 16:55:45.391356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.391463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.391497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.391622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.391774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.391809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.391962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.392184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.392487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.392763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.392878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.392996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.393249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.393498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.393777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.393912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.394028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.394358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.394587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.394730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.394863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.395134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.395471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.395697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.395897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.396021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.396230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.396536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.396820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.396970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.397107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.397378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.397626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.397775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.397907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.398193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.398445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.398654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.398884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.398999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.399026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.201 qpair failed and we were unable to recover it. 00:31:20.201 [2024-10-13 16:55:45.399160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.201 [2024-10-13 16:55:45.399245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.399273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.399359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.399473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.399507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.399624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.399765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.399794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.399896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.400114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.400353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.400634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.400796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.400911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.401185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.401530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.401853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.401975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.402123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.402380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.402604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.402874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.402995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.403178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.403443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.403701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.403845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.403978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.404304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.404577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.404878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.404986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.405132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.405432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.405764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.405903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.406044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.406318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.406599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.406816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.406957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.407071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.407215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.407246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.202 qpair failed and we were unable to recover it. 00:31:20.202 [2024-10-13 16:55:45.407340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.202 [2024-10-13 16:55:45.407516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.407542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.407634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.407782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.407807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.407924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.408194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.408426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.408649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.408799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.408920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.409163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.409423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.409643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.409882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.409998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.410141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.410391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.410710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.410871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.410994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.411239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.411483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.411689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.411821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.411898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.412117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.412424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.412706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.412845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.412955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.413223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.413490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.413744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.413919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.414066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.414348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.414584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.203 qpair failed and we were unable to recover it. 00:31:20.203 [2024-10-13 16:55:45.414838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.203 [2024-10-13 16:55:45.414909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.414934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.415035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.415298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.415544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.415855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.415986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.416085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.416324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.416593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.416843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.416981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.417103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.417414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.417632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.417898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.417987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.418152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.418388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.418606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.418906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.418991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.419120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.419466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.419714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.419853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.420023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.420294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.420574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.420737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.420903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.421150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.421374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.421681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.421793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.421913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.422186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.422478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.204 qpair failed and we were unable to recover it. 00:31:20.204 [2024-10-13 16:55:45.422762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.204 [2024-10-13 16:55:45.422917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.422945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.423071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.423328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.423548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.423840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.423976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.424058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.424354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.424583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.424816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.424948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.425085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.425358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.425648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.425868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.425972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.426162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.426420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.426735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.426916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.427026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.427288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.427568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.427829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.427963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.428073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.428384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.428638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.428782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.428897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.429140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.205 qpair failed and we were unable to recover it. 00:31:20.205 [2024-10-13 16:55:45.429425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.205 [2024-10-13 16:55:45.429556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.429641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.429725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.429750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.429831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.429965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.430108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.430302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.430612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.430840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.430978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.431108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.431355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.431630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.431893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.431976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.432154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.432407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.432603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.432867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.432985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.433150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.433459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.433753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.433876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.434003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.434270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.434512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.434742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.434876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.434959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.435212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.435477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.435689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.435846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.436010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.436235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.436549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.436820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.436975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.206 [2024-10-13 16:55:45.437080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.437186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.206 [2024-10-13 16:55:45.437211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.206 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.437298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.437414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.437443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.437568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.437693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.437721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.437864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.437981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.438117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.438434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.438683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.438819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.438904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.439195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.439474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.439766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.439907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.440059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.440282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.440514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.440832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.440995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.441106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.441368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.441652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.441840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.441953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.442326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.442579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.442811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.442971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.443123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.443406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.443710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.443822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.443947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.444232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.444517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.444765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.444906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.445034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.445122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.445150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.207 [2024-10-13 16:55:45.445285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.445358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.207 [2024-10-13 16:55:45.445383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.207 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.445540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.445701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.445726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.445808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.445887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.445912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.446033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.446280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.446550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.446788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.446929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.447004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.447257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.447559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.447807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.447962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.448064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.448269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.448520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.448768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.448909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.449040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.449283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.449514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.449783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.449883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.450011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.450292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.450534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.450794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.450940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.451070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.451282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.451575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.451839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.451956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.452075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.452326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.208 [2024-10-13 16:55:45.452581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.208 [2024-10-13 16:55:45.452765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.208 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.452917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.453177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.453428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.453707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.453821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.453936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.454181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.454440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.454724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.454840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.454930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.455227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.455482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.455774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.456028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.456276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.456512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.456801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.456950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.457071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.457336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.457558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.457826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.457974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.458008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.458169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.458329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.458363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.458509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.458664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.458694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.458875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.459137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.459452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.209 [2024-10-13 16:55:45.459709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.209 [2024-10-13 16:55:45.459850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.209 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.460009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.460285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.460478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.460711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.460834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.460994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.461213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.461493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.461736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.461876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.462023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.462238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.462432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.462684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.462800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.462890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.463191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.463419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.463695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.463850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.463924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.464142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.464351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.464582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.464800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.464923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.465001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.465257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.465434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.465717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.465893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.466018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.466096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.466120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.210 qpair failed and we were unable to recover it. 00:31:20.210 [2024-10-13 16:55:45.466203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.466286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.210 [2024-10-13 16:55:45.466310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.466382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.466645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.466841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.466970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.467046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.467374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.467619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.467840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.467962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.468089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.468326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.468565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.468885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.468998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.469147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.469430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.469694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.469854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.469985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.470200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.470521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.470751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.470888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.471011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.471264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.471548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.471791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.471901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.472004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.472223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.472517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.472786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.472921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.473066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.473322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.473607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.211 qpair failed and we were unable to recover it. 00:31:20.211 [2024-10-13 16:55:45.473871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.211 [2024-10-13 16:55:45.473995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.474119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.474405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.474709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.474886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.475011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.475282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.475605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.475766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.475920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.476158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.476407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.476647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.476860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.476967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.477077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.477309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.477556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.477806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.477963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.478110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.478360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.478629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.478859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.478971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.479143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.479453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.479668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.479825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.479933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.480132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.480348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.480518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.212 qpair failed and we were unable to recover it. 00:31:20.212 [2024-10-13 16:55:45.480727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.212 [2024-10-13 16:55:45.480888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.480917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.481047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.481273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.481462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.481731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.481870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.482007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.482296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.482562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.482798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.482935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.483039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.483283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.483560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.483812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.483950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.484028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.484314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.484517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.484770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.484929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.485056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.485351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.485639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.485807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.485905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.486216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.486534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.486812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.486945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.487080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.487367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.487658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.487793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.213 [2024-10-13 16:55:45.487934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.488044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.213 [2024-10-13 16:55:45.488071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.213 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.488193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.488444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.488658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.488822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.488929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.489202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.489488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.489762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.489874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.490008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.490265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.490520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.490821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.490962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.491070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.491311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.491605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.491826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.491951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.492035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.492285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.492542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.492856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.492993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.493129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.493316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.493534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.493794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.493959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.494123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.494459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.214 [2024-10-13 16:55:45.494722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.214 [2024-10-13 16:55:45.494889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.214 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.495003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.495216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.495480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.495707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.495870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.496020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.496336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.496629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.496840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.496989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.497124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.497419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.497694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.497838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.498265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.498526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.498772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.498901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.498987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.499238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.499490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.499713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.499819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.499925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.500148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.500389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.500616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.500769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.500904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.501183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.501417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.501738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.501842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.501939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.502089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.215 [2024-10-13 16:55:45.502118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.215 qpair failed and we were unable to recover it. 00:31:20.215 [2024-10-13 16:55:45.502240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.502526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.502716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.502848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.502965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.503245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.503473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.503716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.503878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.504041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.504316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.504598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.504816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.504913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.505037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.505303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.505572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.505860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.505985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.506111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.506375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.506600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.506851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.506978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.507147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.507380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.507614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.507869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.507979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.508063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.508263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.508520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.508754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.508907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.509029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.509146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.509174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.216 [2024-10-13 16:55:45.509279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.509383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.216 [2024-10-13 16:55:45.509427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.216 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.509512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.509678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.509710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.509798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.509892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.509919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.510046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.510301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.510579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.510705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.510866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.511165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.511438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.511707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.511843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.511948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.512227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.512497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.512757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.512900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.513023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.513303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.513599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.513874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.513998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.514158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.514356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.514680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.514855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.514961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.515239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.515500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.515706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.515870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.516030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.516348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.217 [2024-10-13 16:55:45.516543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.217 [2024-10-13 16:55:45.516670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.217 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.516801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.516894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.516921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.517069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.517366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.517700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.517823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.517945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.518252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.518512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.518822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.518942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.519055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.519293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.519537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.519803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.519915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.520019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.520319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.520564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.520767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.520905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.520988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.521304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.521607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.521873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.521983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.522124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.522334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.522616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.522874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.522975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.523111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.523421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.218 qpair failed and we were unable to recover it. 00:31:20.218 [2024-10-13 16:55:45.523739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.218 [2024-10-13 16:55:45.523872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.524006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.524245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.524466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.524792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.524933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.525024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.525367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.525654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.525874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.525981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.526095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.526342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.526549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.526776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.526879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.526987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.527202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.527544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.527810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.527966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.528051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.528315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.528593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.528873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.528993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.529168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.529478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.529711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.529884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.529988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.530070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.530095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.530239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.530387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.530424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.219 qpair failed and we were unable to recover it. 00:31:20.219 [2024-10-13 16:55:45.530569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.219 [2024-10-13 16:55:45.530672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.530697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.530803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.530975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.531169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.531439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.531702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.531840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.531978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.532206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.532529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.532790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.532935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.533058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.533294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.533509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.533739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.533867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.533981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.534220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.534429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.534690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.534823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.534953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.535260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.535494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.535783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.535936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.536061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.536357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.536639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.536771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.536863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.537172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.220 [2024-10-13 16:55:45.537435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.220 [2024-10-13 16:55:45.537552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.220 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.537684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.537814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.537843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.537973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.538270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.538515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.538758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.538920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.539041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.539320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.539606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.539809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.539963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.540078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.540349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.540628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.540782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.540898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.541170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.541442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.541749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.541914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.542026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.542285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.542521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.542807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.542936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.543081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.543306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.543645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.543784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.543913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.544177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.544417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.544627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.544883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.544996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.545021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.221 qpair failed and we were unable to recover it. 00:31:20.221 [2024-10-13 16:55:45.545132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.221 [2024-10-13 16:55:45.545242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.545402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.545650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.545876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.545988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.546144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.546447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.546749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.546886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.547010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.547242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.547510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.547758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.547912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.548000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.548248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.548479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.548672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.548852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.548948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.549062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.549371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.549664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.549778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.549935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.550186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.550430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.550658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.550874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.550991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.551410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.551671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.551840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.551937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.552063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.552094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.222 qpair failed and we were unable to recover it. 00:31:20.222 [2024-10-13 16:55:45.552245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.552339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.222 [2024-10-13 16:55:45.552368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.552508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.552598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.552631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.552774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.552883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.552908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.553083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.553352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.553630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.553809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.553938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.554164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.554407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.554616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.554749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.554889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.555195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.555493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.555766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.555928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.556072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.556297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.556540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.556823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.556944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.557062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.557314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.557587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.557742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.557885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.558009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.558040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.558150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.558260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.558291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.223 qpair failed and we were unable to recover it. 00:31:20.223 [2024-10-13 16:55:45.558425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.223 [2024-10-13 16:55:45.558558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.558588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.558720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.558878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.558908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.559020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.559316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.559578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.559812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.559935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.560074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.560377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.560616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.560865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.560991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.561136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.561400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.561610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.561839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.561960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.562133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.562389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.562647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.562794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.562928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.563144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.563433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.563695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.563839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.563933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.564189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.564500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.564741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.564891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.565019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.565301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.565611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.224 qpair failed and we were unable to recover it. 00:31:20.224 [2024-10-13 16:55:45.565870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.224 [2024-10-13 16:55:45.565971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.565999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.566127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.566420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.566633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.566905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.566993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.567115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.567375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.567727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.567895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.568044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.568267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.568530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.568759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.568871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.568998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.569230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.569541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.569810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.569957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.570048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.570265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.570514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.570759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.570919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.571037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.571280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.571537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.571788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.571938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.572086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.572384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.572685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.572838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.572962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.573080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.573107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.225 qpair failed and we were unable to recover it. 00:31:20.225 [2024-10-13 16:55:45.573211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.225 [2024-10-13 16:55:45.573301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.573330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.573452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.573574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.573602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.573720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.573802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.573849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.573963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.574291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.574583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.574843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.574956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.575039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.575316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.575604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.575874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.575982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.576090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.576410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.576692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.576836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.576936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.577227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.577458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.577717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.577873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.577978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.578243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.578477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.578754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.578924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.579017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.579250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.579533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.579815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.579963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.580088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.580354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.580567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.580817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.226 [2024-10-13 16:55:45.580920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.226 qpair failed and we were unable to recover it. 00:31:20.226 [2024-10-13 16:55:45.581047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.581321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.581551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.581781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.581950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.582076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.582371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.582643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.582897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.582987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.583130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.583332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.583650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.583853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.583979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.584106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.584434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.584691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.584869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.584970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.585237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.585556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.585836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.585994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.586166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.586495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.586733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.586841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.586969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.587247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.587578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.587834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.587957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.588048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.588295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.227 qpair failed and we were unable to recover it. 00:31:20.227 [2024-10-13 16:55:45.588598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.227 [2024-10-13 16:55:45.588710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.588801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.588951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.588982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.589093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.589362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.589647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.589900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.589993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.590175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.590441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.590780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.590906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.591027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.591349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.591608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.591770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.591906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.592190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.592423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.592655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.592882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.592998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.593144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.593442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.593683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.593800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.593941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.594213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.594476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.594755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.594917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.595029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.595143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.228 [2024-10-13 16:55:45.595171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.228 qpair failed and we were unable to recover it. 00:31:20.228 [2024-10-13 16:55:45.595268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.595380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.595426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.595553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.595661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.595692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.595860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.596187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.596435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.596739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.596852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.596938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.597146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.597358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.597612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.597756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.597897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.598229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.598507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.598746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.598894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.598988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.599223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.599492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.599756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.599882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.599996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.600229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.600492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.600769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.600928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.601058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.601380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.601665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.601809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.601918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.602168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.602410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.602613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.602782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.229 qpair failed and we were unable to recover it. 00:31:20.229 [2024-10-13 16:55:45.602954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.603051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.229 [2024-10-13 16:55:45.603077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.603179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.603486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.603773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.603892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.604034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.604358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.604616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.604838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.604975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.605127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.605386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.605683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.605811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.605961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.606216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.606531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.606854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.606996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.607129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.607349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.607608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.607845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.607991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.608099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.608402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.608682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.608803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.608905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.609201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.609493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.609758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.609915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.610032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.610324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.610617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.610863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.610998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.230 qpair failed and we were unable to recover it. 00:31:20.230 [2024-10-13 16:55:45.611120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.230 [2024-10-13 16:55:45.611250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.611280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.611369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.611468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.611514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.611692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.611807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.611836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.611957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.612182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.612405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.612668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.612794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.612943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.613274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.613547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.613759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.613906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.614008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.614258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.614540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.614840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.614978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.615110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.615388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.615631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.615881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.615988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.616073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.616289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.616544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.616789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.616948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.617076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.617337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.617584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.617827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.617998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.231 qpair failed and we were unable to recover it. 00:31:20.231 [2024-10-13 16:55:45.618103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.618191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.231 [2024-10-13 16:55:45.618221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.618361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.618491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.618522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.618648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.618811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.618841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.618994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.619234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.619539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.619813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.619958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.620090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.620371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.620597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.620741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.620884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.621207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.621562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.621834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.621987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.622091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.622340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.622555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.622765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.622905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.622999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.623320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.623594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.623785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.623954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.624175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.624410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.624622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.232 qpair failed and we were unable to recover it. 00:31:20.232 [2024-10-13 16:55:45.624825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.232 [2024-10-13 16:55:45.624965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.625066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.625355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.625619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.625816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.625955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.626212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.626441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.626707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.626828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.626940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.627190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.627462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.627768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.627888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.627994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.628330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.628583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.628793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.628975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.629073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.629353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.629592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.629768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.629909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.630179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.630449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.630715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.630902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.631041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.631313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.631591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.631724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.631862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.632151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.233 [2024-10-13 16:55:45.632465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.233 [2024-10-13 16:55:45.632587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.233 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.632712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.632800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.632830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.632964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.633220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.633511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.633730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.633847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.633967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.634168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.634431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.634668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.634873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.634987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.635111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.635346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.635646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.635856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.635987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.636107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.636419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.636652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.636795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.636925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.637205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.637460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.637711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.637894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.638013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.638246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.638585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.638805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.638912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.639002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.639302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.639618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.639769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.234 [2024-10-13 16:55:45.639935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.640043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.234 [2024-10-13 16:55:45.640071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.234 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.640165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.640481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.640734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.640853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.640949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.641241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.641520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.641753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.641888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.642035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.642287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.642583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.642839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.642959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.643041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.643332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.643632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.643874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.643975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.644117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.644384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.644591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.644845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.644997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.645154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.645448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.645738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.645895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.646025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.646260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.646521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.646796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.646917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.235 [2024-10-13 16:55:45.647013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.647139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.235 [2024-10-13 16:55:45.647174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.235 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.647286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.647576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.647823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.647970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.648075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.648320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.648574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.648799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.648915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.649065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.649319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.649580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.649841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.649989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.650104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.650377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.650625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.650869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.650980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.651065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.651323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.651629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.651764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.651936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.652172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.652422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.652717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.652847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.652938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.653233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.653483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.653711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.653851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.653941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.654031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.654057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.654188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.654284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.654314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.236 qpair failed and we were unable to recover it. 00:31:20.236 [2024-10-13 16:55:45.654447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.236 [2024-10-13 16:55:45.654528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.654553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.654641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.654755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.654779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.654892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.655174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.655388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.655650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.655813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.655963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.656206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.656496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.656740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.656853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.656976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.657224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.657452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.657705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.657867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.657986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.658213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.658418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.658699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.658859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.658994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.659276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.659574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.659844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.659958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.660048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.660356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.660625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.660858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.660983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.661011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.237 qpair failed and we were unable to recover it. 00:31:20.237 [2024-10-13 16:55:45.661141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.237 [2024-10-13 16:55:45.661245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.661274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.661378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.661499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.661525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.661659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.661807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.661836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.661982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.662168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.662440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.662686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.662798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.662893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.663196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.663405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.663655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.663799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.663921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.664198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.664523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.664715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.664864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.664939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.665219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.665507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.665749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.665858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.665967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.666152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.666433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.666692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.666803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.666930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.667178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.667490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.667798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.667951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.668051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.668136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.668164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.668301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.668381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.668411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.238 qpair failed and we were unable to recover it. 00:31:20.238 [2024-10-13 16:55:45.668498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.238 [2024-10-13 16:55:45.668591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.668619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.668699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.668796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.668825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.668932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.669146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.669350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.669622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.669815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.669976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.670064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.670369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.670610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.670836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.670945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.671058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.671259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.671561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.671811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.671921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.672032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.672339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.672649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.239 [2024-10-13 16:55:45.672783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.239 qpair failed and we were unable to recover it. 00:31:20.239 [2024-10-13 16:55:45.672880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.537 [2024-10-13 16:55:45.673002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.537 [2024-10-13 16:55:45.673030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.537 qpair failed and we were unable to recover it. 00:31:20.537 [2024-10-13 16:55:45.673120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.537 [2024-10-13 16:55:45.673233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.537 [2024-10-13 16:55:45.673261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.537 qpair failed and we were unable to recover it. 00:31:20.537 [2024-10-13 16:55:45.673361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.537 [2024-10-13 16:55:45.673461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.673486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.673574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.673681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.673711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.673837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.673936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.673963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.674089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.674316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.674581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.674844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.674948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.675053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.675301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.675573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.675794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.675907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.676022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.676311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.676580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.676855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.676975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.677109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.677318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.677593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.677855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.677990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.678112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.678313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.678521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.678760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.678918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.679032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.679357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.679687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.679807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.679943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.680161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.680344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.680649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.680867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.680976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.681092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.681312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.681625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.681883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.681992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.682119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.682437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.682686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.682865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.682956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.683208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.683438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.683730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.683863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.683999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.684202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.684740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.684904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.685059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.685353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.685697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.685835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.685964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.686284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.686539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.538 qpair failed and we were unable to recover it. 00:31:20.538 [2024-10-13 16:55:45.686766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.538 [2024-10-13 16:55:45.686906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.686930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.687018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.687259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.687518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.687812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.687935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.688037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.688310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.688543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.688826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.688924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.689010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.689269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.689547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.689801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.689945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.690063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.690284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.690513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.690755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.690944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.691055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.691273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.691563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.691807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.691910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.692000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.692335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.692583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.692774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.692884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.692990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.693276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.693529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.693776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.693923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.694030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.694282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.694550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.694825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.694966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.695129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.695337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.695565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.695779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.695972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.696095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.696350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.696563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.696820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.696970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.697112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.697348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.697653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.697838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.697973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.698294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.698588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.698861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.698976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.699086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.699328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.699610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.699880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.699989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.700105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.700406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.700662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.700826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.700918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.701076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.701102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.701247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.701328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.701352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.539 qpair failed and we were unable to recover it. 00:31:20.539 [2024-10-13 16:55:45.701517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.539 [2024-10-13 16:55:45.701629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.701655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.701748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.701865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.701891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.702034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.702351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.702627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.702859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.702995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.703109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.703415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.703639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.703830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.703971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.704129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.704412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.704623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.704817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.704936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.705253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.705499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.705760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.705909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.706016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.706229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.706511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.706730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.706864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.707013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.707314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.707597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.707898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.707995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.708169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.708484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.708705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.708868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.708991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.709243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.709428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.709711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.709839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.709974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.710231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.710467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.710720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.710834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.710981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.711248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.711527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.711760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.711951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.712046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.712308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.712530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.712790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.712970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.713110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.713371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.713687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.713895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.714025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.714261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.714584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.714839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.540 [2024-10-13 16:55:45.714949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.540 qpair failed and we were unable to recover it. 00:31:20.540 [2024-10-13 16:55:45.715059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.715328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.715575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.715833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.715980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.716067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.716324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.716590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.716817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.716958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.717085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.717333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.717611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.717851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.717958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.718112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.718418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.718709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.718815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.718917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.719176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.719421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.719630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.719861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.719976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.720107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.720349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.720601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.720828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.720929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.721060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.721322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.721586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.721816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.721939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.722021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.722260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.722485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.722778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.722971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.723426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.723732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.723850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.723981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.724538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.724778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.724882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.724998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.725191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.725566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.725751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.725919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.726049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.726296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.726535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.726802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.726907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.727032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.727290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.727599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.727879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.727989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.728086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.728370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.728681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.728818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.728979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.729243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.729550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.541 qpair failed and we were unable to recover it. 00:31:20.541 [2024-10-13 16:55:45.729778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.541 [2024-10-13 16:55:45.729904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.729932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.730054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.730339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.730649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.730799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.730892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.731130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.731357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.731653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.731808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.731945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.732137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.732344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.732587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.732808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.732968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.733131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.733337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.733584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.733879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.733989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.734126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.734353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.734632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.734888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.734995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.735147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.735464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.735718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.735821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.735933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.736180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.736541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.736730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.736901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.737018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.737266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.737573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.737792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.737896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.738014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.738275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.738586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.738837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.738962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.739073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.739351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.739571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.739771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.739904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.740018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.740354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.740617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.740802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.740974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.741116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.741336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.741648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.741806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.741902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.742165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.742364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.742645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.742876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.742984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.743025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.542 qpair failed and we were unable to recover it. 00:31:20.542 [2024-10-13 16:55:45.743104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.743193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.542 [2024-10-13 16:55:45.743220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.743358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.743452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.743478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.743611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.743751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.743777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.743899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.744177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.744380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.744652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.744986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.745073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.745338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.745571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.745764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.745949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.746074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.746332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.746545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.746786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.746957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.747064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.747286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.747579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.747810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.747996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.748128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.748344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.748609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.748849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.748996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.749093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.749362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.749627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.749777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.749879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.750169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.750380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.750658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.750810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.750952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.751223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.751431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.751660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.751775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.751907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.752211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.752451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.752716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.752848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.752971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.753296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.753564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.753776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.753908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.754045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.754275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.754547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.754829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.754942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.755044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.755310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.755569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.755776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.755898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.756046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.756278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.756512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.756708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.756823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.756962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.757037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.757061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.757167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.757333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.757359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.543 qpair failed and we were unable to recover it. 00:31:20.543 [2024-10-13 16:55:45.757510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.543 [2024-10-13 16:55:45.757617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.757642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.757730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.757802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.757827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.757932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.758210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.758547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.758773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.758885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.758979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.759287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.759530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.759764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.759949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.760082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.760308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.760556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.760807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.760941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.761098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.761299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.761551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.761783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.761883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.761999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.762321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.762546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.762797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.762914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.763015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.763290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.763520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.763805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.763966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.764107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.764386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.764654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.764898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.764992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.765110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.765331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.765572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.765871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.765983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.766113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.766380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.766591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.766875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.766992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.767137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.767406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.767673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.767832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.767942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.768253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.768557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.768852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.768994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.769351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.769585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.769947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.770095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.770371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.770670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.770830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.770967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.771060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.771085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.771190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.771301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.771329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.544 qpair failed and we were unable to recover it. 00:31:20.544 [2024-10-13 16:55:45.771450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.544 [2024-10-13 16:55:45.771545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.771574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.771678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.771792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.771818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.771980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.772239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.772529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.772789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.772936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.773080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.773350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.773550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.773822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.773936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.774032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.774263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.774524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.774732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.774838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.774936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.775123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.775379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.775596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.775869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.775993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.776139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.776371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.776611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.776851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.776946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.777056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.777324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.777592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.777830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.777992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.778088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.778336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.778592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.778812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.778948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.779091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.779334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.779560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.779837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.779960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.780035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.780284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.780544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.780771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.780926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.781041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.781299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.781520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.781739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.781926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.782056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.782349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.782598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.782811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.782946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.783111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.783355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.783711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.783857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.783998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.784240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.784477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.784782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.784938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.785093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.785343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.785667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.785889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.785999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.786025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.545 qpair failed and we were unable to recover it. 00:31:20.545 [2024-10-13 16:55:45.786160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.545 [2024-10-13 16:55:45.786301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.786325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.786416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.786527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.786554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.786639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.786729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.786756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.786898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.787194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.787456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.787732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.787846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.787937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.788201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.788457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.788686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.788791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.788905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.789175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.789407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.789684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.789804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.789931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.790164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.790411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.790637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.790852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.790981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.791134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.791389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.791627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.791852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.791997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.792121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.792391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.792685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.792843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.792975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.793196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.793470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.793724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.793845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.793953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.794226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1331632 Killed "${NVMF_APP[@]}" "$@" 00:31:20.546 [2024-10-13 16:55:45.794367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.794483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 16:55:45 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:31:20.546 [2024-10-13 16:55:45.794761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.794896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:31:20.546 [2024-10-13 16:55:45.794921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.795051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:20.546 [2024-10-13 16:55:45.795148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 16:55:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.795307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:31:20.546 [2024-10-13 16:55:45.795441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.795577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.795852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.795963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.796065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.796310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.796552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.796797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.796953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.797039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.797245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.797503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.797789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.797951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.798039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.798260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.798513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- nvmf/common.sh@469 -- # nvmfpid=1332333 00:31:20.546 [2024-10-13 16:55:45.798602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 16:55:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:31:20.546 16:55:45 -- nvmf/common.sh@470 -- # waitforlisten 1332333 00:31:20.546 [2024-10-13 16:55:45.798739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.798865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 16:55:45 -- common/autotest_common.sh@819 -- # '[' -z 1332333 ']' 00:31:20.546 [2024-10-13 16:55:45.798955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:20.546 [2024-10-13 16:55:45.799101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.799128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 16:55:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:20.546 [2024-10-13 16:55:45.799267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 16:55:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:20.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:20.546 [2024-10-13 16:55:45.799376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.799416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 16:55:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:31:20.546 [2024-10-13 16:55:45.799538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.799618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.546 [2024-10-13 16:55:45.799643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.546 qpair failed and we were unable to recover it. 00:31:20.546 [2024-10-13 16:55:45.799734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.799900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.799928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.800020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.800248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.800492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.800805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.800926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.801098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.801375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.801638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.801785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.801868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.802158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.802418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.802645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.802754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.802867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.803130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.803358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.803635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.803796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.803930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.804157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.804422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.804670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.804783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.804902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.805153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.805375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.805581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.805829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.805998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.806102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.806281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.806574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.806761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.806849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.807124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.807462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.807707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.807826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.807917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.808135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.808410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.808601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.808789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.808928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.809200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.809433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.809668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.809847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.809933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.810116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.810374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.810629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.810783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.810873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.811153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.811429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.811681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.811812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.811938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.812192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.812477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.547 qpair failed and we were unable to recover it. 00:31:20.547 [2024-10-13 16:55:45.812741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.547 [2024-10-13 16:55:45.812865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.812892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.812994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.813264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.813518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.813776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.813954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.814085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.814373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.814671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.814839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.814944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.815236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.815469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.815713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.815859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.815978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.816287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.816618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.816863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.816986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.817139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.817527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.817794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.817931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.818023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.818244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.818471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.818701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.818843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.818928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.819124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.819378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.819590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.819822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.819954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.820063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.820283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.820522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.820738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.820847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.820957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.821203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.821440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.821698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.821836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.821926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.822117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.822319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.822554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.822821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.822932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.823052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.823232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.823450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.823658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.823917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.823999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.824111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.824303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.824583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.824814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.824943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.825080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.825268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.825499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.825720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.825850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.825941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.826194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.826407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.826624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.548 qpair failed and we were unable to recover it. 00:31:20.548 [2024-10-13 16:55:45.826852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.548 [2024-10-13 16:55:45.826962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.826987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.827072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.827307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.827564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.827766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.827930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.828071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.828291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.828572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.828771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.828898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.829005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.829187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.829419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.829612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.829811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.829915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.830009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.830233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.830463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.830708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.830813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.830904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.831148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.831435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.831635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.831860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.831969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.832047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.832265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.832515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.832738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.832878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.832985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.833216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.833449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.833705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.833917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.833993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.834130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.834407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.834630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.834883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.834992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.835092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.835323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.835584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.835840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.835980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.836062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.836309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.836535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.836751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.836859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.836932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.837191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.837416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.837631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.837794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.837903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.838182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.838441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.838709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.838819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.838926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.839039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.839064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.549 qpair failed and we were unable to recover it. 00:31:20.549 [2024-10-13 16:55:45.839143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.549 [2024-10-13 16:55:45.839257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.839405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.839618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.839869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.839980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.840086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840116] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:31:20.550 [2024-10-13 16:55:45.840191] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:20.550 [2024-10-13 16:55:45.840192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.840292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.840539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.840766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.840867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.840984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.841258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.841471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.841732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.841900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.841981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.842211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.842471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.842722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.842888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.842994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.843215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.843458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.843684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.843818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.843931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.844145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.844375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.844641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.844873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.844983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.845091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.845310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.845528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.845811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.845946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.846053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.846280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.846518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.846767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.846906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.847046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.847291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.847523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.847796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.847903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.847991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.848196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.848429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.848705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.848811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.848920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.849164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.849408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.849626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.849855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.849987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.850103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.850334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.850617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.850865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.850989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.851075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.851347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.851568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.851773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.851910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.852022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.852215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.852454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.550 qpair failed and we were unable to recover it. 00:31:20.550 [2024-10-13 16:55:45.852701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.550 [2024-10-13 16:55:45.852810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.852835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.852931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.853118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.853361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.853596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.853848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.853980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.854064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.854292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.854528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.854790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.854924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.855047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.855268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.855523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.855754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.855856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.855993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.856201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.856420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.856615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.856720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.856854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.857106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.857289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.857485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.857892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.858014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.858227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.858465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.858741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.858852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.858962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.859190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.859460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.859695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.859837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.859926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.860173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.860432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.860671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.860897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.860982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.861149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.861364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.861615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.861809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.861952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.862094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.862315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.862544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.862771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.862881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.862990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.863218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.863467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.863698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.863829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.863934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.864043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.864068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.551 qpair failed and we were unable to recover it. 00:31:20.551 [2024-10-13 16:55:45.864178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.551 [2024-10-13 16:55:45.864269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.864421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.864618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.864878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.864987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.865067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.865293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.865558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.865788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.865946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.866059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.866334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.866583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.866838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.866973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.867081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.867267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.867517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.867739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.867849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.867933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.868181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.868419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.868610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.868814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.868978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.869071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.869325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.869548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.869777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.869893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.870006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.870275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.870539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.870764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.870874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.870989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.871218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.871439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.871632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.871756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.871875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.872110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.872356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.872600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.872786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.872891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.872999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.873274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.873542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.873760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.873882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.873983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.874247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.874546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 EAL: No free 2048 kB hugepages reported on node 1 00:31:20.552 [2024-10-13 16:55:45.874764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.874869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.874956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.875196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.875421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.875644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.875791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.875878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.876133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.876357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.876639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.876782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.876894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.877003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.877030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.552 qpair failed and we were unable to recover it. 00:31:20.552 [2024-10-13 16:55:45.877183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.552 [2024-10-13 16:55:45.877298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.877412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.877610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.877832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.877941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.878041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.878264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.878529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.878733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.878878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.878969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.879196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.879457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.879683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.879821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.879909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.880155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.880377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.880647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.880899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.880985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.881114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.881386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.881593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.881804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.881967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.882057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.882283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.882488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.882721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.882857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.882979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.883204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.883442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.883659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.883872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.883986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.884101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.884327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.884558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.884807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.884969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.885087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.885335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.885575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.885824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.885928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.886044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.886301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.886518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.886779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.886915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.887025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.887276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.887493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.887749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.887916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.888001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.888303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.888594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.888805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.888937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.889023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.889262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.889455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.889716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.889862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.553 qpair failed and we were unable to recover it. 00:31:20.553 [2024-10-13 16:55:45.889941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.553 [2024-10-13 16:55:45.890026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.890142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.890404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.890606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.890837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.890947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.891063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.891275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.891516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.891731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.891869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.891952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.892172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.892410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.892604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.892835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.892944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.893026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.893245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.893500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.893753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.893894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.894032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.894249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.894483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.894710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.894822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.894963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.895204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.895464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.895700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.895805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.895937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.896150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.896348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.896587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.896807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.896955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.897040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.897262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.897485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.897728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.897826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.897920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.898166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.898364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.898634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.898876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.898982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.899070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.899286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.899547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.899793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.899899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.899993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.900214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.900443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.900662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.900882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.900990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.901089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.901314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.554 [2024-10-13 16:55:45.901597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.554 [2024-10-13 16:55:45.901737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.554 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.901844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.901956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.901981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.902068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.902324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.902591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.902841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.902977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.903063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.903282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.903531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.903773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.903887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.903966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.904240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.904432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.904657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.904877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.904991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.905074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.905310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.905534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.905759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.905921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.906039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.906227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.906433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.906692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.906852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.906939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.907121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.907341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.907574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.907859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.907994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.908073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.908263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.908523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.908764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.908900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.908966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:20.555 [2024-10-13 16:55:45.908979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.909236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.909459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.909661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.909794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.909909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.910164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.910350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.910609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.910758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.910846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.911134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.911332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.911583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.911807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.911920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.912038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.912269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.912483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.912759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.912898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.913012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.913260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.913505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.913762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.913867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.913958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.914191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.914405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.914651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.555 [2024-10-13 16:55:45.914759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.555 qpair failed and we were unable to recover it. 00:31:20.555 [2024-10-13 16:55:45.914839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.914915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.914940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.915023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.915252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.915565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.915767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.915928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.916033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.916226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.916513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.916731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.916849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.916936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.917159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.917383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.917645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.917840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.917968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.918062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.918348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.918580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.918865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.918977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.919085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.919323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.919574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.919850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.919973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.920112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.920372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.920627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.920860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.920976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.921084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.921316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.921573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.921828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.921958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.922064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.922314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.922528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.922757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.922889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.923009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.923230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.923559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.923792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.923909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.924046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.924268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.924519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.924774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.924883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.924998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.925193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.925430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.925626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.925836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.925957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.926059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.926278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.926505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.556 qpair failed and we were unable to recover it. 00:31:20.556 [2024-10-13 16:55:45.926738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.556 [2024-10-13 16:55:45.926824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.926849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.926931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.927149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.927404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.927594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.927856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.927971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.928082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.928321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.928553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.928775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.928891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.928985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.929189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.929380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.929574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.929778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.929885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.929974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.930182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.930422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.930645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.930834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.930968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.931080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.931275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.931515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.931742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.931873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.931988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.932242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.932448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.932732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.932850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.932966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.933227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.933459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.933687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.933812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.933903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.934151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.934350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.934584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.934787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.934916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.935033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.935290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.935571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.935790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.935930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.936042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.936271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.936497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.936729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.936846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.936939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.937156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.937423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.937646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.937845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.937990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.938107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.938318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.938529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.938780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.938915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.938999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.939071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.939095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.557 qpair failed and we were unable to recover it. 00:31:20.557 [2024-10-13 16:55:45.939213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.939289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.557 [2024-10-13 16:55:45.939313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.939387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.939501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.939527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.939643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.939759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.939784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.939892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.940145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.940374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.940632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.940749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.940894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.941160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.941378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.941577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.941794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.941932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.942024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.942238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.942528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.942785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.942928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.943045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.943275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.943479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.943745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.943879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.943953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.944161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.944358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.944576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.944794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.944930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.945017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.945206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.945461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.945748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.945859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.945971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.946227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.946533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.946775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.946928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.947051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.947291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.947573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.947826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.947936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.948048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.948309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.948573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.948799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.948944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.949058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.949330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.949591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.949854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.949962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.950045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.950259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.950498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.950693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.950809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.950891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.951129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.951357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.951655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.951771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.951894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.952122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.558 qpair failed and we were unable to recover it. 00:31:20.558 [2024-10-13 16:55:45.952361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.558 [2024-10-13 16:55:45.952512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.952604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.952749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.952775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.952863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.952980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.953086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.953329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.953563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.953789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.953895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.954012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.954291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.954495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.954704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.954821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.954931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.955182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.955413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.955645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.955879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.955995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.956136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.956361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.956599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.956773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.956923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.957230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.957465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.957711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.957825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.957936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.958154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.958358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.958620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.958846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.958986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.959074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.959266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.959514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.959798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.959911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.960010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.960262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.960491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.960736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.960848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.960939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.961159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.961404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.961603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.961850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.961994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.962085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.962329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.962531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.962729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.962844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.962960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.963188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.963451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.963668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.963888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.963989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.964016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.964129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.964212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.964238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.964329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.964422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.559 [2024-10-13 16:55:45.964448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.559 qpair failed and we were unable to recover it. 00:31:20.559 [2024-10-13 16:55:45.964556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.964632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.964657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.964782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.964894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.964918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.965036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.965256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.965490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.965756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.965870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.965952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.966198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.966450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.966676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.966899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.966991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.967096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.967323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.967542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.967773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.967915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.967999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.968243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.968508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.968767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.968904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.968994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.969197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.969413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.969633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.969813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.969902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.970155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.970410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.970621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.970883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.970995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.971129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.971354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.971587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.971802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.971965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.972078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.972297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.972496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.972716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.972830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.972942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.973238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.973490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.973713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.973855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.973976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.974224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.974438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.974636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.974824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.974966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.975044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.975271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.975478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.975688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.975876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.975979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.976116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.976329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.976551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.976740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.976846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.976972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.977047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.977072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.977157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.977270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.560 [2024-10-13 16:55:45.977295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.560 qpair failed and we were unable to recover it. 00:31:20.560 [2024-10-13 16:55:45.977379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.977595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.977792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.977905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.978021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.978252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.978489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.978771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.978904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.978989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.979241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.979490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.979739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.979881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.979966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.980183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.980415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.980663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.980812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.980923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.981179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.981429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.981682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.981819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.981908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.982124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.982323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.982578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.982770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.982904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.983016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.983260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.983480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.983729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.983832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.983921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.984143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.984392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.984597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.984810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.984942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.985076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.985302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.985505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.985786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.985925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.561 qpair failed and we were unable to recover it. 00:31:20.561 [2024-10-13 16:55:45.986045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.986133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.561 [2024-10-13 16:55:45.986157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.986237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.986456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.986700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.986846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.986959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.987179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.987368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.987729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.987869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.987978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.988168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.988492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.988688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.988852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.988977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.989220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.989448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.989646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.989887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.989998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.990110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.990298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.990540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.990790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.990901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.990996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.991190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.991377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.991677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.991868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.991976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.992062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.992320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.992567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.992779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.992915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.562 qpair failed and we were unable to recover it. 00:31:20.562 [2024-10-13 16:55:45.993053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.562 [2024-10-13 16:55:45.993166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.993296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.993542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.993817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.993925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.994067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.994314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.994533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.994756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.994895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.994972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.995169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.995386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.995612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.995830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.995962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.996072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.996330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.996552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.996742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.996846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.996932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.997194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.997500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.997718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.997859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.998054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.998165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.563 [2024-10-13 16:55:45.998191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.563 qpair failed and we were unable to recover it. 00:31:20.563 [2024-10-13 16:55:45.998285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.564 [2024-10-13 16:55:45.998477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.564 [2024-10-13 16:55:45.998503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.564 qpair failed and we were unable to recover it. 00:31:20.847 [2024-10-13 16:55:45.998622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.847 [2024-10-13 16:55:45.998709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.847 [2024-10-13 16:55:45.998735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.847 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.998837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.998933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.998958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:20.848 [2024-10-13 16:55:45.999896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:45.999920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:45.999971] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:20.848 [2024-10-13 16:55:45.999990] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:20.848 [2024-10-13 16:55:46.000003] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:20.848 [2024-10-13 16:55:46.000005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.000069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:20.848 [2024-10-13 16:55:46.000095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:20.848 [2024-10-13 16:55:46.000201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:20.848 [2024-10-13 16:55:46.000124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:20.848 [2024-10-13 16:55:46.000282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.000408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.000616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.000808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.000916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.001012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.001237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.001431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.001620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.001824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.001928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.002015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.002203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.002424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.002616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.002831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.002975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.003119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.003321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.003532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.003727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.003861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.003974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.004052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.004077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.004177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.004291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.004316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.848 qpair failed and we were unable to recover it. 00:31:20.848 [2024-10-13 16:55:46.004433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.848 [2024-10-13 16:55:46.004544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.004569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.004681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.004762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.004787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.004866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.004978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.005092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.005278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.005514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.005703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.005890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.005997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.006077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.006265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.006470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.006690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.006907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.006984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.007098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.007344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.007542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.007780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.007894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.008012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.008221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.008443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.008671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.008807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.008939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.009168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.009398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.009595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.009842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.009988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.010092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.010285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.010511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.010704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.010817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.849 [2024-10-13 16:55:46.010910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.011000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.849 [2024-10-13 16:55:46.011025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.849 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.011116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.011332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.011551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.011803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.011919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.012003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.012289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.012534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.012733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.012841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.012948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.013171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.013398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.013593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.013811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.013925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.014005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.014231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.014477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.014671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.014811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.014950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.015156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.015417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.015615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.015838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.015968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.016063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.016355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.016568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.016753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.016864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.016971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.017163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.017351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.017584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.850 [2024-10-13 16:55:46.017716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.850 qpair failed and we were unable to recover it. 00:31:20.850 [2024-10-13 16:55:46.017804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.017899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.017924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.018040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.018257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.018508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.018697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.018865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.018981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.019169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.019388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.019584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.019803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.019915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.020036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.020260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.020470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.020687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.020871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.020984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.021068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.021328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.021550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.021754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.021918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.021998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.022220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.022455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.022715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.022854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.022966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.023186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.023410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.023648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.023853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.023988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.024070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.024152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.024179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.024309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.024391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.024465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.851 qpair failed and we were unable to recover it. 00:31:20.851 [2024-10-13 16:55:46.024579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.851 [2024-10-13 16:55:46.024688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.024719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.024811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.024927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.024952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.025048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.025247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.025447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.025639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.025853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.025989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.026077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.026270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.026531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.026731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.026846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.026959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.027186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.027420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.027623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.027877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.027977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.028053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.028292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.028530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.028720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.028853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.028933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.029130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.029330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.029579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.029781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.029914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.029995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.030127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.852 [2024-10-13 16:55:46.030153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.852 qpair failed and we were unable to recover it. 00:31:20.852 [2024-10-13 16:55:46.030265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.030507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.030707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.030868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.030983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.031205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.031410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.031609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.031829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.031936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.032050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.032241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.032459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.032655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.032841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.032979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.033063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.033307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.033558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.033748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.033851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.033929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.034181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.034417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.034607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.034842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.034945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.035036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.035262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.035466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.035692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.035830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.035907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.036130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.036386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.036644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.853 qpair failed and we were unable to recover it. 00:31:20.853 [2024-10-13 16:55:46.036840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.853 [2024-10-13 16:55:46.036950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.036975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.037063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.037279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.037513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.037731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.037834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.037917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.038108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.038332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.038532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.038758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.038866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.038981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.039222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.039414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.039689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.039820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.039901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.040138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.040384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.040610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.040838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.040976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.041085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.041335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.041559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.041758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.041893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.041979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.042223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.042437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.042656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.042855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.042995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.043111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.043361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.854 [2024-10-13 16:55:46.043582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.854 [2024-10-13 16:55:46.043685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.854 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.043790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.043880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.043906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.043995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.044197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.044404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.044604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.044804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.044937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.045023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.045272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.045471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.045852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.045960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.046045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.046265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.046506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.046737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.046848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.046936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.047158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.047356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.047600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.047843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.047982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.048063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.048307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.048560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.048790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.048894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.048987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.049215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.049453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.049652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.049816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.049938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.050019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.050045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.050126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.050241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.855 [2024-10-13 16:55:46.050266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.855 qpair failed and we were unable to recover it. 00:31:20.855 [2024-10-13 16:55:46.050354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.050604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.050800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.050907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.051016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.051222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.051423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.051621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.051827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.051933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.052016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.052252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.052480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.052717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.052855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.052965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.053164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.053352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.053607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.053819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.053933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.054044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.054238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.054485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.054679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.054853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.054960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.055156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.055353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.055610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.055851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.055964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.856 [2024-10-13 16:55:46.056072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.056182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.856 [2024-10-13 16:55:46.056208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.856 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.056288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.056550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.056784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.056922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.057052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.057237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.057474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.057674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.057822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.057930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.058116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.058364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.058566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.058784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.058898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.058977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.059186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.059403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.059636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.059837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.059946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.060064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.060268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.060550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.060783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.060948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.061034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.061228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.061414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.061655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.061870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.061976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.062094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.062314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.062551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.062747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.857 [2024-10-13 16:55:46.062861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.857 qpair failed and we were unable to recover it. 00:31:20.857 [2024-10-13 16:55:46.062979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.063168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.063420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.063619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.063871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.063989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.064101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.064285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.064553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.064769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.064909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.065005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.065234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.065474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.065676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.065907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.065980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.066087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.066345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.066572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.066776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.066894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.066979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.067375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.067607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.067788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.067895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.067979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.068186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.068372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.068615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.068843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.068961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.069058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.069163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.069189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.069280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.069399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.069425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.858 qpair failed and we were unable to recover it. 00:31:20.858 [2024-10-13 16:55:46.069505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.858 [2024-10-13 16:55:46.069617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.069641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.069736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.069845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.069870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.069978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.070196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.070423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.070615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.070816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.070935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.071049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.071252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.071487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.071706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.071840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.071924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.072139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.072357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.072618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.072808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.072926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.073015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.073234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.073472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.073668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.073891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.073995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.074078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.074295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.074510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.074725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.074863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.074949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.075185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.075380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.075620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.075857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.075962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.076056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.076132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.859 [2024-10-13 16:55:46.076157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.859 qpair failed and we were unable to recover it. 00:31:20.859 [2024-10-13 16:55:46.076242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.076463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.076664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.076891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.076994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.077100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.077337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.077554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.077748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.077865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.077950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.078146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.078460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.078659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.078853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.078992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.079086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.079316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.079583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.079777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.079886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.079985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.080195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.080431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.080626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.080879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.080976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.081062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.081286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.081488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.081680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.081845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.081932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.082046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.082071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.860 qpair failed and we were unable to recover it. 00:31:20.860 [2024-10-13 16:55:46.082188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.860 [2024-10-13 16:55:46.082282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.082391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.082622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.082841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.082982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.083096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.083320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.083539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.083759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.083872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.083985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.084265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.084527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.084755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.084867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.084951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.085180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.085412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.085632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.085867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.085978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.086079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.086316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.086553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.086776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.086914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.087031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.087216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.087447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.087674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.087874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.087980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.088094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.088312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.088591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.088818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.088937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.861 qpair failed and we were unable to recover it. 00:31:20.861 [2024-10-13 16:55:46.089045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.089140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.861 [2024-10-13 16:55:46.089165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.089246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.089480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.089668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.089820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.089932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.090158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.090380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.090581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.090790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.090923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.091013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.091262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.091463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.091683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.091796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.091937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.092154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.092402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.092587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.092818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.092933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.093022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.093241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.093519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.093782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.093915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.094004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.094251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.094684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.094881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.094992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.095112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.095313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.095497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.095737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.862 [2024-10-13 16:55:46.095881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.862 qpair failed and we were unable to recover it. 00:31:20.862 [2024-10-13 16:55:46.096000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.096186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.096425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.096624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.096847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.096984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.097089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.097319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.097539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.097782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.097909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.098045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.098246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.098457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.098651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.098793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.098907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.099128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.099347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.099572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.099770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.099869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.099982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.100191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.100439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.100659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.100825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.100938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.101142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.101401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.101582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.101775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.101878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.101968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.102225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.102420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.863 qpair failed and we were unable to recover it. 00:31:20.863 [2024-10-13 16:55:46.102652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.863 [2024-10-13 16:55:46.102763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.102845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.102958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.102983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.103088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.103278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.103503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.103692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.103878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.103992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.104189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.104377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.104612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.104823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.104935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.105021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.105248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.105469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.105694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.105881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.105998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.106114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.106333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.106542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.106750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.106857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.106974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.107166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.107365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.107595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.107777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.107913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.107996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.108216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.108426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.108659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.108878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.108987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.109011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.864 [2024-10-13 16:55:46.109102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.109183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.864 [2024-10-13 16:55:46.109208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.864 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.109293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.109494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.109696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.109830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.109911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.110164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.110390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.110618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.110812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.110930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.111040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.111228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.111474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.111676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.111901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.111985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.112095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.112345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.112563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.112755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.112873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.112960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.113212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.113429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.113611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.113796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.113907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.114021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.114224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.114484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.114689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.114790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.865 [2024-10-13 16:55:46.114901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.115023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.865 [2024-10-13 16:55:46.115048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.865 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.115133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.115326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.115551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.115780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.115896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.115984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.116212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.116406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.116606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.116837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.116976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.117062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.117274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.117477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.117697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.117888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.117988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.118071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.118264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.118487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.118679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.118816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.118903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.119122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.119313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.119546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.119752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.119893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.119975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.120161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.120350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.120589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.120777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.120912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.120992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.121068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.121092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.121175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.121267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.121292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.866 qpair failed and we were unable to recover it. 00:31:20.866 [2024-10-13 16:55:46.121374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.866 [2024-10-13 16:55:46.121473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.121498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.121573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.121685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.121719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.121795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.121877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.121902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.122012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.122227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.122470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.122684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.122887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.122992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.123080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.123270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.123501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.123695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.123824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.123940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.124137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.124350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.124605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.124814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.124919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.125005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.125224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.125409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.125636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.125828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.125941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.126041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.126289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.126723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.126916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.126999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.127136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.127350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.127553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.867 qpair failed and we were unable to recover it. 00:31:20.867 [2024-10-13 16:55:46.127793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.867 [2024-10-13 16:55:46.127904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.128007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.128195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.128427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.128625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.128809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.128959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.129032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.129223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.129472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.129698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.129872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.129978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.130082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.130276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.130519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.130701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.130838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.130923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.131146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.131356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.131567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.131762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.131867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.131957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.132173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.132359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.132588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.132764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.132902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.132981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.133202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.133388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.133577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.133799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.133910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.133993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.134102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.868 [2024-10-13 16:55:46.134128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.868 qpair failed and we were unable to recover it. 00:31:20.868 [2024-10-13 16:55:46.134217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.134442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.134630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.134891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.134999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.135078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.135307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.135499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.135683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.135825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.135910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.136160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.136354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.136584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.136785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.136901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.136983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.137169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.137350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.137591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.137801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.137934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.138034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.138229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.138420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.138622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.138823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.138923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.139000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.139171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.139391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.139587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.869 qpair failed and we were unable to recover it. 00:31:20.869 [2024-10-13 16:55:46.139763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.869 [2024-10-13 16:55:46.139851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.139876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.139968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.140155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.140405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.140644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.140844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.140954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.141028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.141204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.141390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.141611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.141798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.141900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.142011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.142206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.142428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.142644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.142842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.142940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.143017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.143304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.143508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.143695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.143877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.143979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.144087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.144261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.144503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.144685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.144820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.144936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.145115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.145298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.145552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.145734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.145865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.870 qpair failed and we were unable to recover it. 00:31:20.870 [2024-10-13 16:55:46.145970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.870 [2024-10-13 16:55:46.146089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.146228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.146423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.146649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.146834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.146940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.147024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.147224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.147451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.147643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.147855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.147960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.148037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.148247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.148509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.148707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.148873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.148986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.149184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.149372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.149628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.149856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.149963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.150077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.150334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.150527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.150779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.150889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.151002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.151189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.151436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.151659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.151879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.151989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.152106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.152290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.871 qpair failed and we were unable to recover it. 00:31:20.871 [2024-10-13 16:55:46.152505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.871 [2024-10-13 16:55:46.152646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.152731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.152811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.152836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.152918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.153134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.153362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.153544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.153767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.153898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.153975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.154166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.154376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.154628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.154857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.154963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.155072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.155255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.155513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.155699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.155812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.155924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.156137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.156383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.156592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.156820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.156959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.157047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.157227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.157491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.157710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.157907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.157984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.158107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.158383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.158612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.158856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.158965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.159052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.159160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.872 [2024-10-13 16:55:46.159186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.872 qpair failed and we were unable to recover it. 00:31:20.872 [2024-10-13 16:55:46.159266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.159502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.159716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.159853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.159934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.160116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.160345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.160535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.160781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.160887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.160965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.161156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.161388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.161625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.161839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.161939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.162023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.162198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.162390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.162610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.162821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.162922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.163039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.163247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.163454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.163659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.163895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.163999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.164078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.164260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.164476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.164687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.873 qpair failed and we were unable to recover it. 00:31:20.873 [2024-10-13 16:55:46.164900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.873 [2024-10-13 16:55:46.164982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.165087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.165270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.165530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.165745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.165880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.165969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.166144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.166348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.166635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.166836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.166935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.167025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.167248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.167461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.167704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.167812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.167928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.168136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.168362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.168604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.168863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.168975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.169146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.169361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.169611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.169807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.169952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.170099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.170321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.170543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.170751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.170866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.170982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.171208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.171433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.874 [2024-10-13 16:55:46.171658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.874 [2024-10-13 16:55:46.171766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.874 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.171875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.171986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.172113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.172298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.172533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.172731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.172835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.172942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.173160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.173405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.173614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.173845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.173954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.174040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.174227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.174461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.174641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.174818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.174923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.175009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.175208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.175399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.175623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.175834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.175965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.176084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.176285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.176507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.176691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.176838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.176953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.177141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.177364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.177574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.177792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.177906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.178022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.178097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.875 [2024-10-13 16:55:46.178122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.875 qpair failed and we were unable to recover it. 00:31:20.875 [2024-10-13 16:55:46.178215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.178429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.178676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.178822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.178932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.179144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.179355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.179596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.179849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.179950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.180063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.180270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.180530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.180747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.180879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.180964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.181189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.181374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.181601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.181806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.181944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.182029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.182309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.182506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.182705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.182833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.182942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.183190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.183378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.183646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.183861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.183967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.184041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.184232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.184482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.184671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.876 qpair failed and we were unable to recover it. 00:31:20.876 [2024-10-13 16:55:46.184897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.876 [2024-10-13 16:55:46.184978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.185089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.185306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.185575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.185792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.185925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.186035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.186219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.186456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.186656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.186772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.186891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.187110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.187318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.187548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.187761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.187865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.187950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.188160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.188342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.188535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.188741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.188893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.188982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.189262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.189471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.189684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.189815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.189923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.190138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.190324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.190568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.190787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.190925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.191001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.191216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.877 qpair failed and we were unable to recover it. 00:31:20.877 [2024-10-13 16:55:46.191450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.877 [2024-10-13 16:55:46.191575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.191687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.191783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.191808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.191882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.191990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.192099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.192320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.192623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.192846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.192954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.193036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.193252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.193502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.193723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.193828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.193941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.194150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.194407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.194627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.194831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.194938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.195054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.195285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.195554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.195773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.195907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.195989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.196216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.196454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.196678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.196895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.196999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.197097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.197287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.878 qpair failed and we were unable to recover it. 00:31:20.878 [2024-10-13 16:55:46.197536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.878 [2024-10-13 16:55:46.197652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.197682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.197769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.197852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.197877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.197989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.198202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.198389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.198636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.198858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.198963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.199040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.199289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.199501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.199719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.199833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.199944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.200192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.200372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.200605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.200828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.200936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.201051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.201239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.201487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.201743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.201843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.201922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.202178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.202410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.202654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.202901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.202976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.203112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.203290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.203531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.203733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.203875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.203959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.204073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.204098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.879 qpair failed and we were unable to recover it. 00:31:20.879 [2024-10-13 16:55:46.204175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.204281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.879 [2024-10-13 16:55:46.204305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.204398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.204594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.204798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.204903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.204988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.205211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.205399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.205580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.205801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.205939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.206020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.206227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.206502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.206683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.206874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.206976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.207053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.207224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.207419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.207621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.207858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.207969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.208047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.208225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.208484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.208693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.208887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.208992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.209127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.209321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.209518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.209718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.209856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.209968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.210210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.210389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.880 [2024-10-13 16:55:46.210521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.880 qpair failed and we were unable to recover it. 00:31:20.880 [2024-10-13 16:55:46.210635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.210708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.210734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.210817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.210898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.210923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.211032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.211211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.211405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.211601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.211825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.211955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.212047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.212228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.212449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.212701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.212807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.212897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.213143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.213354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.213581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.213773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.213910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.213989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.214214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.214431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.214668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.214870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.214980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.215088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.215276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.215540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.215772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.215879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.215959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.216170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.216354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.216612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.216837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.216971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.881 qpair failed and we were unable to recover it. 00:31:20.881 [2024-10-13 16:55:46.217060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.217144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.881 [2024-10-13 16:55:46.217170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.217264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.217488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.217702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.217835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.217918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.218137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.218356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.218579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.218751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.218864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.218941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.219125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.219317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.219535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.219727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.219834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.219941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.220157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.220370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.220632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.220876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.220986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.221067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.221286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.221481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.221714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.221822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.221907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.222154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.222383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.222579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.882 [2024-10-13 16:55:46.222820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.882 [2024-10-13 16:55:46.222952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.882 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.223042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.223293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.223547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.223776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.223877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.223987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.224201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.224425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.224658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.224821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.224908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.225132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.225379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.225602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.225789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.225900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.225984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.226167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.226374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.226606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.226824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.226935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.227048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.227265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.227514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.227704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.227816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.227901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.228161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.228337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.228553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.228768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.228867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.228975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.229187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.229432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.883 [2024-10-13 16:55:46.229571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.883 qpair failed and we were unable to recover it. 00:31:20.883 [2024-10-13 16:55:46.229649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.229755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.229780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.229858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.229938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.229963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.230053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.230309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.230539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.230734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.230863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.230943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.231125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.231310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.231530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.231750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.231863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.231944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.232124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.232321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.232525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.232736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.232843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.232931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.233134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.233354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.233566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.233749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.233854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.233961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.234171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.234420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.234659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.234871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.234970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.235086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.235303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.235525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.235734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.235868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.884 qpair failed and we were unable to recover it. 00:31:20.884 [2024-10-13 16:55:46.236007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.884 [2024-10-13 16:55:46.236088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.236222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.236608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.236827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.236930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.237022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.237271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.237501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.237729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.237826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.237935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.238215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.238399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.238613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.238827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.238932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.239011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.239191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.239426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.239647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.239825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.239927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.240037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.240280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.240481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.240665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.240881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.240993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.241072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.241280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.241516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.241759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.241864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.241938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.242156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.885 qpair failed and we were unable to recover it. 00:31:20.885 [2024-10-13 16:55:46.242349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.885 [2024-10-13 16:55:46.242467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.242549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.242631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.242657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.242764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.242841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.242867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.242953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.243193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.243411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.243632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.243876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.243988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.244102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.244290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.244508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.244727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.244832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.244970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.245160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.245377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.245598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.245825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.245925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.246004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.246219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.246493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.246687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.246818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.246905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.247145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.247338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.247552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.247778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.247884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.247962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.248033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.248060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.886 qpair failed and we were unable to recover it. 00:31:20.886 [2024-10-13 16:55:46.248144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.248223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.886 [2024-10-13 16:55:46.248248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.248359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.248583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.248781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.248886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.248965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.249177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.249450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.249726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.249876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.249978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.250246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.250500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.250763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.250886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.250984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.251210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.251448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.251676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.251858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.251984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.252123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.252318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.252555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.252738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.252839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.252942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.253195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.253411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.253625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.253843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.253953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.254032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.254296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.254543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.254732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.254860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.254973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.255065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.887 [2024-10-13 16:55:46.255090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.887 qpair failed and we were unable to recover it. 00:31:20.887 [2024-10-13 16:55:46.255173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.255387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.255599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.255816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.255917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.256039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.256253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.256515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.256695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.256835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.256947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.257338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.257541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.257764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.257899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.257990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.258179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.258375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.258664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.258891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.258978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.259086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.259523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.259704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.259846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.259959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.260174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.260353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.260604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.260798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.260907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.260988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.261203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.261407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.888 qpair failed and we were unable to recover it. 00:31:20.888 [2024-10-13 16:55:46.261636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.888 [2024-10-13 16:55:46.261710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.261736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.261831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.261914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.261940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.262054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.262257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.262456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.262734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.262844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.262927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.263136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.263315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.263557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.263768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.263875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.263986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.264176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.264388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.264635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.264881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.264970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.265091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.265272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.265508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.265716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.265913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.265987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.266098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.266341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.266575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.266766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.266900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.267010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.267228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.267433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.267664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.267803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.267941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.268019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.268045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.889 qpair failed and we were unable to recover it. 00:31:20.889 [2024-10-13 16:55:46.268129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.268214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.889 [2024-10-13 16:55:46.268239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.268353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.268568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.268748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.268880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.268963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.269180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.269579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.269830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.269945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.270024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.270278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.270496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.270711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.270850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.270937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.271157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.271341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.271567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.271820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.271923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.272194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.272379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.272599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.272801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.272931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.273015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.273221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.273407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.273640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.273860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.273964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.274042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.274146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.274171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.274257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.274348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.890 [2024-10-13 16:55:46.274375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.890 qpair failed and we were unable to recover it. 00:31:20.890 [2024-10-13 16:55:46.274494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.274583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.274609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.274725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.274833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.274860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.274942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.275153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.275343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.275548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.275773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.275905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.275991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.276202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.276378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.276568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.276755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.276917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.276996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.277206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.277401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.277617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.277864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.277965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.278073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.278293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.278506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.278751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.278860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.278967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.279107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.279133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.279215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.279324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.279349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.891 qpair failed and we were unable to recover it. 00:31:20.891 [2024-10-13 16:55:46.279448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.891 [2024-10-13 16:55:46.279559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.279584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.279693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.279780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.279805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.279893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.279966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.279991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.280087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.280327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.280551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.280743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.280913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.280991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.281170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.281391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.281583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.281821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.281925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.282009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.282197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.282414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.282622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.282831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.282936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.283040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.283252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.283445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.283666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.283877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.283984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.284090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.284327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.284529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.284731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.284899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.284986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.285174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.285382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.892 qpair failed and we were unable to recover it. 00:31:20.892 [2024-10-13 16:55:46.285603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.892 [2024-10-13 16:55:46.285714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.285740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.285820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.285899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.285926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.286008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.286257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.286482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.286693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.286885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.286975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.287107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.287301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.287512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.287766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.287871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.287949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.288170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.288356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.288548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.288806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.288911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.288987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.289166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.289424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.289613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.289814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.289949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.290033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.290274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.290515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.290733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.290870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.290953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.291172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.291399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.291631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.291765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.291911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.292133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.292377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.893 [2024-10-13 16:55:46.292576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.893 [2024-10-13 16:55:46.292712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.893 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.292822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.292932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.292957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.293036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.293258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.293460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.293683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.293820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.293928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.294114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.294329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.294575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.294789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.294900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.295009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.295199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.295430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.295665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.295883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.295992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.296104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.296320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.296541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.296759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.296864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.296947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.297163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.297354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.297552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.297740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.297842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.297922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.298371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.298599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.298844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.298950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.894 [2024-10-13 16:55:46.299029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.299154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.894 [2024-10-13 16:55:46.299179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.894 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.299264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.299499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.299714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.299855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.299969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.300154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.300400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.300646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.300777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.300892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.301145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.301357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.301560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.301785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.301916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.301998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.302209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.302416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.302649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.302860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.302964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.303052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.303266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.303465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.303659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.303789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.303896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.304144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.304329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.304548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.304735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.304921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.304999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.305025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.895 qpair failed and we were unable to recover it. 00:31:20.895 [2024-10-13 16:55:46.305106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.305242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.895 [2024-10-13 16:55:46.305268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.305348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.305543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.305783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.305894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.305971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.306184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.306362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.306579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.306771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.306871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.306948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.307134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.307332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.307533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.307721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.307857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.307965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.308154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.308355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.308563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.308778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.308888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.308972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.309156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.309375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.309577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.309825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.309965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.310041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.310292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.310495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.310737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.310846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.310922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.311147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.311353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.896 qpair failed and we were unable to recover it. 00:31:20.896 [2024-10-13 16:55:46.311632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.896 [2024-10-13 16:55:46.311711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.311737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.311827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.311940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.311966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.312099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.312312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.312557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.312750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.312886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.312973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.313158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.313379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.313577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.313797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.313948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.314055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.314274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.314495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.314764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.314872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.314947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.315210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.315427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.315615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.315843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.315976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.316063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.316252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.316483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.316668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.316887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.316999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.317106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.317298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.317505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.317727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.317915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.317989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.318015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.897 qpair failed and we were unable to recover it. 00:31:20.897 [2024-10-13 16:55:46.318119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.318230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.897 [2024-10-13 16:55:46.318257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.318344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.318565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.318742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.318910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.318999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.319250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.319466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.319685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.319870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.319974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.320050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.320245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.320442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.320625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.320810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.320945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.321020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.321240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.321450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.321636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.321851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.321958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.322038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.322280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.322519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:20.898 [2024-10-13 16:55:46.322740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:20.898 [2024-10-13 16:55:46.322914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:20.898 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.323014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.323211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.323472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.323662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.323856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.323962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.324039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.324118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.324142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.187 qpair failed and we were unable to recover it. 00:31:21.187 [2024-10-13 16:55:46.324218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.187 [2024-10-13 16:55:46.324345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.324371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.324585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.324720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.324752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.324866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.324991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.325120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.325349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.325584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.325787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.325921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.326009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.326190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.326390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.326626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.326861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.326999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.327077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.327256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.327482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.327682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.327907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.327989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.328097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.328283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.328504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.328746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.328845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.328932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.329116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.329323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.329548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.329743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.329850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.329927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.330005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.330032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.188 [2024-10-13 16:55:46.330122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.330210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.188 [2024-10-13 16:55:46.330236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.188 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.330314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.330532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.330729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.330839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.330917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.331115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.331371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.331568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.331789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.331895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.331982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.332207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.332425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.332631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.332819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.332960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.333077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.333332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.333564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.333764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.333875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.333984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.334203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.334456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.334682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.334907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.334981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.335154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.335364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.335621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.335833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.335970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.336082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.336190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.336215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.189 [2024-10-13 16:55:46.336302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.336382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.189 [2024-10-13 16:55:46.336414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.189 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.336500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.336635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.336661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.336769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.336877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.336901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.336976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.337202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.337387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.337618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.337827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.337933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.338042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.338243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.338473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.338693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.338824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.338943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.339125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.339322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.339555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.339743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.339876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.339968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.340189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.340406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.190 qpair failed and we were unable to recover it. 00:31:21.190 [2024-10-13 16:55:46.340646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.190 [2024-10-13 16:55:46.340778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.340896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.341114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.341326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.341544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.341791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.341928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.342010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.342152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.193 [2024-10-13 16:55:46.342179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.193 qpair failed and we were unable to recover it. 00:31:21.193 [2024-10-13 16:55:46.342258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.342467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.342722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.342824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.342913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.343132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.343321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.343520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.343705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.343818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.343897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.344137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.344358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.344609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.344797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.344908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.345015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd4f8000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 A controller has encountered a failure and is being reset. 00:31:21.194 [2024-10-13 16:55:46.345236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.345477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.345708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.345819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.345897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.346143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.346354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.346546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.346762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.346869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.346982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.347164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.347351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.347568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.194 qpair failed and we were unable to recover it. 00:31:21.194 [2024-10-13 16:55:46.347767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.194 [2024-10-13 16:55:46.347878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.347903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.347981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.348158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.348379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.348578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.348788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.348888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.348962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.349173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.349389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.349640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.349879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.349978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.350082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.350369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.350580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.350775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.350882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.350965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.351182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.351410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.351607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.351822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.351957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.352070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.352309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.352496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.352753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.352862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.195 [2024-10-13 16:55:46.352941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.353049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.195 [2024-10-13 16:55:46.353074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.195 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.353157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.353372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.353573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.353788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.353899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.353988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.354241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.354504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.354721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.354827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.354932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.355185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.355368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.355586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.355800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.355909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.356023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.356248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.356501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.356721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.356858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.356972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.357154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.357345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.357539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.357784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.357943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.358028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.358210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.358414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.358637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.358817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.358903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.359038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.359064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.196 qpair failed and we were unable to recover it. 00:31:21.196 [2024-10-13 16:55:46.359177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.196 [2024-10-13 16:55:46.359257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.359439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.359627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.359842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.359958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.360066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.360276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.360500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.360698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.360884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.360982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.361068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.361281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.361471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.361655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.361766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.361886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.362169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.362413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.362652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.362839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.362945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.363056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.363284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.363507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.363729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.363868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.363950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.364139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.364374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.197 [2024-10-13 16:55:46.364484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.197 qpair failed and we were unable to recover it. 00:31:21.197 [2024-10-13 16:55:46.364607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.364685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.364709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.364796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.364913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.364945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.365093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.365285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.365513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.365729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.365841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.365958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.366155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.366421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.366642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.366840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.366977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.367078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.367301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.367501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.367716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.367880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.367961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.368178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.368405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.368624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.368840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.368943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.369025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.369246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.369439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.369645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.369894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.369978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.370111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.370325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.370521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.198 [2024-10-13 16:55:46.370737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.198 [2024-10-13 16:55:46.370840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.198 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.370980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.371194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.371368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.371563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.371774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.371899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.372005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.372217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.372462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.372655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.372840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.372943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.373048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.373227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.373411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.373606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.373857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.373961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.374066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.374286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.374497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.374724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.374855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.374930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.375170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.375402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.375600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.375821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.375920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.375995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.376180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.376406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.199 qpair failed and we were unable to recover it. 00:31:21.199 [2024-10-13 16:55:46.376593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.199 [2024-10-13 16:55:46.376700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.376825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.376937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.376963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.377070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.377256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.377483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.377709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.377841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.377928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.378178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.378365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.378604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.378799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.378896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.378978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.379225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.379452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.379636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.379836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.379935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.380050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.380294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.380537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.380755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.380853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.380930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.381151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.381337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.200 [2024-10-13 16:55:46.381569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.200 [2024-10-13 16:55:46.381698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.200 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.381778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.381881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.381907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.381985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.382220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.382413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.382604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.382846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.382977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.383053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.383271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.383516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.383729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.383905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.383985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.384122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.384311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.384587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.384817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.384938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.385066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.385304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.385528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.385750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.385852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.385930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.386152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.386334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.386528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.386725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.386854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.386941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.387124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.201 qpair failed and we were unable to recover it. 00:31:21.201 [2024-10-13 16:55:46.387355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.201 [2024-10-13 16:55:46.387504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.387582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.387668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.387693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.387768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.387855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.387881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.387998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.388182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.388361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.388598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.388867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.388976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.389061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.389248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.389479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.389669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.389884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.389998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.390125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.390338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.390528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.390720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.390864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.390948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.391194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.391426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.202 qpair failed and we were unable to recover it. 00:31:21.202 [2024-10-13 16:55:46.391627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.202 [2024-10-13 16:55:46.391705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.391730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.391813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.391931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.391957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.392034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.392239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.392447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.392698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.392900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.392976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.393001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.393115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.393224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.203 [2024-10-13 16:55:46.393248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.203 qpair failed and we were unable to recover it. 00:31:21.203 [2024-10-13 16:55:46.393335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.204 qpair failed and we were unable to recover it. 00:31:21.204 [2024-10-13 16:55:46.393548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.204 qpair failed and we were unable to recover it. 00:31:21.204 [2024-10-13 16:55:46.393742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.393853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.204 qpair failed and we were unable to recover it. 00:31:21.204 [2024-10-13 16:55:46.393937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.394011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.394036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.204 qpair failed and we were unable to recover it. 00:31:21.204 [2024-10-13 16:55:46.394126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.394244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.394269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.204 qpair failed and we were unable to recover it. 00:31:21.204 [2024-10-13 16:55:46.394352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.204 [2024-10-13 16:55:46.394444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.394471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.394553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.394661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.394686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.394765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.394843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.394868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.394947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.395164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.395406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.395616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.205 [2024-10-13 16:55:46.395836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.205 [2024-10-13 16:55:46.395948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.205 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.396030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.396246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.396491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.396678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.396885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.396987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.397064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.397141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.397172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.206 qpair failed and we were unable to recover it. 00:31:21.206 [2024-10-13 16:55:46.397278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.206 [2024-10-13 16:55:46.397387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.207 [2024-10-13 16:55:46.397499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.207 [2024-10-13 16:55:46.397717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.207 [2024-10-13 16:55:46.397908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.397986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.398011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.207 [2024-10-13 16:55:46.398085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.398170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.398196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.207 [2024-10-13 16:55:46.398272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.398374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.207 [2024-10-13 16:55:46.398405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.207 qpair failed and we were unable to recover it. 00:31:21.208 [2024-10-13 16:55:46.398527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.398635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.398660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.208 qpair failed and we were unable to recover it. 00:31:21.208 [2024-10-13 16:55:46.398765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.398843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.398867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.208 qpair failed and we were unable to recover it. 00:31:21.208 [2024-10-13 16:55:46.398954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.208 qpair failed and we were unable to recover it. 00:31:21.208 [2024-10-13 16:55:46.399173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.208 qpair failed and we were unable to recover it. 00:31:21.208 [2024-10-13 16:55:46.399409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.208 [2024-10-13 16:55:46.399549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.399637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.399714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.399739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.399820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.399908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.399934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.400046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.400273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.400472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.400721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.400863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.209 qpair failed and we were unable to recover it. 00:31:21.209 [2024-10-13 16:55:46.400946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.401024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.209 [2024-10-13 16:55:46.401049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.210 [2024-10-13 16:55:46.401133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.210 [2024-10-13 16:55:46.401401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.210 [2024-10-13 16:55:46.401604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.210 [2024-10-13 16:55:46.401785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.401917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.210 [2024-10-13 16:55:46.401998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.402076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.210 [2024-10-13 16:55:46.402100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.210 qpair failed and we were unable to recover it. 00:31:21.211 [2024-10-13 16:55:46.402189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.211 qpair failed and we were unable to recover it. 00:31:21.211 [2024-10-13 16:55:46.402370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.211 qpair failed and we were unable to recover it. 00:31:21.211 [2024-10-13 16:55:46.402604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.211 qpair failed and we were unable to recover it. 00:31:21.211 [2024-10-13 16:55:46.402785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.402884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.211 qpair failed and we were unable to recover it. 00:31:21.211 [2024-10-13 16:55:46.402965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.403045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.211 [2024-10-13 16:55:46.403070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.212 qpair failed and we were unable to recover it. 00:31:21.212 [2024-10-13 16:55:46.403150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.212 qpair failed and we were unable to recover it. 00:31:21.212 [2024-10-13 16:55:46.403340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.212 qpair failed and we were unable to recover it. 00:31:21.212 [2024-10-13 16:55:46.403532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.212 qpair failed and we were unable to recover it. 00:31:21.212 [2024-10-13 16:55:46.403716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.403821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.212 qpair failed and we were unable to recover it. 00:31:21.212 [2024-10-13 16:55:46.403910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.212 [2024-10-13 16:55:46.404015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.213 qpair failed and we were unable to recover it. 00:31:21.213 [2024-10-13 16:55:46.404148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.213 qpair failed and we were unable to recover it. 00:31:21.213 [2024-10-13 16:55:46.404336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.213 qpair failed and we were unable to recover it. 00:31:21.213 [2024-10-13 16:55:46.404558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.213 qpair failed and we were unable to recover it. 00:31:21.213 [2024-10-13 16:55:46.404732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.404836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.213 qpair failed and we were unable to recover it. 00:31:21.213 [2024-10-13 16:55:46.404935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.213 [2024-10-13 16:55:46.405014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.214 [2024-10-13 16:55:46.405039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.215 qpair failed and we were unable to recover it. 00:31:21.215 [2024-10-13 16:55:46.405120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.215 qpair failed and we were unable to recover it. 00:31:21.215 [2024-10-13 16:55:46.405342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.215 qpair failed and we were unable to recover it. 00:31:21.215 [2024-10-13 16:55:46.405536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.215 qpair failed and we were unable to recover it. 00:31:21.215 [2024-10-13 16:55:46.405719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.215 [2024-10-13 16:55:46.405856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.405939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.406150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.406337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.406521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.406727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.406827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.406938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.407151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.407362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.407621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.407815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.407948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.408028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.408250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.408476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.408693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.408914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.408994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.409100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.409309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.409552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.409754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.409856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.216 qpair failed and we were unable to recover it. 00:31:21.216 [2024-10-13 16:55:46.409935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.216 [2024-10-13 16:55:46.410056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.410166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.410386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.410582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.410777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.410882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.410995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.411185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.411401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.411599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.411861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.411961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.412038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.412221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.412413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.412643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.412828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.412934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.413043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.413222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.413481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.413666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.413845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.413977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.414059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.414283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.414528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.414703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.414880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.414987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.415067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.415280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.415474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.217 qpair failed and we were unable to recover it. 00:31:21.217 [2024-10-13 16:55:46.415699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.217 [2024-10-13 16:55:46.415829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.415916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.415994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.416096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.416314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.416536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.416744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.416848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.416927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.417145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.417357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.417579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.417797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.417899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.417981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.418167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.418377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.418606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.418826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.418933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.419016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.419233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.419431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.419675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.419891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.419991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.420067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.420160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.420185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.218 [2024-10-13 16:55:46.420301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.420380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.218 [2024-10-13 16:55:46.420410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.218 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.420496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.420589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.420615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.420721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.420825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.420852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.420932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.421147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.421325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.421536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.421785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.421883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.421994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.422176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.422404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.422622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.422866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.422962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.423035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.423215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.423405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.423626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.423826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.423934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.424034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.424215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.424439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.424655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.424866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.424979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.425009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.425118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.425194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.425220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.219 [2024-10-13 16:55:46.425303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.425410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.219 [2024-10-13 16:55:46.425437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.219 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.425547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.425628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.425653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.425726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.425813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.425837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.425922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.426135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.426353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.426581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.426763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.426864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.426946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.427183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.427403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.427593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.427814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.427945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.428020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.428234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.428454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.428678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.428787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.428899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.429108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.429289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.429474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.429724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.429916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.429992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.430018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.430103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.430209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.430234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.220 qpair failed and we were unable to recover it. 00:31:21.220 [2024-10-13 16:55:46.430313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.430400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.220 [2024-10-13 16:55:46.430427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.430535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.430619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.430650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.430741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.430853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.430878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.430989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.431178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.431382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.431577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.431775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.431907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.432001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.432209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.432515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.432694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.432883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.432995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.433128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.433312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.433544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.433762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.433891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.433976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.434169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.434378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.434635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.434816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.434936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.435050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.435238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.435469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.435642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.435894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.435999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.436075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.436254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.436467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.436665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.436865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.436992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.437110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.437292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.437503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.437694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.437826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.437940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.438128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.438349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.438567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.221 [2024-10-13 16:55:46.438749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.221 [2024-10-13 16:55:46.438851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.221 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.438931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.439129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.439313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.439534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.439745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.439846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.439938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.440143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.440382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.440602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.440782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.440890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.440999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.441187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.441392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.441586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.441806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.441909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.441985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.442168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.442413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.442633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.442812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.442917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.443026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.443236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.443458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.443644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.443827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.443971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.444049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.444255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.444456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.444643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.444902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.444984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.445089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.445339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.445543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.445766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.445872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.445947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.446125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.446377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.446573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.446750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.446849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.446953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.447151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.447405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.447657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.447836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.447968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.448049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.448246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.448448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.448660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.448875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.448970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.449083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.449277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.449565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.449811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.449982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.450083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.450335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1596390 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.450594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.450785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.450887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.222 qpair failed and we were unable to recover it. 00:31:21.222 [2024-10-13 16:55:46.450968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.222 [2024-10-13 16:55:46.451047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.451185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.451371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.451614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.451801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.451913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.451996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.452230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.452451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.452629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.452818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.452929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.453011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.453193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.453420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.453638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.453820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.453937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.454020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.454248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.454492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.454674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.454779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.454877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.455148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.455364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.455580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.455772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.455927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.456045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.456237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.456448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.456668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.456878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.456983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.457062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.457238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.457452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.457656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.457847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.457948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.458090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.458304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.458537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.458718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.458819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.458927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.459143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.459344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.459538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.459716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.459895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.459993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.460067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.460285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.460510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.460727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.460863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.460953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.461138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.461320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.461504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.461722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.223 qpair failed and we were unable to recover it. 00:31:21.223 [2024-10-13 16:55:46.461904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.223 [2024-10-13 16:55:46.461980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.462080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.462343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.462535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.462756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.462892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.463031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.463228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.463456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.463671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.463851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.463959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.464048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.464289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.464483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.464681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.464812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.464928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.465137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.465380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.465623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.465814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.465949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.466038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.466219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.466407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.466632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.466844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.466943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.467019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.467207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.467482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.467699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.467913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.467993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.468124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.468368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.468563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.468748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.468857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.468934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.469120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.469310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.469527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.469713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.469890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.469990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.470075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.470282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.470480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.470697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.470895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.470993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.471073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.471253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.471503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.471711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.471886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.471984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.472103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.472288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.472526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.472747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.472882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.472971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.473195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.473372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.473593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.224 [2024-10-13 16:55:46.473811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.224 [2024-10-13 16:55:46.473914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.224 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.473998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.474211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.474433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.474651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.474867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.474969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.475054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.475281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.475483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.475679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.475909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.475994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.476129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.476337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.476529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.476778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.476886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.477008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.477225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.477447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.477648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.477870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.477990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.478100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.478318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.478510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.478730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.478890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.478972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.479189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.479406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.479637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.479858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.479959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.480042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.480247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.480437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.480630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.480842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.480947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.481055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.481130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.481155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fd500000b90 with addr=10.0.0.2, port=4420 00:31:21.225 qpair failed and we were unable to recover it. 00:31:21.225 [2024-10-13 16:55:46.481306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.481411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:21.225 [2024-10-13 16:55:46.481443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a3e00 with addr=10.0.0.2, port=4420 00:31:21.225 [2024-10-13 16:55:46.481472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15a3e00 is same with the state(5) to be set 00:31:21.225 [2024-10-13 16:55:46.481512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15a3e00 (9): Bad file descriptor 00:31:21.225 [2024-10-13 16:55:46.481545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:21.225 [2024-10-13 16:55:46.481572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:21.225 [2024-10-13 16:55:46.481605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:21.225 Unable to reset the controller. 00:31:21.482 16:55:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:21.482 16:55:46 -- common/autotest_common.sh@852 -- # return 0 00:31:21.482 16:55:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:21.482 16:55:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:21.482 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.482 16:55:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:21.482 16:55:46 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:21.482 16:55:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.482 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.482 Malloc0 00:31:21.482 16:55:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.482 16:55:46 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:21.482 16:55:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.482 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.482 [2024-10-13 16:55:46.970357] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:21.483 16:55:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.483 16:55:46 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:21.483 16:55:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.483 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.741 16:55:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.741 16:55:46 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:21.741 16:55:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.741 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.741 16:55:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.741 16:55:46 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:21.741 16:55:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.741 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:31:21.741 [2024-10-13 16:55:46.998655] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:21.741 16:55:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.741 16:55:47 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:21.741 16:55:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.741 16:55:47 -- common/autotest_common.sh@10 -- # set +x 00:31:21.741 16:55:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.741 16:55:47 -- host/target_disconnect.sh@58 -- # wait 1331793 00:31:21.998 Controller properly reset. 00:31:27.258 Initializing NVMe Controllers 00:31:27.258 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:27.258 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:27.258 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:31:27.258 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:31:27.258 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:31:27.258 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:31:27.258 Initialization complete. Launching workers. 00:31:27.258 Starting thread on core 1 00:31:27.258 Starting thread on core 2 00:31:27.258 Starting thread on core 3 00:31:27.258 Starting thread on core 0 00:31:27.258 16:55:52 -- host/target_disconnect.sh@59 -- # sync 00:31:27.258 00:31:27.258 real 0m11.477s 00:31:27.258 user 0m36.012s 00:31:27.258 sys 0m7.261s 00:31:27.258 16:55:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:27.258 16:55:52 -- common/autotest_common.sh@10 -- # set +x 00:31:27.258 ************************************ 00:31:27.258 END TEST nvmf_target_disconnect_tc2 00:31:27.258 ************************************ 00:31:27.258 16:55:52 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:31:27.258 16:55:52 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:31:27.258 16:55:52 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:31:27.258 16:55:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:27.258 16:55:52 -- nvmf/common.sh@116 -- # sync 00:31:27.258 16:55:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:27.258 16:55:52 -- nvmf/common.sh@119 -- # set +e 00:31:27.258 16:55:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:27.258 16:55:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:27.258 rmmod nvme_tcp 00:31:27.258 rmmod nvme_fabrics 00:31:27.258 rmmod nvme_keyring 00:31:27.258 16:55:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:27.258 16:55:52 -- nvmf/common.sh@123 -- # set -e 00:31:27.258 16:55:52 -- nvmf/common.sh@124 -- # return 0 00:31:27.258 16:55:52 -- nvmf/common.sh@477 -- # '[' -n 1332333 ']' 00:31:27.258 16:55:52 -- nvmf/common.sh@478 -- # killprocess 1332333 00:31:27.258 16:55:52 -- common/autotest_common.sh@926 -- # '[' -z 1332333 ']' 00:31:27.258 16:55:52 -- common/autotest_common.sh@930 -- # kill -0 1332333 00:31:27.258 16:55:52 -- common/autotest_common.sh@931 -- # uname 00:31:27.258 16:55:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:27.258 16:55:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1332333 00:31:27.258 16:55:52 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:31:27.258 16:55:52 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:31:27.258 16:55:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1332333' 00:31:27.258 killing process with pid 1332333 00:31:27.258 16:55:52 -- common/autotest_common.sh@945 -- # kill 1332333 00:31:27.258 16:55:52 -- common/autotest_common.sh@950 -- # wait 1332333 00:31:27.258 16:55:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:27.258 16:55:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:27.258 16:55:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:27.258 16:55:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:27.258 16:55:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:27.258 16:55:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:27.258 16:55:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:27.258 16:55:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:29.162 16:55:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:29.162 00:31:29.162 real 0m16.247s 00:31:29.162 user 1m1.876s 00:31:29.162 sys 0m9.688s 00:31:29.162 16:55:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:29.162 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.162 ************************************ 00:31:29.162 END TEST nvmf_target_disconnect 00:31:29.162 ************************************ 00:31:29.162 16:55:54 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:31:29.162 16:55:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:29.162 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.162 16:55:54 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:31:29.162 00:31:29.162 real 22m49.127s 00:31:29.162 user 66m52.569s 00:31:29.162 sys 5m22.092s 00:31:29.162 16:55:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:29.162 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.162 ************************************ 00:31:29.162 END TEST nvmf_tcp 00:31:29.162 ************************************ 00:31:29.162 16:55:54 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:31:29.162 16:55:54 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:29.162 16:55:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:29.162 16:55:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:29.162 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.162 ************************************ 00:31:29.162 START TEST spdkcli_nvmf_tcp 00:31:29.162 ************************************ 00:31:29.162 16:55:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:29.420 * Looking for test storage... 00:31:29.420 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:31:29.420 16:55:54 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:31:29.420 16:55:54 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:29.420 16:55:54 -- nvmf/common.sh@7 -- # uname -s 00:31:29.420 16:55:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:29.420 16:55:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:29.420 16:55:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:29.420 16:55:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:29.420 16:55:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:29.420 16:55:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:29.420 16:55:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:29.420 16:55:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:29.420 16:55:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:29.420 16:55:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:29.420 16:55:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:29.420 16:55:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:29.420 16:55:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:29.420 16:55:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:29.420 16:55:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:29.420 16:55:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:29.420 16:55:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:29.420 16:55:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:29.420 16:55:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:29.420 16:55:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.420 16:55:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.420 16:55:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.420 16:55:54 -- paths/export.sh@5 -- # export PATH 00:31:29.420 16:55:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.420 16:55:54 -- nvmf/common.sh@46 -- # : 0 00:31:29.420 16:55:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:29.420 16:55:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:29.420 16:55:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:29.420 16:55:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:29.420 16:55:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:29.420 16:55:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:29.420 16:55:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:29.420 16:55:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:31:29.420 16:55:54 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:31:29.420 16:55:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:29.420 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.421 16:55:54 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:31:29.421 16:55:54 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1333549 00:31:29.421 16:55:54 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:31:29.421 16:55:54 -- spdkcli/common.sh@34 -- # waitforlisten 1333549 00:31:29.421 16:55:54 -- common/autotest_common.sh@819 -- # '[' -z 1333549 ']' 00:31:29.421 16:55:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:29.421 16:55:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:29.421 16:55:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:29.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:29.421 16:55:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:29.421 16:55:54 -- common/autotest_common.sh@10 -- # set +x 00:31:29.421 [2024-10-13 16:55:54.771750] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:31:29.421 [2024-10-13 16:55:54.771830] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1333549 ] 00:31:29.421 EAL: No free 2048 kB hugepages reported on node 1 00:31:29.421 [2024-10-13 16:55:54.830140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:31:29.421 [2024-10-13 16:55:54.915868] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:29.421 [2024-10-13 16:55:54.916069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:29.421 [2024-10-13 16:55:54.916074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:30.354 16:55:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:30.354 16:55:55 -- common/autotest_common.sh@852 -- # return 0 00:31:30.354 16:55:55 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:30.354 16:55:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:30.354 16:55:55 -- common/autotest_common.sh@10 -- # set +x 00:31:30.354 16:55:55 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:30.354 16:55:55 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:30.354 16:55:55 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:30.354 16:55:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:30.354 16:55:55 -- common/autotest_common.sh@10 -- # set +x 00:31:30.354 16:55:55 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:30.354 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:30.354 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:30.354 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:30.354 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:30.354 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:30.354 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:30.354 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:30.354 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:30.354 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:30.354 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:30.354 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:30.354 ' 00:31:30.920 [2024-10-13 16:55:56.236822] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:33.448 [2024-10-13 16:55:58.395964] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:34.380 [2024-10-13 16:55:59.632458] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:36.904 [2024-10-13 16:56:01.924089] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:38.801 [2024-10-13 16:56:03.890348] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:40.173 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:40.173 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:40.173 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:40.173 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:40.173 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:40.173 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:40.173 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:40.173 16:56:05 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:40.173 16:56:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:40.173 16:56:05 -- common/autotest_common.sh@10 -- # set +x 00:31:40.173 16:56:05 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:40.173 16:56:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:40.173 16:56:05 -- common/autotest_common.sh@10 -- # set +x 00:31:40.173 16:56:05 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:40.173 16:56:05 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:40.739 16:56:05 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:40.739 16:56:06 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:40.739 16:56:06 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:40.739 16:56:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:40.739 16:56:06 -- common/autotest_common.sh@10 -- # set +x 00:31:40.739 16:56:06 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:40.739 16:56:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:40.739 16:56:06 -- common/autotest_common.sh@10 -- # set +x 00:31:40.739 16:56:06 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:40.739 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:40.739 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:40.739 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:40.739 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:40.739 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:40.739 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:40.739 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:40.739 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:40.739 ' 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:46.007 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:46.007 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:46.007 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:46.007 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:46.007 16:56:11 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:46.007 16:56:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:46.007 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:31:46.007 16:56:11 -- spdkcli/nvmf.sh@90 -- # killprocess 1333549 00:31:46.007 16:56:11 -- common/autotest_common.sh@926 -- # '[' -z 1333549 ']' 00:31:46.007 16:56:11 -- common/autotest_common.sh@930 -- # kill -0 1333549 00:31:46.007 16:56:11 -- common/autotest_common.sh@931 -- # uname 00:31:46.007 16:56:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:46.007 16:56:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1333549 00:31:46.007 16:56:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:46.007 16:56:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:46.007 16:56:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1333549' 00:31:46.007 killing process with pid 1333549 00:31:46.007 16:56:11 -- common/autotest_common.sh@945 -- # kill 1333549 00:31:46.007 [2024-10-13 16:56:11.434621] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:46.007 16:56:11 -- common/autotest_common.sh@950 -- # wait 1333549 00:31:46.266 16:56:11 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:46.266 16:56:11 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:46.266 16:56:11 -- spdkcli/common.sh@13 -- # '[' -n 1333549 ']' 00:31:46.266 16:56:11 -- spdkcli/common.sh@14 -- # killprocess 1333549 00:31:46.266 16:56:11 -- common/autotest_common.sh@926 -- # '[' -z 1333549 ']' 00:31:46.266 16:56:11 -- common/autotest_common.sh@930 -- # kill -0 1333549 00:31:46.266 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1333549) - No such process 00:31:46.266 16:56:11 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1333549 is not found' 00:31:46.266 Process with pid 1333549 is not found 00:31:46.266 16:56:11 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:46.266 16:56:11 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:46.266 16:56:11 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:46.266 00:31:46.266 real 0m17.009s 00:31:46.266 user 0m36.406s 00:31:46.266 sys 0m0.803s 00:31:46.266 16:56:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:46.266 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:31:46.266 ************************************ 00:31:46.266 END TEST spdkcli_nvmf_tcp 00:31:46.266 ************************************ 00:31:46.266 16:56:11 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:46.266 16:56:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:46.266 16:56:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:46.266 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:31:46.266 ************************************ 00:31:46.266 START TEST nvmf_identify_passthru 00:31:46.266 ************************************ 00:31:46.266 16:56:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:46.266 * Looking for test storage... 00:31:46.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:46.266 16:56:11 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:46.266 16:56:11 -- nvmf/common.sh@7 -- # uname -s 00:31:46.266 16:56:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:46.266 16:56:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:46.266 16:56:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:46.266 16:56:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:46.266 16:56:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:46.266 16:56:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:46.266 16:56:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:46.266 16:56:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:46.266 16:56:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:46.266 16:56:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:46.266 16:56:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:46.266 16:56:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:46.266 16:56:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:46.266 16:56:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:46.266 16:56:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:46.266 16:56:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:46.266 16:56:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:46.266 16:56:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:46.266 16:56:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:46.266 16:56:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@5 -- # export PATH 00:31:46.266 16:56:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- nvmf/common.sh@46 -- # : 0 00:31:46.266 16:56:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:46.266 16:56:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:46.266 16:56:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:46.266 16:56:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:46.266 16:56:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:46.266 16:56:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:46.266 16:56:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:46.266 16:56:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:46.266 16:56:11 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:46.266 16:56:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:46.266 16:56:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:46.266 16:56:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:46.266 16:56:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- paths/export.sh@5 -- # export PATH 00:31:46.266 16:56:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:46.266 16:56:11 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:46.266 16:56:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:46.266 16:56:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:46.266 16:56:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:46.266 16:56:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:46.266 16:56:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:46.266 16:56:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:46.266 16:56:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:46.266 16:56:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:46.266 16:56:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:46.266 16:56:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:46.266 16:56:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:46.266 16:56:11 -- common/autotest_common.sh@10 -- # set +x 00:31:48.796 16:56:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:48.796 16:56:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:48.796 16:56:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:48.796 16:56:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:48.796 16:56:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:48.796 16:56:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:48.796 16:56:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:48.796 16:56:13 -- nvmf/common.sh@294 -- # net_devs=() 00:31:48.796 16:56:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:48.796 16:56:13 -- nvmf/common.sh@295 -- # e810=() 00:31:48.796 16:56:13 -- nvmf/common.sh@295 -- # local -ga e810 00:31:48.796 16:56:13 -- nvmf/common.sh@296 -- # x722=() 00:31:48.796 16:56:13 -- nvmf/common.sh@296 -- # local -ga x722 00:31:48.796 16:56:13 -- nvmf/common.sh@297 -- # mlx=() 00:31:48.796 16:56:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:48.796 16:56:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:48.796 16:56:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:48.796 16:56:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:48.796 16:56:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:48.796 16:56:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:48.796 16:56:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:48.796 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:48.796 16:56:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:48.796 16:56:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:48.796 16:56:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:48.797 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:48.797 16:56:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:48.797 16:56:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:48.797 16:56:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:48.797 16:56:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:48.797 16:56:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:48.797 16:56:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:48.797 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:48.797 16:56:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:48.797 16:56:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:48.797 16:56:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:48.797 16:56:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:48.797 16:56:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:48.797 16:56:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:48.797 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:48.797 16:56:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:48.797 16:56:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:48.797 16:56:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:48.797 16:56:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:48.797 16:56:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:48.797 16:56:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:48.797 16:56:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:48.797 16:56:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:48.797 16:56:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:48.797 16:56:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:48.797 16:56:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:48.797 16:56:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:48.797 16:56:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:48.797 16:56:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:48.797 16:56:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:48.797 16:56:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:48.797 16:56:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:48.797 16:56:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:48.797 16:56:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:48.797 16:56:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:48.797 16:56:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:48.797 16:56:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:48.797 16:56:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:48.797 16:56:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:48.797 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:48.797 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:31:48.797 00:31:48.797 --- 10.0.0.2 ping statistics --- 00:31:48.797 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:48.797 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:31:48.797 16:56:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:48.797 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:48.797 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:31:48.797 00:31:48.797 --- 10.0.0.1 ping statistics --- 00:31:48.797 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:48.797 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:31:48.797 16:56:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:48.797 16:56:13 -- nvmf/common.sh@410 -- # return 0 00:31:48.797 16:56:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:48.797 16:56:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:48.797 16:56:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:48.797 16:56:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:48.797 16:56:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:48.797 16:56:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:48.797 16:56:14 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:48.797 16:56:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:48.797 16:56:14 -- common/autotest_common.sh@10 -- # set +x 00:31:48.797 16:56:14 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:48.797 16:56:14 -- common/autotest_common.sh@1509 -- # bdfs=() 00:31:48.797 16:56:14 -- common/autotest_common.sh@1509 -- # local bdfs 00:31:48.797 16:56:14 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:31:48.797 16:56:14 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:31:48.797 16:56:14 -- common/autotest_common.sh@1498 -- # bdfs=() 00:31:48.797 16:56:14 -- common/autotest_common.sh@1498 -- # local bdfs 00:31:48.797 16:56:14 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:48.797 16:56:14 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:48.797 16:56:14 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:31:48.797 16:56:14 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:31:48.797 16:56:14 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:31:48.797 16:56:14 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:31:48.797 16:56:14 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:48.797 16:56:14 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:48.797 16:56:14 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:48.797 16:56:14 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:48.797 16:56:14 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:48.797 EAL: No free 2048 kB hugepages reported on node 1 00:31:52.980 16:56:18 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:52.980 16:56:18 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:52.980 16:56:18 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:52.980 16:56:18 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:52.980 EAL: No free 2048 kB hugepages reported on node 1 00:31:57.164 16:56:22 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:57.164 16:56:22 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:57.164 16:56:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:57.164 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.164 16:56:22 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:57.164 16:56:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:57.164 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.164 16:56:22 -- target/identify_passthru.sh@31 -- # nvmfpid=1338279 00:31:57.164 16:56:22 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:57.164 16:56:22 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:57.164 16:56:22 -- target/identify_passthru.sh@35 -- # waitforlisten 1338279 00:31:57.164 16:56:22 -- common/autotest_common.sh@819 -- # '[' -z 1338279 ']' 00:31:57.164 16:56:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:57.164 16:56:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:57.164 16:56:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:57.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:57.164 16:56:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:57.164 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.164 [2024-10-13 16:56:22.569313] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:31:57.164 [2024-10-13 16:56:22.569418] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:57.164 EAL: No free 2048 kB hugepages reported on node 1 00:31:57.164 [2024-10-13 16:56:22.637073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:57.422 [2024-10-13 16:56:22.728220] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:57.422 [2024-10-13 16:56:22.728406] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:57.422 [2024-10-13 16:56:22.728438] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:57.422 [2024-10-13 16:56:22.728462] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:57.422 [2024-10-13 16:56:22.728527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:57.422 [2024-10-13 16:56:22.728586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:57.422 [2024-10-13 16:56:22.728705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:57.422 [2024-10-13 16:56:22.728713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:57.422 16:56:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:57.422 16:56:22 -- common/autotest_common.sh@852 -- # return 0 00:31:57.422 16:56:22 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:57.422 16:56:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:57.422 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.422 INFO: Log level set to 20 00:31:57.422 INFO: Requests: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "method": "nvmf_set_config", 00:31:57.422 "id": 1, 00:31:57.422 "params": { 00:31:57.422 "admin_cmd_passthru": { 00:31:57.422 "identify_ctrlr": true 00:31:57.422 } 00:31:57.422 } 00:31:57.422 } 00:31:57.422 00:31:57.422 INFO: response: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "id": 1, 00:31:57.422 "result": true 00:31:57.422 } 00:31:57.422 00:31:57.422 16:56:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:57.422 16:56:22 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:57.422 16:56:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:57.422 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.422 INFO: Setting log level to 20 00:31:57.422 INFO: Setting log level to 20 00:31:57.422 INFO: Log level set to 20 00:31:57.422 INFO: Log level set to 20 00:31:57.422 INFO: Requests: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "method": "framework_start_init", 00:31:57.422 "id": 1 00:31:57.422 } 00:31:57.422 00:31:57.422 INFO: Requests: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "method": "framework_start_init", 00:31:57.422 "id": 1 00:31:57.422 } 00:31:57.422 00:31:57.422 [2024-10-13 16:56:22.896638] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:57.422 INFO: response: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "id": 1, 00:31:57.422 "result": true 00:31:57.422 } 00:31:57.422 00:31:57.422 INFO: response: 00:31:57.422 { 00:31:57.422 "jsonrpc": "2.0", 00:31:57.422 "id": 1, 00:31:57.422 "result": true 00:31:57.422 } 00:31:57.422 00:31:57.422 16:56:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:57.422 16:56:22 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:57.422 16:56:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:57.422 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.422 INFO: Setting log level to 40 00:31:57.422 INFO: Setting log level to 40 00:31:57.422 INFO: Setting log level to 40 00:31:57.422 [2024-10-13 16:56:22.906599] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:57.422 16:56:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:57.422 16:56:22 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:57.422 16:56:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:57.422 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:31:57.680 16:56:22 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:57.680 16:56:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:57.680 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 Nvme0n1 00:32:00.958 16:56:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:25 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:32:00.958 16:56:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.958 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 16:56:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:25 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:32:00.958 16:56:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.958 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 16:56:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:25 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:00.958 16:56:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.958 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 [2024-10-13 16:56:25.790589] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:00.958 16:56:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:25 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:32:00.958 16:56:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.958 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 [2024-10-13 16:56:25.798278] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:32:00.958 [ 00:32:00.958 { 00:32:00.958 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:32:00.958 "subtype": "Discovery", 00:32:00.958 "listen_addresses": [], 00:32:00.958 "allow_any_host": true, 00:32:00.958 "hosts": [] 00:32:00.958 }, 00:32:00.958 { 00:32:00.958 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:32:00.958 "subtype": "NVMe", 00:32:00.958 "listen_addresses": [ 00:32:00.958 { 00:32:00.958 "transport": "TCP", 00:32:00.958 "trtype": "TCP", 00:32:00.958 "adrfam": "IPv4", 00:32:00.958 "traddr": "10.0.0.2", 00:32:00.958 "trsvcid": "4420" 00:32:00.958 } 00:32:00.958 ], 00:32:00.958 "allow_any_host": true, 00:32:00.958 "hosts": [], 00:32:00.958 "serial_number": "SPDK00000000000001", 00:32:00.958 "model_number": "SPDK bdev Controller", 00:32:00.958 "max_namespaces": 1, 00:32:00.958 "min_cntlid": 1, 00:32:00.958 "max_cntlid": 65519, 00:32:00.958 "namespaces": [ 00:32:00.958 { 00:32:00.958 "nsid": 1, 00:32:00.958 "bdev_name": "Nvme0n1", 00:32:00.958 "name": "Nvme0n1", 00:32:00.958 "nguid": "AB8598F7FBB54A728F1E3ACC8901EDCD", 00:32:00.958 "uuid": "ab8598f7-fbb5-4a72-8f1e-3acc8901edcd" 00:32:00.958 } 00:32:00.958 ] 00:32:00.958 } 00:32:00.958 ] 00:32:00.958 16:56:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:25 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:32:00.958 16:56:25 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:32:00.958 16:56:25 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:32:00.958 EAL: No free 2048 kB hugepages reported on node 1 00:32:00.958 16:56:26 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:32:00.958 16:56:26 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:32:00.958 16:56:26 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:32:00.958 16:56:26 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:32:00.958 EAL: No free 2048 kB hugepages reported on node 1 00:32:00.958 16:56:26 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:32:00.958 16:56:26 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:32:00.958 16:56:26 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:32:00.958 16:56:26 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:00.958 16:56:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.958 16:56:26 -- common/autotest_common.sh@10 -- # set +x 00:32:00.958 16:56:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.958 16:56:26 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:32:00.958 16:56:26 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:32:00.958 16:56:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:00.958 16:56:26 -- nvmf/common.sh@116 -- # sync 00:32:00.958 16:56:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:00.958 16:56:26 -- nvmf/common.sh@119 -- # set +e 00:32:00.958 16:56:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:00.958 16:56:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:00.958 rmmod nvme_tcp 00:32:00.958 rmmod nvme_fabrics 00:32:00.958 rmmod nvme_keyring 00:32:00.958 16:56:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:00.958 16:56:26 -- nvmf/common.sh@123 -- # set -e 00:32:00.958 16:56:26 -- nvmf/common.sh@124 -- # return 0 00:32:00.958 16:56:26 -- nvmf/common.sh@477 -- # '[' -n 1338279 ']' 00:32:00.958 16:56:26 -- nvmf/common.sh@478 -- # killprocess 1338279 00:32:00.958 16:56:26 -- common/autotest_common.sh@926 -- # '[' -z 1338279 ']' 00:32:00.958 16:56:26 -- common/autotest_common.sh@930 -- # kill -0 1338279 00:32:00.958 16:56:26 -- common/autotest_common.sh@931 -- # uname 00:32:00.958 16:56:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:00.958 16:56:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1338279 00:32:00.958 16:56:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:00.958 16:56:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:00.958 16:56:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1338279' 00:32:00.958 killing process with pid 1338279 00:32:00.958 16:56:26 -- common/autotest_common.sh@945 -- # kill 1338279 00:32:00.958 [2024-10-13 16:56:26.284391] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:32:00.958 16:56:26 -- common/autotest_common.sh@950 -- # wait 1338279 00:32:02.857 16:56:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:32:02.857 16:56:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:02.857 16:56:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:02.857 16:56:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:02.857 16:56:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:02.857 16:56:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:02.857 16:56:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:02.857 16:56:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:04.759 16:56:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:04.759 00:32:04.759 real 0m18.210s 00:32:04.759 user 0m26.950s 00:32:04.759 sys 0m2.294s 00:32:04.759 16:56:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:04.759 16:56:29 -- common/autotest_common.sh@10 -- # set +x 00:32:04.759 ************************************ 00:32:04.759 END TEST nvmf_identify_passthru 00:32:04.759 ************************************ 00:32:04.759 16:56:29 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:32:04.759 16:56:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:04.759 16:56:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:04.759 16:56:29 -- common/autotest_common.sh@10 -- # set +x 00:32:04.759 ************************************ 00:32:04.759 START TEST nvmf_dif 00:32:04.759 ************************************ 00:32:04.759 16:56:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:32:04.759 * Looking for test storage... 00:32:04.759 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:04.759 16:56:29 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:04.759 16:56:29 -- nvmf/common.sh@7 -- # uname -s 00:32:04.759 16:56:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:04.759 16:56:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:04.759 16:56:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:04.759 16:56:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:04.759 16:56:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:04.759 16:56:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:04.759 16:56:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:04.759 16:56:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:04.759 16:56:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:04.759 16:56:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:04.759 16:56:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:04.759 16:56:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:04.759 16:56:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:04.759 16:56:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:04.759 16:56:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:04.759 16:56:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:04.759 16:56:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:04.759 16:56:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:04.759 16:56:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:04.759 16:56:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:04.759 16:56:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:04.759 16:56:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:04.759 16:56:29 -- paths/export.sh@5 -- # export PATH 00:32:04.759 16:56:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:04.759 16:56:29 -- nvmf/common.sh@46 -- # : 0 00:32:04.759 16:56:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:04.759 16:56:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:04.759 16:56:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:04.759 16:56:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:04.759 16:56:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:04.759 16:56:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:04.759 16:56:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:04.759 16:56:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:04.759 16:56:29 -- target/dif.sh@15 -- # NULL_META=16 00:32:04.759 16:56:29 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:32:04.759 16:56:29 -- target/dif.sh@15 -- # NULL_SIZE=64 00:32:04.759 16:56:29 -- target/dif.sh@15 -- # NULL_DIF=1 00:32:04.759 16:56:29 -- target/dif.sh@135 -- # nvmftestinit 00:32:04.759 16:56:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:04.759 16:56:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:04.759 16:56:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:04.759 16:56:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:04.759 16:56:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:04.759 16:56:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:04.759 16:56:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:04.759 16:56:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:04.759 16:56:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:04.759 16:56:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:04.759 16:56:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:04.759 16:56:29 -- common/autotest_common.sh@10 -- # set +x 00:32:06.660 16:56:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:06.660 16:56:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:06.660 16:56:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:06.660 16:56:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:06.660 16:56:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:06.660 16:56:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:06.660 16:56:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:06.660 16:56:31 -- nvmf/common.sh@294 -- # net_devs=() 00:32:06.660 16:56:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:06.660 16:56:31 -- nvmf/common.sh@295 -- # e810=() 00:32:06.660 16:56:31 -- nvmf/common.sh@295 -- # local -ga e810 00:32:06.660 16:56:31 -- nvmf/common.sh@296 -- # x722=() 00:32:06.660 16:56:31 -- nvmf/common.sh@296 -- # local -ga x722 00:32:06.660 16:56:31 -- nvmf/common.sh@297 -- # mlx=() 00:32:06.660 16:56:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:06.660 16:56:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:06.660 16:56:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:06.660 16:56:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:06.660 16:56:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:06.660 16:56:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:06.660 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:06.660 16:56:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:06.660 16:56:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:06.660 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:06.660 16:56:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:06.660 16:56:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:06.660 16:56:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:06.660 16:56:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:06.660 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:06.660 16:56:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:06.660 16:56:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:06.660 16:56:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:06.660 16:56:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:06.660 16:56:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:06.660 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:06.660 16:56:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:06.660 16:56:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:06.660 16:56:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:06.660 16:56:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:06.660 16:56:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:06.660 16:56:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:06.660 16:56:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:06.660 16:56:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:06.660 16:56:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:06.660 16:56:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:06.660 16:56:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:06.660 16:56:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:06.660 16:56:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:06.661 16:56:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:06.661 16:56:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:06.661 16:56:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:06.661 16:56:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:06.661 16:56:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:06.661 16:56:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:06.661 16:56:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:06.661 16:56:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:06.661 16:56:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:06.661 16:56:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:06.661 16:56:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:06.661 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:06.661 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:32:06.661 00:32:06.661 --- 10.0.0.2 ping statistics --- 00:32:06.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:06.661 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:32:06.661 16:56:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:06.661 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:06.661 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:32:06.661 00:32:06.661 --- 10.0.0.1 ping statistics --- 00:32:06.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:06.661 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:32:06.661 16:56:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:06.661 16:56:32 -- nvmf/common.sh@410 -- # return 0 00:32:06.661 16:56:32 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:06.661 16:56:32 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:08.038 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:32:08.038 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:32:08.038 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:32:08.038 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:32:08.038 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:32:08.038 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:32:08.038 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:32:08.038 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:32:08.038 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:32:08.038 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:32:08.038 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:32:08.038 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:32:08.038 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:32:08.038 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:32:08.038 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:32:08.038 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:32:08.038 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:32:08.038 16:56:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:08.038 16:56:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:08.038 16:56:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:08.038 16:56:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:08.038 16:56:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:08.038 16:56:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:08.038 16:56:33 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:32:08.038 16:56:33 -- target/dif.sh@137 -- # nvmfappstart 00:32:08.038 16:56:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:08.038 16:56:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:08.038 16:56:33 -- common/autotest_common.sh@10 -- # set +x 00:32:08.038 16:56:33 -- nvmf/common.sh@469 -- # nvmfpid=1341605 00:32:08.038 16:56:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:32:08.038 16:56:33 -- nvmf/common.sh@470 -- # waitforlisten 1341605 00:32:08.038 16:56:33 -- common/autotest_common.sh@819 -- # '[' -z 1341605 ']' 00:32:08.038 16:56:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:08.038 16:56:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:08.038 16:56:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:08.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:08.038 16:56:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:08.038 16:56:33 -- common/autotest_common.sh@10 -- # set +x 00:32:08.038 [2024-10-13 16:56:33.470326] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:32:08.038 [2024-10-13 16:56:33.470414] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:08.038 EAL: No free 2048 kB hugepages reported on node 1 00:32:08.038 [2024-10-13 16:56:33.537547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:08.296 [2024-10-13 16:56:33.625264] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:08.296 [2024-10-13 16:56:33.625453] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:08.296 [2024-10-13 16:56:33.625484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:08.296 [2024-10-13 16:56:33.625507] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:08.296 [2024-10-13 16:56:33.625559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:09.234 16:56:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:09.234 16:56:34 -- common/autotest_common.sh@852 -- # return 0 00:32:09.234 16:56:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:09.234 16:56:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 16:56:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:09.234 16:56:34 -- target/dif.sh@139 -- # create_transport 00:32:09.234 16:56:34 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:32:09.234 16:56:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 [2024-10-13 16:56:34.442931] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:09.234 16:56:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:09.234 16:56:34 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:32:09.234 16:56:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:09.234 16:56:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 ************************************ 00:32:09.234 START TEST fio_dif_1_default 00:32:09.234 ************************************ 00:32:09.234 16:56:34 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:32:09.234 16:56:34 -- target/dif.sh@86 -- # create_subsystems 0 00:32:09.234 16:56:34 -- target/dif.sh@28 -- # local sub 00:32:09.234 16:56:34 -- target/dif.sh@30 -- # for sub in "$@" 00:32:09.234 16:56:34 -- target/dif.sh@31 -- # create_subsystem 0 00:32:09.234 16:56:34 -- target/dif.sh@18 -- # local sub_id=0 00:32:09.234 16:56:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:09.234 16:56:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 bdev_null0 00:32:09.234 16:56:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:09.234 16:56:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:09.234 16:56:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 16:56:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:09.234 16:56:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:09.234 16:56:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 16:56:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:09.234 16:56:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:09.234 16:56:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:09.234 16:56:34 -- common/autotest_common.sh@10 -- # set +x 00:32:09.234 [2024-10-13 16:56:34.479193] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:09.234 16:56:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:09.234 16:56:34 -- target/dif.sh@87 -- # fio /dev/fd/62 00:32:09.234 16:56:34 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:32:09.234 16:56:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:09.234 16:56:34 -- nvmf/common.sh@520 -- # config=() 00:32:09.234 16:56:34 -- nvmf/common.sh@520 -- # local subsystem config 00:32:09.234 16:56:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:09.234 16:56:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.234 16:56:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:09.234 { 00:32:09.234 "params": { 00:32:09.234 "name": "Nvme$subsystem", 00:32:09.234 "trtype": "$TEST_TRANSPORT", 00:32:09.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:09.234 "adrfam": "ipv4", 00:32:09.234 "trsvcid": "$NVMF_PORT", 00:32:09.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:09.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:09.234 "hdgst": ${hdgst:-false}, 00:32:09.234 "ddgst": ${ddgst:-false} 00:32:09.234 }, 00:32:09.234 "method": "bdev_nvme_attach_controller" 00:32:09.234 } 00:32:09.234 EOF 00:32:09.234 )") 00:32:09.234 16:56:34 -- target/dif.sh@82 -- # gen_fio_conf 00:32:09.234 16:56:34 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.234 16:56:34 -- target/dif.sh@54 -- # local file 00:32:09.234 16:56:34 -- target/dif.sh@56 -- # cat 00:32:09.234 16:56:34 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:09.234 16:56:34 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:09.234 16:56:34 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:09.234 16:56:34 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.234 16:56:34 -- common/autotest_common.sh@1320 -- # shift 00:32:09.234 16:56:34 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:09.234 16:56:34 -- nvmf/common.sh@542 -- # cat 00:32:09.234 16:56:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:09.234 16:56:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.234 16:56:34 -- target/dif.sh@72 -- # (( file <= files )) 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:09.234 16:56:34 -- nvmf/common.sh@544 -- # jq . 00:32:09.234 16:56:34 -- nvmf/common.sh@545 -- # IFS=, 00:32:09.234 16:56:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:09.234 "params": { 00:32:09.234 "name": "Nvme0", 00:32:09.234 "trtype": "tcp", 00:32:09.234 "traddr": "10.0.0.2", 00:32:09.234 "adrfam": "ipv4", 00:32:09.234 "trsvcid": "4420", 00:32:09.234 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:09.234 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:09.234 "hdgst": false, 00:32:09.234 "ddgst": false 00:32:09.234 }, 00:32:09.234 "method": "bdev_nvme_attach_controller" 00:32:09.234 }' 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:09.234 16:56:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:09.234 16:56:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:09.234 16:56:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:09.234 16:56:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:09.234 16:56:34 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:09.234 16:56:34 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:09.493 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:09.493 fio-3.35 00:32:09.493 Starting 1 thread 00:32:09.493 EAL: No free 2048 kB hugepages reported on node 1 00:32:09.751 [2024-10-13 16:56:35.246484] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:09.751 [2024-10-13 16:56:35.246557] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:21.977 00:32:21.978 filename0: (groupid=0, jobs=1): err= 0: pid=1341852: Sun Oct 13 16:56:45 2024 00:32:21.978 read: IOPS=195, BW=783KiB/s (802kB/s)(7840KiB/10016msec) 00:32:21.978 slat (nsec): min=6593, max=64426, avg=8103.67, stdev=2758.29 00:32:21.978 clat (usec): min=513, max=44318, avg=20414.25, stdev=20405.53 00:32:21.978 lat (usec): min=520, max=44353, avg=20422.36, stdev=20405.30 00:32:21.978 clat percentiles (usec): 00:32:21.978 | 1.00th=[ 537], 5.00th=[ 562], 10.00th=[ 570], 20.00th=[ 578], 00:32:21.978 | 30.00th=[ 586], 40.00th=[ 603], 50.00th=[ 685], 60.00th=[41157], 00:32:21.978 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:32:21.978 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:32:21.978 | 99.99th=[44303] 00:32:21.978 bw ( KiB/s): min= 704, max= 1024, per=99.90%, avg=782.40, stdev=66.05, samples=20 00:32:21.978 iops : min= 176, max= 256, avg=195.60, stdev=16.51, samples=20 00:32:21.978 lat (usec) : 750=51.28%, 1000=0.15% 00:32:21.978 lat (msec) : 50=48.57% 00:32:21.978 cpu : usr=91.27%, sys=8.44%, ctx=20, majf=0, minf=334 00:32:21.978 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:21.978 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:21.978 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:21.978 issued rwts: total=1960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:21.978 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:21.978 00:32:21.978 Run status group 0 (all jobs): 00:32:21.978 READ: bw=783KiB/s (802kB/s), 783KiB/s-783KiB/s (802kB/s-802kB/s), io=7840KiB (8028kB), run=10016-10016msec 00:32:21.978 16:56:45 -- target/dif.sh@88 -- # destroy_subsystems 0 00:32:21.978 16:56:45 -- target/dif.sh@43 -- # local sub 00:32:21.978 16:56:45 -- target/dif.sh@45 -- # for sub in "$@" 00:32:21.978 16:56:45 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:21.978 16:56:45 -- target/dif.sh@36 -- # local sub_id=0 00:32:21.978 16:56:45 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 00:32:21.978 real 0m11.136s 00:32:21.978 user 0m10.469s 00:32:21.978 sys 0m1.126s 00:32:21.978 16:56:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 ************************************ 00:32:21.978 END TEST fio_dif_1_default 00:32:21.978 ************************************ 00:32:21.978 16:56:45 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:32:21.978 16:56:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:21.978 16:56:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 ************************************ 00:32:21.978 START TEST fio_dif_1_multi_subsystems 00:32:21.978 ************************************ 00:32:21.978 16:56:45 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:32:21.978 16:56:45 -- target/dif.sh@92 -- # local files=1 00:32:21.978 16:56:45 -- target/dif.sh@94 -- # create_subsystems 0 1 00:32:21.978 16:56:45 -- target/dif.sh@28 -- # local sub 00:32:21.978 16:56:45 -- target/dif.sh@30 -- # for sub in "$@" 00:32:21.978 16:56:45 -- target/dif.sh@31 -- # create_subsystem 0 00:32:21.978 16:56:45 -- target/dif.sh@18 -- # local sub_id=0 00:32:21.978 16:56:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 bdev_null0 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 [2024-10-13 16:56:45.638543] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@30 -- # for sub in "$@" 00:32:21.978 16:56:45 -- target/dif.sh@31 -- # create_subsystem 1 00:32:21.978 16:56:45 -- target/dif.sh@18 -- # local sub_id=1 00:32:21.978 16:56:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 bdev_null1 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:21.978 16:56:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.978 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:32:21.978 16:56:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.978 16:56:45 -- target/dif.sh@95 -- # fio /dev/fd/62 00:32:21.978 16:56:45 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:32:21.978 16:56:45 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:21.978 16:56:45 -- nvmf/common.sh@520 -- # config=() 00:32:21.978 16:56:45 -- nvmf/common.sh@520 -- # local subsystem config 00:32:21.978 16:56:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:21.978 16:56:45 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.978 16:56:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:21.978 { 00:32:21.978 "params": { 00:32:21.978 "name": "Nvme$subsystem", 00:32:21.978 "trtype": "$TEST_TRANSPORT", 00:32:21.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:21.978 "adrfam": "ipv4", 00:32:21.978 "trsvcid": "$NVMF_PORT", 00:32:21.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:21.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:21.978 "hdgst": ${hdgst:-false}, 00:32:21.978 "ddgst": ${ddgst:-false} 00:32:21.978 }, 00:32:21.978 "method": "bdev_nvme_attach_controller" 00:32:21.978 } 00:32:21.978 EOF 00:32:21.978 )") 00:32:21.978 16:56:45 -- target/dif.sh@82 -- # gen_fio_conf 00:32:21.978 16:56:45 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.978 16:56:45 -- target/dif.sh@54 -- # local file 00:32:21.978 16:56:45 -- target/dif.sh@56 -- # cat 00:32:21.978 16:56:45 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:21.978 16:56:45 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:21.978 16:56:45 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:21.978 16:56:45 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.978 16:56:45 -- common/autotest_common.sh@1320 -- # shift 00:32:21.978 16:56:45 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:21.978 16:56:45 -- nvmf/common.sh@542 -- # cat 00:32:21.978 16:56:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:21.978 16:56:45 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:21.978 16:56:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.978 16:56:45 -- target/dif.sh@72 -- # (( file <= files )) 00:32:21.978 16:56:45 -- target/dif.sh@73 -- # cat 00:32:21.978 16:56:45 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:21.978 16:56:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:21.978 16:56:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:21.978 16:56:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:21.978 { 00:32:21.978 "params": { 00:32:21.978 "name": "Nvme$subsystem", 00:32:21.978 "trtype": "$TEST_TRANSPORT", 00:32:21.978 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:21.978 "adrfam": "ipv4", 00:32:21.978 "trsvcid": "$NVMF_PORT", 00:32:21.978 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:21.978 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:21.978 "hdgst": ${hdgst:-false}, 00:32:21.978 "ddgst": ${ddgst:-false} 00:32:21.978 }, 00:32:21.978 "method": "bdev_nvme_attach_controller" 00:32:21.978 } 00:32:21.978 EOF 00:32:21.978 )") 00:32:21.978 16:56:45 -- nvmf/common.sh@542 -- # cat 00:32:21.978 16:56:45 -- target/dif.sh@72 -- # (( file++ )) 00:32:21.978 16:56:45 -- target/dif.sh@72 -- # (( file <= files )) 00:32:21.978 16:56:45 -- nvmf/common.sh@544 -- # jq . 00:32:21.978 16:56:45 -- nvmf/common.sh@545 -- # IFS=, 00:32:21.978 16:56:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:21.978 "params": { 00:32:21.978 "name": "Nvme0", 00:32:21.978 "trtype": "tcp", 00:32:21.978 "traddr": "10.0.0.2", 00:32:21.978 "adrfam": "ipv4", 00:32:21.978 "trsvcid": "4420", 00:32:21.979 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:21.979 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:21.979 "hdgst": false, 00:32:21.979 "ddgst": false 00:32:21.979 }, 00:32:21.979 "method": "bdev_nvme_attach_controller" 00:32:21.979 },{ 00:32:21.979 "params": { 00:32:21.979 "name": "Nvme1", 00:32:21.979 "trtype": "tcp", 00:32:21.979 "traddr": "10.0.0.2", 00:32:21.979 "adrfam": "ipv4", 00:32:21.979 "trsvcid": "4420", 00:32:21.979 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:21.979 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:21.979 "hdgst": false, 00:32:21.979 "ddgst": false 00:32:21.979 }, 00:32:21.979 "method": "bdev_nvme_attach_controller" 00:32:21.979 }' 00:32:21.979 16:56:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:21.979 16:56:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:21.979 16:56:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:21.979 16:56:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.979 16:56:45 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:21.979 16:56:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:21.979 16:56:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:21.979 16:56:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:21.979 16:56:45 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:21.979 16:56:45 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.979 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:21.979 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:21.979 fio-3.35 00:32:21.979 Starting 2 threads 00:32:21.979 EAL: No free 2048 kB hugepages reported on node 1 00:32:21.979 [2024-10-13 16:56:46.619005] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:21.979 [2024-10-13 16:56:46.619087] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:31.988 00:32:31.988 filename0: (groupid=0, jobs=1): err= 0: pid=1343319: Sun Oct 13 16:56:56 2024 00:32:31.988 read: IOPS=98, BW=393KiB/s (402kB/s)(3936KiB/10017msec) 00:32:31.988 slat (nsec): min=5541, max=27815, avg=8499.84, stdev=2287.77 00:32:31.988 clat (usec): min=580, max=46730, avg=40692.29, stdev=3650.40 00:32:31.988 lat (usec): min=587, max=46757, avg=40700.79, stdev=3650.31 00:32:31.988 clat percentiles (usec): 00:32:31.988 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:31.988 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:31.988 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:31.988 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:32:31.988 | 99.99th=[46924] 00:32:31.988 bw ( KiB/s): min= 384, max= 448, per=33.75%, avg=392.00, stdev=17.60, samples=20 00:32:31.988 iops : min= 96, max= 112, avg=98.00, stdev= 4.40, samples=20 00:32:31.988 lat (usec) : 750=0.81% 00:32:31.988 lat (msec) : 50=99.19% 00:32:31.988 cpu : usr=95.47%, sys=4.23%, ctx=15, majf=0, minf=190 00:32:31.988 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:31.988 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.988 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.988 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.988 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:31.988 filename1: (groupid=0, jobs=1): err= 0: pid=1343320: Sun Oct 13 16:56:56 2024 00:32:31.988 read: IOPS=192, BW=770KiB/s (788kB/s)(7728KiB/10042msec) 00:32:31.988 slat (nsec): min=4893, max=67360, avg=8520.53, stdev=2883.54 00:32:31.988 clat (usec): min=544, max=46748, avg=20763.99, stdev=20358.16 00:32:31.988 lat (usec): min=551, max=46760, avg=20772.51, stdev=20358.04 00:32:31.988 clat percentiles (usec): 00:32:31.988 | 1.00th=[ 553], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 734], 00:32:31.988 | 30.00th=[ 742], 40.00th=[ 750], 50.00th=[ 1090], 60.00th=[41157], 00:32:31.988 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:32:31.988 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:32:31.988 | 99.99th=[46924] 00:32:31.988 bw ( KiB/s): min= 704, max= 896, per=66.38%, avg=771.20, stdev=38.71, samples=20 00:32:31.988 iops : min= 176, max= 224, avg=192.80, stdev= 9.68, samples=20 00:32:31.988 lat (usec) : 750=39.34%, 1000=9.94% 00:32:31.988 lat (msec) : 2=1.45%, 50=49.28% 00:32:31.988 cpu : usr=95.62%, sys=4.07%, ctx=21, majf=0, minf=179 00:32:31.988 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:31.988 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.988 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.988 issued rwts: total=1932,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.988 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:31.988 00:32:31.988 Run status group 0 (all jobs): 00:32:31.988 READ: bw=1162KiB/s (1189kB/s), 393KiB/s-770KiB/s (402kB/s-788kB/s), io=11.4MiB (11.9MB), run=10017-10042msec 00:32:31.988 16:56:56 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:31.988 16:56:56 -- target/dif.sh@43 -- # local sub 00:32:31.988 16:56:56 -- target/dif.sh@45 -- # for sub in "$@" 00:32:31.988 16:56:56 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:31.988 16:56:56 -- target/dif.sh@36 -- # local sub_id=0 00:32:31.988 16:56:56 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:31.988 16:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:56 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:56 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:31.988 16:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:56 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:56 -- target/dif.sh@45 -- # for sub in "$@" 00:32:31.988 16:56:56 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:31.988 16:56:56 -- target/dif.sh@36 -- # local sub_id=1 00:32:31.988 16:56:56 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:31.988 16:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:56 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:56 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:31.988 16:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:56 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 00:32:31.988 real 0m11.388s 00:32:31.988 user 0m20.431s 00:32:31.988 sys 0m1.138s 00:32:31.988 16:56:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:31.988 16:56:56 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 ************************************ 00:32:31.988 END TEST fio_dif_1_multi_subsystems 00:32:31.988 ************************************ 00:32:31.988 16:56:57 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:31.988 16:56:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:31.988 16:56:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:31.988 16:56:57 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 ************************************ 00:32:31.988 START TEST fio_dif_rand_params 00:32:31.988 ************************************ 00:32:31.988 16:56:57 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:32:31.988 16:56:57 -- target/dif.sh@100 -- # local NULL_DIF 00:32:31.988 16:56:57 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:31.988 16:56:57 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:31.988 16:56:57 -- target/dif.sh@103 -- # bs=128k 00:32:31.988 16:56:57 -- target/dif.sh@103 -- # numjobs=3 00:32:31.988 16:56:57 -- target/dif.sh@103 -- # iodepth=3 00:32:31.988 16:56:57 -- target/dif.sh@103 -- # runtime=5 00:32:31.988 16:56:57 -- target/dif.sh@105 -- # create_subsystems 0 00:32:31.988 16:56:57 -- target/dif.sh@28 -- # local sub 00:32:31.988 16:56:57 -- target/dif.sh@30 -- # for sub in "$@" 00:32:31.988 16:56:57 -- target/dif.sh@31 -- # create_subsystem 0 00:32:31.988 16:56:57 -- target/dif.sh@18 -- # local sub_id=0 00:32:31.988 16:56:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:31.988 16:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:57 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 bdev_null0 00:32:31.988 16:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:31.988 16:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:57 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:31.988 16:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:57 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 16:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:31.988 16:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:31.988 16:56:57 -- common/autotest_common.sh@10 -- # set +x 00:32:31.988 [2024-10-13 16:56:57.054424] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:31.988 16:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:31.988 16:56:57 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:31.988 16:56:57 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:31.988 16:56:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:31.988 16:56:57 -- nvmf/common.sh@520 -- # config=() 00:32:31.988 16:56:57 -- nvmf/common.sh@520 -- # local subsystem config 00:32:31.988 16:56:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:31.989 16:56:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:31.989 16:56:57 -- target/dif.sh@82 -- # gen_fio_conf 00:32:31.989 16:56:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:31.989 { 00:32:31.989 "params": { 00:32:31.989 "name": "Nvme$subsystem", 00:32:31.989 "trtype": "$TEST_TRANSPORT", 00:32:31.989 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:31.989 "adrfam": "ipv4", 00:32:31.989 "trsvcid": "$NVMF_PORT", 00:32:31.989 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:31.989 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:31.989 "hdgst": ${hdgst:-false}, 00:32:31.989 "ddgst": ${ddgst:-false} 00:32:31.989 }, 00:32:31.989 "method": "bdev_nvme_attach_controller" 00:32:31.989 } 00:32:31.989 EOF 00:32:31.989 )") 00:32:31.989 16:56:57 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:31.989 16:56:57 -- target/dif.sh@54 -- # local file 00:32:31.989 16:56:57 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:31.989 16:56:57 -- target/dif.sh@56 -- # cat 00:32:31.989 16:56:57 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:31.989 16:56:57 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:31.989 16:56:57 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:31.989 16:56:57 -- common/autotest_common.sh@1320 -- # shift 00:32:31.989 16:56:57 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:31.989 16:56:57 -- nvmf/common.sh@542 -- # cat 00:32:31.989 16:56:57 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:31.989 16:56:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:31.989 16:56:57 -- target/dif.sh@72 -- # (( file <= files )) 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:31.989 16:56:57 -- nvmf/common.sh@544 -- # jq . 00:32:31.989 16:56:57 -- nvmf/common.sh@545 -- # IFS=, 00:32:31.989 16:56:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:31.989 "params": { 00:32:31.989 "name": "Nvme0", 00:32:31.989 "trtype": "tcp", 00:32:31.989 "traddr": "10.0.0.2", 00:32:31.989 "adrfam": "ipv4", 00:32:31.989 "trsvcid": "4420", 00:32:31.989 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:31.989 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:31.989 "hdgst": false, 00:32:31.989 "ddgst": false 00:32:31.989 }, 00:32:31.989 "method": "bdev_nvme_attach_controller" 00:32:31.989 }' 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:31.989 16:56:57 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:31.989 16:56:57 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:31.989 16:56:57 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:31.989 16:56:57 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:31.989 16:56:57 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:31.989 16:56:57 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:31.989 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:31.989 ... 00:32:31.989 fio-3.35 00:32:31.989 Starting 3 threads 00:32:31.989 EAL: No free 2048 kB hugepages reported on node 1 00:32:32.554 [2024-10-13 16:56:57.861081] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:32.554 [2024-10-13 16:56:57.861169] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:37.827 00:32:37.827 filename0: (groupid=0, jobs=1): err= 0: pid=1344732: Sun Oct 13 16:57:03 2024 00:32:37.827 read: IOPS=224, BW=28.1MiB/s (29.4MB/s)(141MiB/5005msec) 00:32:37.827 slat (nsec): min=4779, max=40945, avg=13210.13, stdev=3171.06 00:32:37.827 clat (usec): min=4599, max=54503, avg=13337.93, stdev=3281.14 00:32:37.827 lat (usec): min=4611, max=54515, avg=13351.14, stdev=3280.89 00:32:37.827 clat percentiles (usec): 00:32:37.827 | 1.00th=[ 5145], 5.00th=[ 8455], 10.00th=[ 9896], 20.00th=[11469], 00:32:37.827 | 30.00th=[12387], 40.00th=[13042], 50.00th=[13566], 60.00th=[14091], 00:32:37.827 | 70.00th=[14615], 80.00th=[15139], 90.00th=[15795], 95.00th=[16581], 00:32:37.827 | 99.00th=[17695], 99.50th=[26084], 99.90th=[53740], 99.95th=[54264], 00:32:37.827 | 99.99th=[54264] 00:32:37.827 bw ( KiB/s): min=26368, max=36864, per=32.77%, avg=28728.50, stdev=3439.53, samples=10 00:32:37.827 iops : min= 206, max= 288, avg=224.40, stdev=26.90, samples=10 00:32:37.827 lat (msec) : 10=10.32%, 20=89.15%, 50=0.27%, 100=0.27% 00:32:37.827 cpu : usr=93.03%, sys=6.49%, ctx=15, majf=0, minf=141 00:32:37.827 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:37.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 issued rwts: total=1124,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:37.827 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:37.827 filename0: (groupid=0, jobs=1): err= 0: pid=1344733: Sun Oct 13 16:57:03 2024 00:32:37.827 read: IOPS=220, BW=27.6MiB/s (29.0MB/s)(138MiB/5006msec) 00:32:37.827 slat (nsec): min=4224, max=93663, avg=13097.77, stdev=3752.84 00:32:37.827 clat (usec): min=5251, max=92075, avg=13558.88, stdev=4826.08 00:32:37.827 lat (usec): min=5262, max=92094, avg=13571.98, stdev=4826.16 00:32:37.827 clat percentiles (usec): 00:32:37.827 | 1.00th=[ 7111], 5.00th=[ 8979], 10.00th=[10814], 20.00th=[11600], 00:32:37.827 | 30.00th=[12256], 40.00th=[12780], 50.00th=[13435], 60.00th=[13960], 00:32:37.827 | 70.00th=[14353], 80.00th=[14877], 90.00th=[15664], 95.00th=[16319], 00:32:37.827 | 99.00th=[18744], 99.50th=[51643], 99.90th=[53216], 99.95th=[91751], 00:32:37.827 | 99.99th=[91751] 00:32:37.827 bw ( KiB/s): min=21248, max=33090, per=32.22%, avg=28243.40, stdev=2985.21, samples=10 00:32:37.827 iops : min= 166, max= 258, avg=220.60, stdev=23.23, samples=10 00:32:37.827 lat (msec) : 10=7.23%, 20=91.77%, 100=0.99% 00:32:37.827 cpu : usr=93.45%, sys=6.05%, ctx=8, majf=0, minf=126 00:32:37.827 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:37.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 issued rwts: total=1106,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:37.827 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:37.827 filename0: (groupid=0, jobs=1): err= 0: pid=1344734: Sun Oct 13 16:57:03 2024 00:32:37.827 read: IOPS=242, BW=30.4MiB/s (31.8MB/s)(153MiB/5046msec) 00:32:37.827 slat (usec): min=4, max=120, avg=15.15, stdev= 6.69 00:32:37.827 clat (usec): min=6732, max=52478, avg=12292.77, stdev=5148.19 00:32:37.827 lat (usec): min=6749, max=52490, avg=12307.91, stdev=5147.94 00:32:37.827 clat percentiles (usec): 00:32:37.827 | 1.00th=[ 7504], 5.00th=[ 9110], 10.00th=[10028], 20.00th=[10552], 00:32:37.827 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11600], 60.00th=[11994], 00:32:37.827 | 70.00th=[12387], 80.00th=[13042], 90.00th=[13829], 95.00th=[14484], 00:32:37.827 | 99.00th=[50594], 99.50th=[51643], 99.90th=[52691], 99.95th=[52691], 00:32:37.827 | 99.99th=[52691] 00:32:37.827 bw ( KiB/s): min=23808, max=34048, per=35.71%, avg=31308.80, stdev=3072.12, samples=10 00:32:37.827 iops : min= 186, max= 266, avg=244.60, stdev=24.00, samples=10 00:32:37.827 lat (msec) : 10=10.36%, 20=88.01%, 50=0.57%, 100=1.06% 00:32:37.827 cpu : usr=89.75%, sys=7.75%, ctx=118, majf=0, minf=85 00:32:37.827 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:37.827 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:37.827 issued rwts: total=1226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:37.827 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:37.827 00:32:37.827 Run status group 0 (all jobs): 00:32:37.827 READ: bw=85.6MiB/s (89.8MB/s), 27.6MiB/s-30.4MiB/s (29.0MB/s-31.8MB/s), io=432MiB (453MB), run=5005-5046msec 00:32:37.827 16:57:03 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:37.827 16:57:03 -- target/dif.sh@43 -- # local sub 00:32:37.827 16:57:03 -- target/dif.sh@45 -- # for sub in "$@" 00:32:37.827 16:57:03 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:37.827 16:57:03 -- target/dif.sh@36 -- # local sub_id=0 00:32:37.827 16:57:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:37.827 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:37.827 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:37.827 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:37.827 16:57:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:37.827 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:37.828 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:37.828 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # bs=4k 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # numjobs=8 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # iodepth=16 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # runtime= 00:32:37.828 16:57:03 -- target/dif.sh@109 -- # files=2 00:32:37.828 16:57:03 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:37.828 16:57:03 -- target/dif.sh@28 -- # local sub 00:32:37.828 16:57:03 -- target/dif.sh@30 -- # for sub in "$@" 00:32:37.828 16:57:03 -- target/dif.sh@31 -- # create_subsystem 0 00:32:37.828 16:57:03 -- target/dif.sh@18 -- # local sub_id=0 00:32:37.828 16:57:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:37.828 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:37.828 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:37.828 bdev_null0 00:32:37.828 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:37.828 16:57:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:37.828 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:37.828 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:37.828 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:37.828 16:57:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 [2024-10-13 16:57:03.339987] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@30 -- # for sub in "$@" 00:32:38.086 16:57:03 -- target/dif.sh@31 -- # create_subsystem 1 00:32:38.086 16:57:03 -- target/dif.sh@18 -- # local sub_id=1 00:32:38.086 16:57:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 bdev_null1 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@30 -- # for sub in "$@" 00:32:38.086 16:57:03 -- target/dif.sh@31 -- # create_subsystem 2 00:32:38.086 16:57:03 -- target/dif.sh@18 -- # local sub_id=2 00:32:38.086 16:57:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 bdev_null2 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:38.086 16:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:38.086 16:57:03 -- common/autotest_common.sh@10 -- # set +x 00:32:38.086 16:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:38.086 16:57:03 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:38.086 16:57:03 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:38.086 16:57:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:38.086 16:57:03 -- nvmf/common.sh@520 -- # config=() 00:32:38.086 16:57:03 -- nvmf/common.sh@520 -- # local subsystem config 00:32:38.086 16:57:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:38.086 16:57:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:38.087 { 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme$subsystem", 00:32:38.087 "trtype": "$TEST_TRANSPORT", 00:32:38.087 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "$NVMF_PORT", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:38.087 "hdgst": ${hdgst:-false}, 00:32:38.087 "ddgst": ${ddgst:-false} 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 } 00:32:38.087 EOF 00:32:38.087 )") 00:32:38.087 16:57:03 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.087 16:57:03 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:38.087 16:57:03 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:38.087 16:57:03 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:38.087 16:57:03 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.087 16:57:03 -- target/dif.sh@82 -- # gen_fio_conf 00:32:38.087 16:57:03 -- common/autotest_common.sh@1320 -- # shift 00:32:38.087 16:57:03 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:38.087 16:57:03 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:38.087 16:57:03 -- target/dif.sh@54 -- # local file 00:32:38.087 16:57:03 -- target/dif.sh@56 -- # cat 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # cat 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file <= files )) 00:32:38.087 16:57:03 -- target/dif.sh@73 -- # cat 00:32:38.087 16:57:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:38.087 { 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme$subsystem", 00:32:38.087 "trtype": "$TEST_TRANSPORT", 00:32:38.087 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "$NVMF_PORT", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:38.087 "hdgst": ${hdgst:-false}, 00:32:38.087 "ddgst": ${ddgst:-false} 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 } 00:32:38.087 EOF 00:32:38.087 )") 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # cat 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file++ )) 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file <= files )) 00:32:38.087 16:57:03 -- target/dif.sh@73 -- # cat 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file++ )) 00:32:38.087 16:57:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:38.087 16:57:03 -- target/dif.sh@72 -- # (( file <= files )) 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:38.087 { 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme$subsystem", 00:32:38.087 "trtype": "$TEST_TRANSPORT", 00:32:38.087 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "$NVMF_PORT", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:38.087 "hdgst": ${hdgst:-false}, 00:32:38.087 "ddgst": ${ddgst:-false} 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 } 00:32:38.087 EOF 00:32:38.087 )") 00:32:38.087 16:57:03 -- nvmf/common.sh@542 -- # cat 00:32:38.087 16:57:03 -- nvmf/common.sh@544 -- # jq . 00:32:38.087 16:57:03 -- nvmf/common.sh@545 -- # IFS=, 00:32:38.087 16:57:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme0", 00:32:38.087 "trtype": "tcp", 00:32:38.087 "traddr": "10.0.0.2", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "4420", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:38.087 "hdgst": false, 00:32:38.087 "ddgst": false 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 },{ 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme1", 00:32:38.087 "trtype": "tcp", 00:32:38.087 "traddr": "10.0.0.2", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "4420", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:38.087 "hdgst": false, 00:32:38.087 "ddgst": false 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 },{ 00:32:38.087 "params": { 00:32:38.087 "name": "Nvme2", 00:32:38.087 "trtype": "tcp", 00:32:38.087 "traddr": "10.0.0.2", 00:32:38.087 "adrfam": "ipv4", 00:32:38.087 "trsvcid": "4420", 00:32:38.087 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:38.087 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:38.087 "hdgst": false, 00:32:38.087 "ddgst": false 00:32:38.087 }, 00:32:38.087 "method": "bdev_nvme_attach_controller" 00:32:38.087 }' 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:38.087 16:57:03 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:38.087 16:57:03 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:38.087 16:57:03 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:38.087 16:57:03 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:38.087 16:57:03 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:38.087 16:57:03 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.345 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:38.345 ... 00:32:38.345 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:38.345 ... 00:32:38.345 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:38.345 ... 00:32:38.345 fio-3.35 00:32:38.345 Starting 24 threads 00:32:38.345 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.280 [2024-10-13 16:57:04.604638] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:39.280 [2024-10-13 16:57:04.604723] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:51.482 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345738: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=139, BW=560KiB/s (573kB/s)(5688KiB/10166msec) 00:32:51.482 slat (nsec): min=7878, max=96533, avg=31770.78, stdev=18290.91 00:32:51.482 clat (msec): min=29, max=394, avg=113.92, stdev=122.75 00:32:51.482 lat (msec): min=29, max=394, avg=113.95, stdev=122.74 00:32:51.482 clat percentiles (msec): 00:32:51.482 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.482 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.482 | 70.00th=[ 257], 80.00th=[ 288], 90.00th=[ 300], 95.00th=[ 317], 00:32:51.482 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 397], 99.95th=[ 397], 00:32:51.482 | 99.99th=[ 397] 00:32:51.482 bw ( KiB/s): min= 128, max= 2048, per=4.41%, avg=562.40, stdev=714.94, samples=20 00:32:51.482 iops : min= 32, max= 512, avg=140.60, stdev=178.74, samples=20 00:32:51.482 lat (msec) : 50=67.51%, 100=1.13%, 250=0.98%, 500=30.38% 00:32:51.482 cpu : usr=98.76%, sys=0.80%, ctx=22, majf=0, minf=51 00:32:51.482 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.7%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:51.482 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 issued rwts: total=1422,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.482 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345739: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=127, BW=511KiB/s (523kB/s)(5184KiB/10152msec) 00:32:51.482 slat (usec): min=5, max=108, avg=32.01, stdev=18.26 00:32:51.482 clat (msec): min=30, max=623, avg=124.47, stdev=161.62 00:32:51.482 lat (msec): min=30, max=623, avg=124.50, stdev=161.61 00:32:51.482 clat percentiles (msec): 00:32:51.482 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.482 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.482 | 70.00th=[ 33], 80.00th=[ 305], 90.00th=[ 439], 95.00th=[ 460], 00:32:51.482 | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 625], 99.95th=[ 625], 00:32:51.482 | 99.99th=[ 625] 00:32:51.482 bw ( KiB/s): min= 112, max= 2048, per=4.02%, avg=512.00, stdev=726.34, samples=20 00:32:51.482 iops : min= 28, max= 512, avg=128.00, stdev=181.59, samples=20 00:32:51.482 lat (msec) : 50=72.84%, 100=1.23%, 250=0.15%, 500=25.46%, 750=0.31% 00:32:51.482 cpu : usr=98.76%, sys=0.83%, ctx=17, majf=0, minf=55 00:32:51.482 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:51.482 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 issued rwts: total=1296,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.482 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345740: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10147msec) 00:32:51.482 slat (usec): min=8, max=105, avg=36.17, stdev=16.30 00:32:51.482 clat (msec): min=30, max=596, avg=128.09, stdev=173.65 00:32:51.482 lat (msec): min=30, max=596, avg=128.13, stdev=173.64 00:32:51.482 clat percentiles (msec): 00:32:51.482 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.482 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.482 | 70.00th=[ 33], 80.00th=[ 376], 90.00th=[ 451], 95.00th=[ 477], 00:32:51.482 | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 600], 99.95th=[ 600], 00:32:51.482 | 99.99th=[ 600] 00:32:51.482 bw ( KiB/s): min= 128, max= 2048, per=3.92%, avg=499.35, stdev=732.53, samples=20 00:32:51.482 iops : min= 32, max= 512, avg=124.80, stdev=183.06, samples=20 00:32:51.482 lat (msec) : 50=74.68%, 100=1.27%, 500=23.58%, 750=0.47% 00:32:51.482 cpu : usr=98.85%, sys=0.76%, ctx=20, majf=0, minf=45 00:32:51.482 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:51.482 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.482 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345741: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=131, BW=528KiB/s (541kB/s)(5368KiB/10167msec) 00:32:51.482 slat (usec): min=7, max=110, avg=33.20, stdev=22.28 00:32:51.482 clat (msec): min=16, max=556, avg=120.24, stdev=148.93 00:32:51.482 lat (msec): min=16, max=556, avg=120.28, stdev=148.93 00:32:51.482 clat percentiles (msec): 00:32:51.482 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.482 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.482 | 70.00th=[ 33], 80.00th=[ 313], 90.00th=[ 351], 95.00th=[ 435], 00:32:51.482 | 99.00th=[ 472], 99.50th=[ 489], 99.90th=[ 558], 99.95th=[ 558], 00:32:51.482 | 99.99th=[ 558] 00:32:51.482 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=530.40, stdev=730.86, samples=20 00:32:51.482 iops : min= 32, max= 512, avg=132.60, stdev=182.72, samples=20 00:32:51.482 lat (msec) : 20=0.15%, 50=71.39%, 100=1.19%, 250=0.45%, 500=26.53% 00:32:51.482 lat (msec) : 750=0.30% 00:32:51.482 cpu : usr=98.65%, sys=0.91%, ctx=25, majf=0, minf=50 00:32:51.482 IO depths : 1=5.1%, 2=10.6%, 4=22.4%, 8=54.4%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:51.482 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 complete : 0=0.0%, 4=93.3%, 8=1.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 issued rwts: total=1342,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.482 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345742: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=142, BW=571KiB/s (585kB/s)(5824KiB/10195msec) 00:32:51.482 slat (usec): min=6, max=103, avg=16.80, stdev=12.89 00:32:51.482 clat (msec): min=9, max=380, avg=111.40, stdev=125.05 00:32:51.482 lat (msec): min=9, max=380, avg=111.41, stdev=125.05 00:32:51.482 clat percentiles (msec): 00:32:51.482 | 1.00th=[ 10], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.482 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.482 | 70.00th=[ 45], 80.00th=[ 284], 90.00th=[ 309], 95.00th=[ 342], 00:32:51.482 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 380], 99.95th=[ 380], 00:32:51.482 | 99.99th=[ 380] 00:32:51.482 bw ( KiB/s): min= 128, max= 2176, per=4.52%, avg=576.00, stdev=757.90, samples=20 00:32:51.482 iops : min= 32, max= 544, avg=144.00, stdev=189.47, samples=20 00:32:51.482 lat (msec) : 10=1.10%, 20=2.20%, 50=67.03%, 500=29.67% 00:32:51.482 cpu : usr=98.77%, sys=0.82%, ctx=14, majf=0, minf=54 00:32:51.482 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:32:51.482 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.482 issued rwts: total=1456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.482 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.482 filename0: (groupid=0, jobs=1): err= 0: pid=1345743: Sun Oct 13 16:57:14 2024 00:32:51.482 read: IOPS=139, BW=557KiB/s (570kB/s)(5632KiB/10116msec) 00:32:51.482 slat (nsec): min=7958, max=93156, avg=32086.34, stdev=19450.80 00:32:51.483 clat (msec): min=16, max=355, avg=114.67, stdev=125.73 00:32:51.483 lat (msec): min=16, max=355, avg=114.70, stdev=125.72 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 266], 80.00th=[ 288], 90.00th=[ 305], 95.00th=[ 342], 00:32:51.483 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:32:51.483 | 99.99th=[ 355] 00:32:51.483 bw ( KiB/s): min= 128, max= 2032, per=4.36%, avg=556.80, stdev=718.30, samples=20 00:32:51.483 iops : min= 32, max= 508, avg=139.20, stdev=179.57, samples=20 00:32:51.483 lat (msec) : 20=0.57%, 50=67.61%, 100=1.14%, 500=30.68% 00:32:51.483 cpu : usr=98.57%, sys=0.92%, ctx=44, majf=0, minf=42 00:32:51.483 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1408,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename0: (groupid=0, jobs=1): err= 0: pid=1345744: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10159msec) 00:32:51.483 slat (nsec): min=4153, max=62376, avg=30659.58, stdev=11761.47 00:32:51.483 clat (msec): min=19, max=582, avg=128.34, stdev=172.73 00:32:51.483 lat (msec): min=19, max=582, avg=128.37, stdev=172.72 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 33], 80.00th=[ 376], 90.00th=[ 456], 95.00th=[ 481], 00:32:51.483 | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 584], 99.95th=[ 584], 00:32:51.483 | 99.99th=[ 584] 00:32:51.483 bw ( KiB/s): min= 128, max= 2048, per=3.92%, avg=499.20, stdev=732.25, samples=20 00:32:51.483 iops : min= 32, max= 512, avg=124.80, stdev=183.06, samples=20 00:32:51.483 lat (msec) : 20=0.32%, 50=74.37%, 100=1.27%, 500=23.89%, 750=0.16% 00:32:51.483 cpu : usr=97.75%, sys=1.39%, ctx=61, majf=0, minf=47 00:32:51.483 IO depths : 1=3.7%, 2=9.8%, 4=24.4%, 8=53.2%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename0: (groupid=0, jobs=1): err= 0: pid=1345745: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=139, BW=559KiB/s (573kB/s)(5696KiB/10188msec) 00:32:51.483 slat (usec): min=4, max=120, avg=31.10, stdev=21.82 00:32:51.483 clat (msec): min=4, max=570, avg=113.69, stdev=136.66 00:32:51.483 lat (msec): min=4, max=570, avg=113.72, stdev=136.65 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 33], 80.00th=[ 296], 90.00th=[ 330], 95.00th=[ 355], 00:32:51.483 | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 575], 99.95th=[ 575], 00:32:51.483 | 99.99th=[ 575] 00:32:51.483 bw ( KiB/s): min= 128, max= 2176, per=4.42%, avg=563.20, stdev=764.71, samples=20 00:32:51.483 iops : min= 32, max= 544, avg=140.80, stdev=191.18, samples=20 00:32:51.483 lat (msec) : 10=1.12%, 20=2.39%, 50=68.40%, 250=0.14%, 500=27.67% 00:32:51.483 lat (msec) : 750=0.28% 00:32:51.483 cpu : usr=98.79%, sys=0.80%, ctx=23, majf=0, minf=64 00:32:51.483 IO depths : 1=5.1%, 2=11.4%, 4=25.0%, 8=51.1%, 16=7.4%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1424,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345746: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=136, BW=548KiB/s (561kB/s)(5568KiB/10166msec) 00:32:51.483 slat (usec): min=7, max=115, avg=20.26, stdev=15.60 00:32:51.483 clat (msec): min=24, max=454, avg=116.20, stdev=131.49 00:32:51.483 lat (msec): min=24, max=454, avg=116.22, stdev=131.49 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 61], 80.00th=[ 296], 90.00th=[ 321], 95.00th=[ 347], 00:32:51.483 | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], 00:32:51.483 | 99.99th=[ 456] 00:32:51.483 bw ( KiB/s): min= 128, max= 2048, per=4.32%, avg=550.40, stdev=721.29, samples=20 00:32:51.483 iops : min= 32, max= 512, avg=137.60, stdev=180.32, samples=20 00:32:51.483 lat (msec) : 50=68.97%, 100=1.15%, 500=29.89% 00:32:51.483 cpu : usr=98.94%, sys=0.67%, ctx=13, majf=0, minf=39 00:32:51.483 IO depths : 1=1.4%, 2=7.7%, 4=25.0%, 8=54.8%, 16=11.1%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1392,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345747: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=142, BW=571KiB/s (585kB/s)(5824KiB/10195msec) 00:32:51.483 slat (usec): min=4, max=101, avg=31.98, stdev=20.63 00:32:51.483 clat (msec): min=3, max=513, avg=111.24, stdev=125.34 00:32:51.483 lat (msec): min=4, max=513, avg=111.27, stdev=125.33 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 9], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 44], 80.00th=[ 288], 90.00th=[ 309], 95.00th=[ 330], 00:32:51.483 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 514], 99.95th=[ 514], 00:32:51.483 | 99.99th=[ 514] 00:32:51.483 bw ( KiB/s): min= 128, max= 2176, per=4.52%, avg=576.00, stdev=757.77, samples=20 00:32:51.483 iops : min= 32, max= 544, avg=144.00, stdev=189.44, samples=20 00:32:51.483 lat (msec) : 4=0.07%, 10=1.17%, 20=2.06%, 50=67.03%, 500=29.53% 00:32:51.483 lat (msec) : 750=0.14% 00:32:51.483 cpu : usr=98.85%, sys=0.68%, ctx=33, majf=0, minf=53 00:32:51.483 IO depths : 1=4.1%, 2=10.4%, 4=25.0%, 8=52.1%, 16=8.4%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345748: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=143, BW=572KiB/s (586kB/s)(5832KiB/10191msec) 00:32:51.483 slat (usec): min=5, max=120, avg=46.68, stdev=26.35 00:32:51.483 clat (msec): min=8, max=455, avg=110.56, stdev=124.44 00:32:51.483 lat (msec): min=8, max=455, avg=110.61, stdev=124.46 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 44], 80.00th=[ 288], 90.00th=[ 309], 95.00th=[ 321], 00:32:51.483 | 99.00th=[ 384], 99.50th=[ 439], 99.90th=[ 456], 99.95th=[ 456], 00:32:51.483 | 99.99th=[ 456] 00:32:51.483 bw ( KiB/s): min= 128, max= 2176, per=4.52%, avg=576.80, stdev=756.77, samples=20 00:32:51.483 iops : min= 32, max= 544, avg=144.20, stdev=189.19, samples=20 00:32:51.483 lat (msec) : 10=2.06%, 20=1.10%, 50=67.08%, 250=0.82%, 500=28.94% 00:32:51.483 cpu : usr=98.69%, sys=0.80%, ctx=46, majf=0, minf=56 00:32:51.483 IO depths : 1=4.3%, 2=9.2%, 4=20.8%, 8=57.5%, 16=8.2%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=92.8%, 8=1.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1458,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345749: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=124, BW=497KiB/s (509kB/s)(5048KiB/10148msec) 00:32:51.483 slat (usec): min=8, max=162, avg=41.38, stdev=24.92 00:32:51.483 clat (msec): min=24, max=665, avg=128.27, stdev=174.78 00:32:51.483 lat (msec): min=24, max=665, avg=128.31, stdev=174.77 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 33], 80.00th=[ 397], 90.00th=[ 456], 95.00th=[ 485], 00:32:51.483 | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 667], 99.95th=[ 667], 00:32:51.483 | 99.99th=[ 667] 00:32:51.483 bw ( KiB/s): min= 112, max= 2048, per=3.91%, avg=498.55, stdev=730.93, samples=20 00:32:51.483 iops : min= 28, max= 512, avg=124.60, stdev=182.66, samples=20 00:32:51.483 lat (msec) : 50=74.64%, 100=1.27%, 250=1.27%, 500=21.39%, 750=1.43% 00:32:51.483 cpu : usr=98.66%, sys=0.94%, ctx=15, majf=0, minf=59 00:32:51.483 IO depths : 1=1.0%, 2=7.3%, 4=25.0%, 8=55.2%, 16=11.4%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1262,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345750: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=136, BW=546KiB/s (559kB/s)(5552KiB/10166msec) 00:32:51.483 slat (usec): min=7, max=127, avg=40.26, stdev=25.44 00:32:51.483 clat (msec): min=16, max=520, avg=116.33, stdev=133.34 00:32:51.483 lat (msec): min=16, max=520, avg=116.37, stdev=133.33 00:32:51.483 clat percentiles (msec): 00:32:51.483 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:51.483 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.483 | 70.00th=[ 52], 80.00th=[ 292], 90.00th=[ 321], 95.00th=[ 351], 00:32:51.483 | 99.00th=[ 447], 99.50th=[ 456], 99.90th=[ 523], 99.95th=[ 523], 00:32:51.483 | 99.99th=[ 523] 00:32:51.483 bw ( KiB/s): min= 128, max= 2048, per=4.30%, avg=548.80, stdev=721.82, samples=20 00:32:51.483 iops : min= 32, max= 512, avg=137.20, stdev=180.46, samples=20 00:32:51.483 lat (msec) : 20=0.14%, 50=69.02%, 100=1.15%, 500=29.54%, 750=0.14% 00:32:51.483 cpu : usr=98.71%, sys=0.81%, ctx=46, majf=0, minf=47 00:32:51.483 IO depths : 1=4.5%, 2=10.2%, 4=23.1%, 8=54.3%, 16=8.0%, 32=0.0%, >=64=0.0% 00:32:51.483 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 complete : 0=0.0%, 4=93.5%, 8=0.7%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.483 issued rwts: total=1388,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.483 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.483 filename1: (groupid=0, jobs=1): err= 0: pid=1345751: Sun Oct 13 16:57:14 2024 00:32:51.483 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10152msec) 00:32:51.483 slat (usec): min=5, max=105, avg=37.87, stdev=15.20 00:32:51.483 clat (msec): min=30, max=610, avg=128.13, stdev=174.74 00:32:51.484 lat (msec): min=30, max=610, avg=128.17, stdev=174.74 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 33], 80.00th=[ 376], 90.00th=[ 451], 95.00th=[ 477], 00:32:51.484 | 99.00th=[ 567], 99.50th=[ 592], 99.90th=[ 609], 99.95th=[ 609], 00:32:51.484 | 99.99th=[ 609] 00:32:51.484 bw ( KiB/s): min= 112, max= 2048, per=3.92%, avg=499.20, stdev=732.01, samples=20 00:32:51.484 iops : min= 28, max= 512, avg=124.80, stdev=183.00, samples=20 00:32:51.484 lat (msec) : 50=74.68%, 100=1.27%, 250=0.16%, 500=22.47%, 750=1.42% 00:32:51.484 cpu : usr=98.34%, sys=1.05%, ctx=31, majf=0, minf=52 00:32:51.484 IO depths : 1=5.5%, 2=11.8%, 4=25.0%, 8=50.7%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename1: (groupid=0, jobs=1): err= 0: pid=1345752: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=136, BW=548KiB/s (561kB/s)(5560KiB/10154msec) 00:32:51.484 slat (usec): min=7, max=110, avg=28.97, stdev=17.47 00:32:51.484 clat (msec): min=29, max=461, avg=116.47, stdev=129.12 00:32:51.484 lat (msec): min=29, max=461, avg=116.50, stdev=129.11 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 220], 80.00th=[ 288], 90.00th=[ 313], 95.00th=[ 326], 00:32:51.484 | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], 00:32:51.484 | 99.99th=[ 464] 00:32:51.484 bw ( KiB/s): min= 128, max= 2048, per=4.31%, avg=549.60, stdev=707.56, samples=20 00:32:51.484 iops : min= 32, max= 512, avg=137.40, stdev=176.89, samples=20 00:32:51.484 lat (msec) : 50=67.91%, 100=1.15%, 250=1.01%, 500=29.93% 00:32:51.484 cpu : usr=98.46%, sys=1.05%, ctx=55, majf=0, minf=47 00:32:51.484 IO depths : 1=4.5%, 2=10.8%, 4=25.0%, 8=51.7%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1390,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename1: (groupid=0, jobs=1): err= 0: pid=1345753: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10148msec) 00:32:51.484 slat (usec): min=8, max=118, avg=36.47, stdev=16.45 00:32:51.484 clat (msec): min=23, max=603, avg=128.11, stdev=173.46 00:32:51.484 lat (msec): min=23, max=603, avg=128.14, stdev=173.45 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 33], 80.00th=[ 376], 90.00th=[ 451], 95.00th=[ 477], 00:32:51.484 | 99.00th=[ 498], 99.50th=[ 558], 99.90th=[ 600], 99.95th=[ 600], 00:32:51.484 | 99.99th=[ 600] 00:32:51.484 bw ( KiB/s): min= 112, max= 2048, per=3.92%, avg=499.20, stdev=732.14, samples=20 00:32:51.484 iops : min= 28, max= 512, avg=124.80, stdev=183.03, samples=20 00:32:51.484 lat (msec) : 50=74.68%, 100=1.27%, 500=23.42%, 750=0.63% 00:32:51.484 cpu : usr=98.88%, sys=0.72%, ctx=14, majf=0, minf=41 00:32:51.484 IO depths : 1=4.9%, 2=11.1%, 4=24.8%, 8=51.7%, 16=7.6%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345754: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=124, BW=499KiB/s (511kB/s)(5040KiB/10097msec) 00:32:51.484 slat (nsec): min=7808, max=84446, avg=26620.16, stdev=15433.36 00:32:51.484 clat (msec): min=22, max=630, avg=127.97, stdev=175.34 00:32:51.484 lat (msec): min=22, max=630, avg=128.00, stdev=175.34 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 33], 80.00th=[ 393], 90.00th=[ 460], 95.00th=[ 481], 00:32:51.484 | 99.00th=[ 510], 99.50th=[ 527], 99.90th=[ 634], 99.95th=[ 634], 00:32:51.484 | 99.99th=[ 634] 00:32:51.484 bw ( KiB/s): min= 112, max= 2048, per=3.90%, avg=497.75, stdev=734.57, samples=20 00:32:51.484 iops : min= 28, max= 512, avg=124.40, stdev=183.57, samples=20 00:32:51.484 lat (msec) : 50=74.29%, 100=2.06%, 500=21.43%, 750=2.22% 00:32:51.484 cpu : usr=98.93%, sys=0.67%, ctx=23, majf=0, minf=46 00:32:51.484 IO depths : 1=4.4%, 2=9.8%, 4=21.6%, 8=55.6%, 16=8.7%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=93.4%, 8=1.5%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1260,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345755: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=144, BW=577KiB/s (591kB/s)(5888KiB/10197msec) 00:32:51.484 slat (nsec): min=5376, max=72174, avg=10823.24, stdev=4043.02 00:32:51.484 clat (msec): min=8, max=376, avg=110.25, stdev=124.05 00:32:51.484 lat (msec): min=8, max=376, avg=110.26, stdev=124.05 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 9], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 48], 80.00th=[ 284], 90.00th=[ 309], 95.00th=[ 330], 00:32:51.484 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 376], 99.95th=[ 376], 00:32:51.484 | 99.99th=[ 376] 00:32:51.484 bw ( KiB/s): min= 144, max= 2176, per=4.57%, avg=582.40, stdev=754.32, samples=20 00:32:51.484 iops : min= 36, max= 544, avg=145.60, stdev=188.58, samples=20 00:32:51.484 lat (msec) : 10=1.22%, 20=2.38%, 50=67.05%, 500=29.35% 00:32:51.484 cpu : usr=98.31%, sys=1.24%, ctx=16, majf=0, minf=114 00:32:51.484 IO depths : 1=4.6%, 2=10.8%, 4=25.0%, 8=51.7%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1472,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345756: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10159msec) 00:32:51.484 slat (nsec): min=3864, max=60880, avg=26746.90, stdev=11767.67 00:32:51.484 clat (msec): min=18, max=642, avg=128.36, stdev=174.74 00:32:51.484 lat (msec): min=18, max=642, avg=128.39, stdev=174.74 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 33], 80.00th=[ 368], 90.00th=[ 456], 95.00th=[ 485], 00:32:51.484 | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 642], 99.95th=[ 642], 00:32:51.484 | 99.99th=[ 642] 00:32:51.484 bw ( KiB/s): min= 112, max= 2048, per=3.92%, avg=499.35, stdev=732.55, samples=20 00:32:51.484 iops : min= 28, max= 512, avg=124.80, stdev=183.07, samples=20 00:32:51.484 lat (msec) : 20=0.32%, 50=74.21%, 100=1.42%, 250=1.27%, 500=21.04% 00:32:51.484 lat (msec) : 750=1.74% 00:32:51.484 cpu : usr=98.95%, sys=0.64%, ctx=21, majf=0, minf=52 00:32:51.484 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345757: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=138, BW=554KiB/s (567kB/s)(5644KiB/10188msec) 00:32:51.484 slat (usec): min=7, max=126, avg=30.29, stdev=19.33 00:32:51.484 clat (msec): min=9, max=500, avg=114.87, stdev=137.66 00:32:51.484 lat (msec): min=9, max=500, avg=114.90, stdev=137.66 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 16], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 33], 80.00th=[ 296], 90.00th=[ 321], 95.00th=[ 376], 00:32:51.484 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 502], 99.95th=[ 502], 00:32:51.484 | 99.99th=[ 502] 00:32:51.484 bw ( KiB/s): min= 128, max= 2104, per=4.38%, avg=558.00, stdev=756.93, samples=20 00:32:51.484 iops : min= 32, max= 526, avg=139.50, stdev=189.23, samples=20 00:32:51.484 lat (msec) : 10=0.99%, 20=1.91%, 50=69.03%, 250=1.13%, 500=26.65% 00:32:51.484 lat (msec) : 750=0.28% 00:32:51.484 cpu : usr=98.82%, sys=0.73%, ctx=32, majf=0, minf=61 00:32:51.484 IO depths : 1=4.3%, 2=9.2%, 4=20.9%, 8=57.3%, 16=8.4%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=92.9%, 8=1.4%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1411,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345758: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=137, BW=548KiB/s (562kB/s)(5576KiB/10168msec) 00:32:51.484 slat (usec): min=7, max=118, avg=29.11, stdev=16.68 00:32:51.484 clat (msec): min=29, max=502, avg=116.02, stdev=131.91 00:32:51.484 lat (msec): min=29, max=502, avg=116.05, stdev=131.91 00:32:51.484 clat percentiles (msec): 00:32:51.484 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.484 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.484 | 70.00th=[ 52], 80.00th=[ 292], 90.00th=[ 313], 95.00th=[ 338], 00:32:51.484 | 99.00th=[ 460], 99.50th=[ 481], 99.90th=[ 502], 99.95th=[ 502], 00:32:51.484 | 99.99th=[ 502] 00:32:51.484 bw ( KiB/s): min= 128, max= 2048, per=4.32%, avg=551.20, stdev=720.41, samples=20 00:32:51.484 iops : min= 32, max= 512, avg=137.80, stdev=180.10, samples=20 00:32:51.484 lat (msec) : 50=68.87%, 100=1.15%, 250=1.15%, 500=28.55%, 750=0.29% 00:32:51.484 cpu : usr=98.50%, sys=0.89%, ctx=60, majf=0, minf=55 00:32:51.484 IO depths : 1=4.7%, 2=9.8%, 4=21.4%, 8=56.2%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:51.484 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 complete : 0=0.0%, 4=93.0%, 8=1.3%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.484 issued rwts: total=1394,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.484 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.484 filename2: (groupid=0, jobs=1): err= 0: pid=1345759: Sun Oct 13 16:57:14 2024 00:32:51.484 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10147msec) 00:32:51.484 slat (usec): min=7, max=106, avg=34.86, stdev=14.81 00:32:51.484 clat (msec): min=17, max=595, avg=128.14, stdev=173.21 00:32:51.484 lat (msec): min=17, max=595, avg=128.18, stdev=173.20 00:32:51.485 clat percentiles (msec): 00:32:51.485 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:51.485 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.485 | 70.00th=[ 33], 80.00th=[ 376], 90.00th=[ 451], 95.00th=[ 477], 00:32:51.485 | 99.00th=[ 498], 99.50th=[ 550], 99.90th=[ 592], 99.95th=[ 592], 00:32:51.485 | 99.99th=[ 592] 00:32:51.485 bw ( KiB/s): min= 128, max= 2048, per=3.92%, avg=499.35, stdev=732.27, samples=20 00:32:51.485 iops : min= 32, max= 512, avg=124.80, stdev=183.00, samples=20 00:32:51.485 lat (msec) : 20=0.32%, 50=74.37%, 100=1.27%, 500=23.42%, 750=0.63% 00:32:51.485 cpu : usr=98.84%, sys=0.77%, ctx=22, majf=0, minf=64 00:32:51.485 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:51.485 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.485 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.485 filename2: (groupid=0, jobs=1): err= 0: pid=1345760: Sun Oct 13 16:57:14 2024 00:32:51.485 read: IOPS=138, BW=552KiB/s (566kB/s)(5616KiB/10168msec) 00:32:51.485 slat (nsec): min=7853, max=62807, avg=27346.70, stdev=12861.62 00:32:51.485 clat (msec): min=29, max=468, avg=115.18, stdev=127.80 00:32:51.485 lat (msec): min=29, max=468, avg=115.21, stdev=127.79 00:32:51.485 clat percentiles (msec): 00:32:51.485 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:51.485 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.485 | 70.00th=[ 259], 80.00th=[ 296], 90.00th=[ 313], 95.00th=[ 330], 00:32:51.485 | 99.00th=[ 405], 99.50th=[ 435], 99.90th=[ 468], 99.95th=[ 468], 00:32:51.485 | 99.99th=[ 468] 00:32:51.485 bw ( KiB/s): min= 128, max= 2048, per=4.36%, avg=555.20, stdev=718.16, samples=20 00:32:51.485 iops : min= 32, max= 512, avg=138.80, stdev=179.54, samples=20 00:32:51.485 lat (msec) : 50=68.38%, 100=1.14%, 250=0.43%, 500=30.06% 00:32:51.485 cpu : usr=98.34%, sys=1.04%, ctx=64, majf=0, minf=45 00:32:51.485 IO depths : 1=4.1%, 2=9.3%, 4=21.8%, 8=56.3%, 16=8.4%, 32=0.0%, >=64=0.0% 00:32:51.485 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 complete : 0=0.0%, 4=93.2%, 8=1.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 issued rwts: total=1404,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.485 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.485 filename2: (groupid=0, jobs=1): err= 0: pid=1345761: Sun Oct 13 16:57:14 2024 00:32:51.485 read: IOPS=124, BW=498KiB/s (510kB/s)(5056KiB/10152msec) 00:32:51.485 slat (usec): min=8, max=118, avg=55.57, stdev=25.62 00:32:51.485 clat (msec): min=30, max=620, avg=127.98, stdev=174.36 00:32:51.485 lat (msec): min=30, max=621, avg=128.04, stdev=174.37 00:32:51.485 clat percentiles (msec): 00:32:51.485 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:51.485 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:51.485 | 70.00th=[ 33], 80.00th=[ 397], 90.00th=[ 451], 95.00th=[ 485], 00:32:51.485 | 99.00th=[ 510], 99.50th=[ 514], 99.90th=[ 625], 99.95th=[ 625], 00:32:51.485 | 99.99th=[ 625] 00:32:51.485 bw ( KiB/s): min= 128, max= 2048, per=3.92%, avg=499.35, stdev=732.53, samples=20 00:32:51.485 iops : min= 32, max= 512, avg=124.80, stdev=183.06, samples=20 00:32:51.485 lat (msec) : 50=74.68%, 100=1.27%, 250=1.27%, 500=21.20%, 750=1.58% 00:32:51.485 cpu : usr=98.69%, sys=0.88%, ctx=14, majf=0, minf=50 00:32:51.485 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:51.485 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.485 issued rwts: total=1264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.485 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:51.485 00:32:51.485 Run status group 0 (all jobs): 00:32:51.485 READ: bw=12.4MiB/s (13.0MB/s), 497KiB/s-577KiB/s (509kB/s-591kB/s), io=127MiB (133MB), run=10097-10197msec 00:32:51.485 16:57:15 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:51.485 16:57:15 -- target/dif.sh@43 -- # local sub 00:32:51.485 16:57:15 -- target/dif.sh@45 -- # for sub in "$@" 00:32:51.485 16:57:15 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:51.485 16:57:15 -- target/dif.sh@36 -- # local sub_id=0 00:32:51.485 16:57:15 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@45 -- # for sub in "$@" 00:32:51.485 16:57:15 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:51.485 16:57:15 -- target/dif.sh@36 -- # local sub_id=1 00:32:51.485 16:57:15 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@45 -- # for sub in "$@" 00:32:51.485 16:57:15 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:51.485 16:57:15 -- target/dif.sh@36 -- # local sub_id=2 00:32:51.485 16:57:15 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # numjobs=2 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # iodepth=8 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # runtime=5 00:32:51.485 16:57:15 -- target/dif.sh@115 -- # files=1 00:32:51.485 16:57:15 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:51.485 16:57:15 -- target/dif.sh@28 -- # local sub 00:32:51.485 16:57:15 -- target/dif.sh@30 -- # for sub in "$@" 00:32:51.485 16:57:15 -- target/dif.sh@31 -- # create_subsystem 0 00:32:51.485 16:57:15 -- target/dif.sh@18 -- # local sub_id=0 00:32:51.485 16:57:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 bdev_null0 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 [2024-10-13 16:57:15.295963] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@30 -- # for sub in "$@" 00:32:51.485 16:57:15 -- target/dif.sh@31 -- # create_subsystem 1 00:32:51.485 16:57:15 -- target/dif.sh@18 -- # local sub_id=1 00:32:51.485 16:57:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 bdev_null1 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:51.485 16:57:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:51.485 16:57:15 -- common/autotest_common.sh@10 -- # set +x 00:32:51.485 16:57:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:51.485 16:57:15 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:51.485 16:57:15 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:51.485 16:57:15 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:51.485 16:57:15 -- nvmf/common.sh@520 -- # config=() 00:32:51.485 16:57:15 -- nvmf/common.sh@520 -- # local subsystem config 00:32:51.485 16:57:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:51.485 16:57:15 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:51.485 16:57:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:51.485 { 00:32:51.485 "params": { 00:32:51.485 "name": "Nvme$subsystem", 00:32:51.485 "trtype": "$TEST_TRANSPORT", 00:32:51.485 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:51.485 "adrfam": "ipv4", 00:32:51.485 "trsvcid": "$NVMF_PORT", 00:32:51.485 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:51.485 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:51.485 "hdgst": ${hdgst:-false}, 00:32:51.485 "ddgst": ${ddgst:-false} 00:32:51.485 }, 00:32:51.485 "method": "bdev_nvme_attach_controller" 00:32:51.485 } 00:32:51.485 EOF 00:32:51.485 )") 00:32:51.485 16:57:15 -- target/dif.sh@82 -- # gen_fio_conf 00:32:51.486 16:57:15 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:51.486 16:57:15 -- target/dif.sh@54 -- # local file 00:32:51.486 16:57:15 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:51.486 16:57:15 -- target/dif.sh@56 -- # cat 00:32:51.486 16:57:15 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:51.486 16:57:15 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:51.486 16:57:15 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:51.486 16:57:15 -- common/autotest_common.sh@1320 -- # shift 00:32:51.486 16:57:15 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:51.486 16:57:15 -- nvmf/common.sh@542 -- # cat 00:32:51.486 16:57:15 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:51.486 16:57:15 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:51.486 16:57:15 -- target/dif.sh@72 -- # (( file <= files )) 00:32:51.486 16:57:15 -- target/dif.sh@73 -- # cat 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:51.486 16:57:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:51.486 16:57:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:51.486 { 00:32:51.486 "params": { 00:32:51.486 "name": "Nvme$subsystem", 00:32:51.486 "trtype": "$TEST_TRANSPORT", 00:32:51.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:51.486 "adrfam": "ipv4", 00:32:51.486 "trsvcid": "$NVMF_PORT", 00:32:51.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:51.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:51.486 "hdgst": ${hdgst:-false}, 00:32:51.486 "ddgst": ${ddgst:-false} 00:32:51.486 }, 00:32:51.486 "method": "bdev_nvme_attach_controller" 00:32:51.486 } 00:32:51.486 EOF 00:32:51.486 )") 00:32:51.486 16:57:15 -- target/dif.sh@72 -- # (( file++ )) 00:32:51.486 16:57:15 -- nvmf/common.sh@542 -- # cat 00:32:51.486 16:57:15 -- target/dif.sh@72 -- # (( file <= files )) 00:32:51.486 16:57:15 -- nvmf/common.sh@544 -- # jq . 00:32:51.486 16:57:15 -- nvmf/common.sh@545 -- # IFS=, 00:32:51.486 16:57:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:51.486 "params": { 00:32:51.486 "name": "Nvme0", 00:32:51.486 "trtype": "tcp", 00:32:51.486 "traddr": "10.0.0.2", 00:32:51.486 "adrfam": "ipv4", 00:32:51.486 "trsvcid": "4420", 00:32:51.486 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:51.486 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:51.486 "hdgst": false, 00:32:51.486 "ddgst": false 00:32:51.486 }, 00:32:51.486 "method": "bdev_nvme_attach_controller" 00:32:51.486 },{ 00:32:51.486 "params": { 00:32:51.486 "name": "Nvme1", 00:32:51.486 "trtype": "tcp", 00:32:51.486 "traddr": "10.0.0.2", 00:32:51.486 "adrfam": "ipv4", 00:32:51.486 "trsvcid": "4420", 00:32:51.486 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:51.486 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:51.486 "hdgst": false, 00:32:51.486 "ddgst": false 00:32:51.486 }, 00:32:51.486 "method": "bdev_nvme_attach_controller" 00:32:51.486 }' 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:51.486 16:57:15 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:51.486 16:57:15 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:51.486 16:57:15 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:51.486 16:57:15 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:51.486 16:57:15 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:51.486 16:57:15 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:51.486 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:51.486 ... 00:32:51.486 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:51.486 ... 00:32:51.486 fio-3.35 00:32:51.486 Starting 4 threads 00:32:51.486 EAL: No free 2048 kB hugepages reported on node 1 00:32:51.486 [2024-10-13 16:57:16.111329] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:51.486 [2024-10-13 16:57:16.111404] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:56.750 00:32:56.750 filename0: (groupid=0, jobs=1): err= 0: pid=1347686: Sun Oct 13 16:57:21 2024 00:32:56.750 read: IOPS=1904, BW=14.9MiB/s (15.6MB/s)(74.4MiB/5001msec) 00:32:56.750 slat (nsec): min=6813, max=64696, avg=16959.31, stdev=7911.14 00:32:56.750 clat (usec): min=668, max=8667, avg=4144.60, stdev=658.76 00:32:56.750 lat (usec): min=685, max=8675, avg=4161.56, stdev=658.07 00:32:56.750 clat percentiles (usec): 00:32:56.750 | 1.00th=[ 2704], 5.00th=[ 3326], 10.00th=[ 3589], 20.00th=[ 3818], 00:32:56.750 | 30.00th=[ 3916], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4113], 00:32:56.750 | 70.00th=[ 4228], 80.00th=[ 4424], 90.00th=[ 4883], 95.00th=[ 5407], 00:32:56.750 | 99.00th=[ 6456], 99.50th=[ 6783], 99.90th=[ 7963], 99.95th=[ 8160], 00:32:56.750 | 99.99th=[ 8717] 00:32:56.750 bw ( KiB/s): min=14688, max=15936, per=24.49%, avg=15319.11, stdev=475.45, samples=9 00:32:56.750 iops : min= 1836, max= 1992, avg=1914.89, stdev=59.43, samples=9 00:32:56.750 lat (usec) : 750=0.01%, 1000=0.10% 00:32:56.750 lat (msec) : 2=0.38%, 4=45.71%, 10=53.80% 00:32:56.750 cpu : usr=96.00%, sys=3.50%, ctx=8, majf=0, minf=9 00:32:56.750 IO depths : 1=0.1%, 2=10.0%, 4=61.5%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:56.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 complete : 0=0.0%, 4=92.8%, 8=7.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 issued rwts: total=9524,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:56.750 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:56.750 filename0: (groupid=0, jobs=1): err= 0: pid=1347687: Sun Oct 13 16:57:21 2024 00:32:56.750 read: IOPS=2009, BW=15.7MiB/s (16.5MB/s)(79.2MiB/5042msec) 00:32:56.750 slat (nsec): min=4607, max=62035, avg=14133.01, stdev=7610.72 00:32:56.750 clat (usec): min=868, max=42296, avg=3909.56, stdev=810.14 00:32:56.750 lat (usec): min=886, max=42309, avg=3923.70, stdev=810.57 00:32:56.750 clat percentiles (usec): 00:32:56.750 | 1.00th=[ 2245], 5.00th=[ 2966], 10.00th=[ 3228], 20.00th=[ 3523], 00:32:56.750 | 30.00th=[ 3720], 40.00th=[ 3851], 50.00th=[ 3949], 60.00th=[ 4015], 00:32:56.750 | 70.00th=[ 4080], 80.00th=[ 4178], 90.00th=[ 4424], 95.00th=[ 4817], 00:32:56.750 | 99.00th=[ 5997], 99.50th=[ 6456], 99.90th=[ 6849], 99.95th=[ 6915], 00:32:56.750 | 99.99th=[42206] 00:32:56.750 bw ( KiB/s): min=15808, max=16832, per=25.92%, avg=16212.80, stdev=326.08, samples=10 00:32:56.750 iops : min= 1976, max= 2104, avg=2026.60, stdev=40.76, samples=10 00:32:56.750 lat (usec) : 1000=0.04% 00:32:56.750 lat (msec) : 2=0.59%, 4=58.34%, 10=41.00%, 50=0.02% 00:32:56.750 cpu : usr=96.27%, sys=3.23%, ctx=6, majf=0, minf=9 00:32:56.750 IO depths : 1=0.3%, 2=10.5%, 4=61.0%, 8=28.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:56.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 complete : 0=0.0%, 4=92.8%, 8=7.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 issued rwts: total=10133,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:56.750 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:56.750 filename1: (groupid=0, jobs=1): err= 0: pid=1347688: Sun Oct 13 16:57:21 2024 00:32:56.750 read: IOPS=1986, BW=15.5MiB/s (16.3MB/s)(77.6MiB/5002msec) 00:32:56.750 slat (nsec): min=4167, max=63113, avg=16899.04, stdev=8707.88 00:32:56.750 clat (usec): min=650, max=7515, avg=3968.46, stdev=586.90 00:32:56.750 lat (usec): min=663, max=7522, avg=3985.36, stdev=587.02 00:32:56.750 clat percentiles (usec): 00:32:56.750 | 1.00th=[ 2638], 5.00th=[ 3032], 10.00th=[ 3359], 20.00th=[ 3621], 00:32:56.750 | 30.00th=[ 3785], 40.00th=[ 3884], 50.00th=[ 3949], 60.00th=[ 4015], 00:32:56.750 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4555], 95.00th=[ 5014], 00:32:56.750 | 99.00th=[ 6128], 99.50th=[ 6325], 99.90th=[ 6849], 99.95th=[ 6980], 00:32:56.750 | 99.99th=[ 7504] 00:32:56.750 bw ( KiB/s): min=15360, max=16720, per=25.26%, avg=15802.67, stdev=430.81, samples=9 00:32:56.750 iops : min= 1920, max= 2090, avg=1975.33, stdev=53.85, samples=9 00:32:56.750 lat (usec) : 750=0.01%, 1000=0.03% 00:32:56.750 lat (msec) : 2=0.37%, 4=57.25%, 10=42.33% 00:32:56.750 cpu : usr=96.06%, sys=3.42%, ctx=6, majf=0, minf=9 00:32:56.750 IO depths : 1=0.2%, 2=12.8%, 4=59.1%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:56.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 issued rwts: total=9938,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:56.750 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:56.750 filename1: (groupid=0, jobs=1): err= 0: pid=1347689: Sun Oct 13 16:57:21 2024 00:32:56.750 read: IOPS=1951, BW=15.2MiB/s (16.0MB/s)(76.9MiB/5043msec) 00:32:56.750 slat (usec): min=4, max=181, avg=16.85, stdev= 8.80 00:32:56.750 clat (usec): min=863, max=42572, avg=4011.94, stdev=716.50 00:32:56.750 lat (usec): min=877, max=42584, avg=4028.79, stdev=716.27 00:32:56.750 clat percentiles (usec): 00:32:56.750 | 1.00th=[ 2540], 5.00th=[ 3195], 10.00th=[ 3392], 20.00th=[ 3687], 00:32:56.750 | 30.00th=[ 3818], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:32:56.750 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4621], 95.00th=[ 5080], 00:32:56.750 | 99.00th=[ 6194], 99.50th=[ 6521], 99.90th=[ 8029], 99.95th=[ 8094], 00:32:56.750 | 99.99th=[42730] 00:32:56.750 bw ( KiB/s): min=15008, max=16512, per=25.15%, avg=15734.30, stdev=443.53, samples=10 00:32:56.750 iops : min= 1876, max= 2064, avg=1966.70, stdev=55.49, samples=10 00:32:56.750 lat (usec) : 1000=0.01% 00:32:56.750 lat (msec) : 2=0.37%, 4=55.10%, 10=44.51%, 50=0.01% 00:32:56.750 cpu : usr=96.15%, sys=3.37%, ctx=6, majf=0, minf=9 00:32:56.750 IO depths : 1=0.2%, 2=13.3%, 4=58.9%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:56.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:56.750 issued rwts: total=9840,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:56.750 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:56.750 00:32:56.750 Run status group 0 (all jobs): 00:32:56.750 READ: bw=61.1MiB/s (64.1MB/s), 14.9MiB/s-15.7MiB/s (15.6MB/s-16.5MB/s), io=308MiB (323MB), run=5001-5043msec 00:32:56.750 16:57:21 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:56.750 16:57:21 -- target/dif.sh@43 -- # local sub 00:32:56.750 16:57:21 -- target/dif.sh@45 -- # for sub in "$@" 00:32:56.750 16:57:21 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:56.750 16:57:21 -- target/dif.sh@36 -- # local sub_id=0 00:32:56.750 16:57:21 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:56.750 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.750 16:57:21 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:56.750 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.750 16:57:21 -- target/dif.sh@45 -- # for sub in "$@" 00:32:56.750 16:57:21 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:56.750 16:57:21 -- target/dif.sh@36 -- # local sub_id=1 00:32:56.750 16:57:21 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:56.750 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.750 16:57:21 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:56.750 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.750 00:32:56.750 real 0m24.540s 00:32:56.750 user 4m38.660s 00:32:56.750 sys 0m4.753s 00:32:56.750 16:57:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 ************************************ 00:32:56.750 END TEST fio_dif_rand_params 00:32:56.750 ************************************ 00:32:56.750 16:57:21 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:56.750 16:57:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:56.750 16:57:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:56.750 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.750 ************************************ 00:32:56.750 START TEST fio_dif_digest 00:32:56.750 ************************************ 00:32:56.750 16:57:21 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:32:56.750 16:57:21 -- target/dif.sh@123 -- # local NULL_DIF 00:32:56.750 16:57:21 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:56.751 16:57:21 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:56.751 16:57:21 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:56.751 16:57:21 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:56.751 16:57:21 -- target/dif.sh@127 -- # numjobs=3 00:32:56.751 16:57:21 -- target/dif.sh@127 -- # iodepth=3 00:32:56.751 16:57:21 -- target/dif.sh@127 -- # runtime=10 00:32:56.751 16:57:21 -- target/dif.sh@128 -- # hdgst=true 00:32:56.751 16:57:21 -- target/dif.sh@128 -- # ddgst=true 00:32:56.751 16:57:21 -- target/dif.sh@130 -- # create_subsystems 0 00:32:56.751 16:57:21 -- target/dif.sh@28 -- # local sub 00:32:56.751 16:57:21 -- target/dif.sh@30 -- # for sub in "$@" 00:32:56.751 16:57:21 -- target/dif.sh@31 -- # create_subsystem 0 00:32:56.751 16:57:21 -- target/dif.sh@18 -- # local sub_id=0 00:32:56.751 16:57:21 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:56.751 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.751 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.751 bdev_null0 00:32:56.751 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.751 16:57:21 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:56.751 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.751 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.751 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.751 16:57:21 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:56.751 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.751 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.751 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.751 16:57:21 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:56.751 16:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:56.751 16:57:21 -- common/autotest_common.sh@10 -- # set +x 00:32:56.751 [2024-10-13 16:57:21.619202] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:56.751 16:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:56.751 16:57:21 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:56.751 16:57:21 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:56.751 16:57:21 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:56.751 16:57:21 -- nvmf/common.sh@520 -- # config=() 00:32:56.751 16:57:21 -- nvmf/common.sh@520 -- # local subsystem config 00:32:56.751 16:57:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:56.751 16:57:21 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:56.751 16:57:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:56.751 { 00:32:56.751 "params": { 00:32:56.751 "name": "Nvme$subsystem", 00:32:56.751 "trtype": "$TEST_TRANSPORT", 00:32:56.751 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:56.751 "adrfam": "ipv4", 00:32:56.751 "trsvcid": "$NVMF_PORT", 00:32:56.751 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:56.751 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:56.751 "hdgst": ${hdgst:-false}, 00:32:56.751 "ddgst": ${ddgst:-false} 00:32:56.751 }, 00:32:56.751 "method": "bdev_nvme_attach_controller" 00:32:56.751 } 00:32:56.751 EOF 00:32:56.751 )") 00:32:56.751 16:57:21 -- target/dif.sh@82 -- # gen_fio_conf 00:32:56.751 16:57:21 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:56.751 16:57:21 -- target/dif.sh@54 -- # local file 00:32:56.751 16:57:21 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:56.751 16:57:21 -- target/dif.sh@56 -- # cat 00:32:56.751 16:57:21 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:56.751 16:57:21 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:56.751 16:57:21 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:56.751 16:57:21 -- common/autotest_common.sh@1320 -- # shift 00:32:56.751 16:57:21 -- nvmf/common.sh@542 -- # cat 00:32:56.751 16:57:21 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:56.751 16:57:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:56.751 16:57:21 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:56.751 16:57:21 -- target/dif.sh@72 -- # (( file <= files )) 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:56.751 16:57:21 -- nvmf/common.sh@544 -- # jq . 00:32:56.751 16:57:21 -- nvmf/common.sh@545 -- # IFS=, 00:32:56.751 16:57:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:56.751 "params": { 00:32:56.751 "name": "Nvme0", 00:32:56.751 "trtype": "tcp", 00:32:56.751 "traddr": "10.0.0.2", 00:32:56.751 "adrfam": "ipv4", 00:32:56.751 "trsvcid": "4420", 00:32:56.751 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:56.751 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:56.751 "hdgst": true, 00:32:56.751 "ddgst": true 00:32:56.751 }, 00:32:56.751 "method": "bdev_nvme_attach_controller" 00:32:56.751 }' 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:56.751 16:57:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:56.751 16:57:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:56.751 16:57:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:56.751 16:57:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:56.751 16:57:21 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:56.751 16:57:21 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:56.751 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:56.751 ... 00:32:56.751 fio-3.35 00:32:56.751 Starting 3 threads 00:32:56.751 EAL: No free 2048 kB hugepages reported on node 1 00:32:57.009 [2024-10-13 16:57:22.451197] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:57.009 [2024-10-13 16:57:22.451249] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:09.204 00:33:09.204 filename0: (groupid=0, jobs=1): err= 0: pid=1348588: Sun Oct 13 16:57:32 2024 00:33:09.204 read: IOPS=203, BW=25.4MiB/s (26.6MB/s)(255MiB/10044msec) 00:33:09.204 slat (nsec): min=7400, max=36858, avg=13366.98, stdev=3315.72 00:33:09.204 clat (usec): min=11490, max=55292, avg=14726.12, stdev=2174.20 00:33:09.204 lat (usec): min=11503, max=55305, avg=14739.49, stdev=2174.61 00:33:09.204 clat percentiles (usec): 00:33:09.204 | 1.00th=[12387], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:33:09.204 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:33:09.204 | 70.00th=[15139], 80.00th=[15533], 90.00th=[15926], 95.00th=[16319], 00:33:09.204 | 99.00th=[17433], 99.50th=[18220], 99.90th=[54264], 99.95th=[54264], 00:33:09.204 | 99.99th=[55313] 00:33:09.204 bw ( KiB/s): min=23599, max=27392, per=33.13%, avg=26101.55, stdev=978.05, samples=20 00:33:09.204 iops : min= 184, max= 214, avg=203.90, stdev= 7.69, samples=20 00:33:09.204 lat (msec) : 20=99.76%, 50=0.05%, 100=0.20% 00:33:09.205 cpu : usr=92.87%, sys=6.64%, ctx=15, majf=0, minf=148 00:33:09.205 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:09.205 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 issued rwts: total=2041,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:09.205 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:09.205 filename0: (groupid=0, jobs=1): err= 0: pid=1348589: Sun Oct 13 16:57:32 2024 00:33:09.205 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(260MiB/10045msec) 00:33:09.205 slat (nsec): min=7222, max=36500, avg=13208.32, stdev=3094.45 00:33:09.205 clat (usec): min=9031, max=54223, avg=14471.00, stdev=1603.86 00:33:09.205 lat (usec): min=9047, max=54236, avg=14484.20, stdev=1603.87 00:33:09.205 clat percentiles (usec): 00:33:09.205 | 1.00th=[11731], 5.00th=[12649], 10.00th=[13173], 20.00th=[13566], 00:33:09.205 | 30.00th=[13960], 40.00th=[14091], 50.00th=[14484], 60.00th=[14746], 00:33:09.205 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15795], 95.00th=[16188], 00:33:09.205 | 99.00th=[17171], 99.50th=[17433], 99.90th=[20841], 99.95th=[50070], 00:33:09.205 | 99.99th=[54264] 00:33:09.205 bw ( KiB/s): min=25088, max=27904, per=33.71%, avg=26560.00, stdev=791.77, samples=20 00:33:09.205 iops : min= 196, max= 218, avg=207.50, stdev= 6.19, samples=20 00:33:09.205 lat (msec) : 10=0.39%, 20=99.47%, 50=0.10%, 100=0.05% 00:33:09.205 cpu : usr=92.82%, sys=6.68%, ctx=18, majf=0, minf=130 00:33:09.205 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:09.205 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 issued rwts: total=2077,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:09.205 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:09.205 filename0: (groupid=0, jobs=1): err= 0: pid=1348590: Sun Oct 13 16:57:32 2024 00:33:09.205 read: IOPS=205, BW=25.7MiB/s (26.9MB/s)(258MiB/10044msec) 00:33:09.205 slat (nsec): min=7629, max=61803, avg=13468.82, stdev=3379.77 00:33:09.205 clat (usec): min=8838, max=49769, avg=14554.75, stdev=1498.42 00:33:09.205 lat (usec): min=8852, max=49782, avg=14568.22, stdev=1498.47 00:33:09.205 clat percentiles (usec): 00:33:09.205 | 1.00th=[11994], 5.00th=[12780], 10.00th=[13173], 20.00th=[13698], 00:33:09.205 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:33:09.205 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:33:09.205 | 99.00th=[17171], 99.50th=[17695], 99.90th=[19006], 99.95th=[45351], 00:33:09.205 | 99.99th=[49546] 00:33:09.205 bw ( KiB/s): min=25344, max=27904, per=33.52%, avg=26406.40, stdev=739.51, samples=20 00:33:09.205 iops : min= 198, max= 218, avg=206.30, stdev= 5.78, samples=20 00:33:09.205 lat (msec) : 10=0.05%, 20=99.85%, 50=0.10% 00:33:09.205 cpu : usr=92.83%, sys=6.69%, ctx=24, majf=0, minf=102 00:33:09.205 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:09.205 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:09.205 issued rwts: total=2065,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:09.205 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:09.205 00:33:09.205 Run status group 0 (all jobs): 00:33:09.205 READ: bw=76.9MiB/s (80.7MB/s), 25.4MiB/s-25.8MiB/s (26.6MB/s-27.1MB/s), io=773MiB (810MB), run=10044-10045msec 00:33:09.205 16:57:32 -- target/dif.sh@132 -- # destroy_subsystems 0 00:33:09.205 16:57:32 -- target/dif.sh@43 -- # local sub 00:33:09.205 16:57:32 -- target/dif.sh@45 -- # for sub in "$@" 00:33:09.205 16:57:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:09.205 16:57:32 -- target/dif.sh@36 -- # local sub_id=0 00:33:09.205 16:57:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:09.205 16:57:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:09.205 16:57:32 -- common/autotest_common.sh@10 -- # set +x 00:33:09.205 16:57:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:09.205 16:57:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:09.205 16:57:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:09.205 16:57:32 -- common/autotest_common.sh@10 -- # set +x 00:33:09.205 16:57:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:09.205 00:33:09.205 real 0m11.338s 00:33:09.205 user 0m29.205s 00:33:09.205 sys 0m2.312s 00:33:09.205 16:57:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:09.205 16:57:32 -- common/autotest_common.sh@10 -- # set +x 00:33:09.205 ************************************ 00:33:09.205 END TEST fio_dif_digest 00:33:09.205 ************************************ 00:33:09.205 16:57:32 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:33:09.205 16:57:32 -- target/dif.sh@147 -- # nvmftestfini 00:33:09.205 16:57:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:09.205 16:57:32 -- nvmf/common.sh@116 -- # sync 00:33:09.205 16:57:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:09.205 16:57:32 -- nvmf/common.sh@119 -- # set +e 00:33:09.205 16:57:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:09.205 16:57:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:09.205 rmmod nvme_tcp 00:33:09.205 rmmod nvme_fabrics 00:33:09.205 rmmod nvme_keyring 00:33:09.205 16:57:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:09.205 16:57:33 -- nvmf/common.sh@123 -- # set -e 00:33:09.205 16:57:33 -- nvmf/common.sh@124 -- # return 0 00:33:09.205 16:57:33 -- nvmf/common.sh@477 -- # '[' -n 1341605 ']' 00:33:09.205 16:57:33 -- nvmf/common.sh@478 -- # killprocess 1341605 00:33:09.205 16:57:33 -- common/autotest_common.sh@926 -- # '[' -z 1341605 ']' 00:33:09.205 16:57:33 -- common/autotest_common.sh@930 -- # kill -0 1341605 00:33:09.205 16:57:33 -- common/autotest_common.sh@931 -- # uname 00:33:09.205 16:57:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:33:09.205 16:57:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1341605 00:33:09.205 16:57:33 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:33:09.205 16:57:33 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:33:09.205 16:57:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1341605' 00:33:09.205 killing process with pid 1341605 00:33:09.205 16:57:33 -- common/autotest_common.sh@945 -- # kill 1341605 00:33:09.205 16:57:33 -- common/autotest_common.sh@950 -- # wait 1341605 00:33:09.205 16:57:33 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:09.205 16:57:33 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:09.205 Waiting for block devices as requested 00:33:09.205 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:09.205 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:09.205 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:09.205 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:09.464 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:09.464 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:09.464 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:09.464 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:09.723 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:09.723 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:09.723 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:09.723 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:09.981 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:09.981 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:09.981 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:09.981 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:09.981 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:10.240 16:57:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:10.240 16:57:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:10.240 16:57:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:10.240 16:57:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:10.240 16:57:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:10.240 16:57:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:10.240 16:57:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:12.145 16:57:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:12.145 00:33:12.145 real 1m7.687s 00:33:12.145 user 6m37.203s 00:33:12.145 sys 0m15.715s 00:33:12.145 16:57:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:12.145 16:57:37 -- common/autotest_common.sh@10 -- # set +x 00:33:12.145 ************************************ 00:33:12.145 END TEST nvmf_dif 00:33:12.145 ************************************ 00:33:12.145 16:57:37 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:33:12.145 16:57:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:12.145 16:57:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:12.145 16:57:37 -- common/autotest_common.sh@10 -- # set +x 00:33:12.145 ************************************ 00:33:12.145 START TEST nvmf_abort_qd_sizes 00:33:12.145 ************************************ 00:33:12.145 16:57:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:33:12.404 * Looking for test storage... 00:33:12.404 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:33:12.404 16:57:37 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:33:12.404 16:57:37 -- nvmf/common.sh@7 -- # uname -s 00:33:12.404 16:57:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:12.404 16:57:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:12.404 16:57:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:12.404 16:57:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:12.404 16:57:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:12.404 16:57:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:12.404 16:57:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:12.404 16:57:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:12.404 16:57:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:12.404 16:57:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:12.404 16:57:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:33:12.404 16:57:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:33:12.404 16:57:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:12.404 16:57:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:12.404 16:57:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:12.404 16:57:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:12.404 16:57:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:12.404 16:57:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:12.404 16:57:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:12.404 16:57:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:12.404 16:57:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:12.404 16:57:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:12.404 16:57:37 -- paths/export.sh@5 -- # export PATH 00:33:12.404 16:57:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:12.404 16:57:37 -- nvmf/common.sh@46 -- # : 0 00:33:12.404 16:57:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:33:12.404 16:57:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:33:12.404 16:57:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:33:12.404 16:57:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:12.404 16:57:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:12.404 16:57:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:33:12.404 16:57:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:33:12.404 16:57:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:33:12.404 16:57:37 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:33:12.404 16:57:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:33:12.404 16:57:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:12.404 16:57:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:33:12.404 16:57:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:33:12.404 16:57:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:33:12.404 16:57:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:12.404 16:57:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:12.404 16:57:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:12.404 16:57:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:33:12.404 16:57:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:33:12.404 16:57:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:33:12.404 16:57:37 -- common/autotest_common.sh@10 -- # set +x 00:33:14.360 16:57:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:14.360 16:57:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:33:14.360 16:57:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:33:14.360 16:57:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:33:14.360 16:57:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:33:14.360 16:57:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:33:14.360 16:57:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:33:14.360 16:57:39 -- nvmf/common.sh@294 -- # net_devs=() 00:33:14.360 16:57:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:33:14.360 16:57:39 -- nvmf/common.sh@295 -- # e810=() 00:33:14.360 16:57:39 -- nvmf/common.sh@295 -- # local -ga e810 00:33:14.360 16:57:39 -- nvmf/common.sh@296 -- # x722=() 00:33:14.360 16:57:39 -- nvmf/common.sh@296 -- # local -ga x722 00:33:14.360 16:57:39 -- nvmf/common.sh@297 -- # mlx=() 00:33:14.360 16:57:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:33:14.360 16:57:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:14.360 16:57:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:33:14.360 16:57:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:33:14.360 16:57:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:33:14.360 16:57:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:14.360 16:57:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:33:14.360 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:33:14.360 16:57:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:14.360 16:57:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:33:14.360 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:33:14.360 16:57:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:33:14.360 16:57:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:33:14.360 16:57:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:14.360 16:57:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:14.360 16:57:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:14.360 16:57:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:14.361 16:57:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:33:14.361 Found net devices under 0000:0a:00.0: cvl_0_0 00:33:14.361 16:57:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:14.361 16:57:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:14.361 16:57:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:14.361 16:57:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:14.361 16:57:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:14.361 16:57:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:33:14.361 Found net devices under 0000:0a:00.1: cvl_0_1 00:33:14.361 16:57:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:14.361 16:57:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:33:14.361 16:57:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:33:14.361 16:57:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:33:14.361 16:57:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:33:14.361 16:57:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:33:14.361 16:57:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:33:14.361 16:57:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:33:14.361 16:57:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:33:14.361 16:57:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:33:14.361 16:57:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:33:14.361 16:57:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:33:14.361 16:57:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:33:14.361 16:57:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:33:14.361 16:57:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:33:14.361 16:57:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:33:14.361 16:57:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:33:14.361 16:57:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:33:14.361 16:57:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:33:14.361 16:57:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:33:14.361 16:57:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:33:14.361 16:57:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:33:14.361 16:57:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:33:14.619 16:57:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:33:14.619 16:57:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:33:14.619 16:57:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:33:14.619 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:33:14.619 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:33:14.619 00:33:14.619 --- 10.0.0.2 ping statistics --- 00:33:14.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:14.619 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:33:14.619 16:57:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:33:14.619 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:33:14.619 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:33:14.619 00:33:14.619 --- 10.0.0.1 ping statistics --- 00:33:14.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:14.619 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:33:14.619 16:57:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:33:14.619 16:57:39 -- nvmf/common.sh@410 -- # return 0 00:33:14.619 16:57:39 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:33:14.619 16:57:39 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:33:15.995 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:33:15.995 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:33:15.995 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:33:16.938 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:33:16.938 16:57:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:33:16.938 16:57:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:33:16.938 16:57:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:33:16.938 16:57:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:33:16.938 16:57:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:33:16.938 16:57:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:33:16.938 16:57:42 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:33:16.938 16:57:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:33:16.938 16:57:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:33:16.938 16:57:42 -- common/autotest_common.sh@10 -- # set +x 00:33:16.938 16:57:42 -- nvmf/common.sh@469 -- # nvmfpid=1353475 00:33:16.938 16:57:42 -- nvmf/common.sh@470 -- # waitforlisten 1353475 00:33:16.938 16:57:42 -- common/autotest_common.sh@819 -- # '[' -z 1353475 ']' 00:33:16.938 16:57:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:33:16.938 16:57:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:16.938 16:57:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:33:16.938 16:57:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:16.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:16.938 16:57:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:33:16.938 16:57:42 -- common/autotest_common.sh@10 -- # set +x 00:33:16.938 [2024-10-13 16:57:42.334129] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... 00:33:16.938 [2024-10-13 16:57:42.334208] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:16.938 EAL: No free 2048 kB hugepages reported on node 1 00:33:16.938 [2024-10-13 16:57:42.402292] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:17.196 [2024-10-13 16:57:42.492784] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:33:17.196 [2024-10-13 16:57:42.492970] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:17.196 [2024-10-13 16:57:42.493001] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:17.196 [2024-10-13 16:57:42.493023] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:17.196 [2024-10-13 16:57:42.493122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:17.196 [2024-10-13 16:57:42.493196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:17.196 [2024-10-13 16:57:42.493289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:17.196 [2024-10-13 16:57:42.493295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:18.129 16:57:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:33:18.129 16:57:43 -- common/autotest_common.sh@852 -- # return 0 00:33:18.129 16:57:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:33:18.129 16:57:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:33:18.129 16:57:43 -- common/autotest_common.sh@10 -- # set +x 00:33:18.129 16:57:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:33:18.129 16:57:43 -- scripts/common.sh@311 -- # local bdf bdfs 00:33:18.129 16:57:43 -- scripts/common.sh@312 -- # local nvmes 00:33:18.129 16:57:43 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:33:18.129 16:57:43 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:33:18.129 16:57:43 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:33:18.129 16:57:43 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:33:18.129 16:57:43 -- scripts/common.sh@322 -- # uname -s 00:33:18.129 16:57:43 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:33:18.129 16:57:43 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:33:18.129 16:57:43 -- scripts/common.sh@327 -- # (( 1 )) 00:33:18.129 16:57:43 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:33:18.129 16:57:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:18.129 16:57:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:18.129 16:57:43 -- common/autotest_common.sh@10 -- # set +x 00:33:18.129 ************************************ 00:33:18.129 START TEST spdk_target_abort 00:33:18.129 ************************************ 00:33:18.129 16:57:43 -- common/autotest_common.sh@1104 -- # spdk_target 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:18.129 16:57:43 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:33:18.129 16:57:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:18.129 16:57:43 -- common/autotest_common.sh@10 -- # set +x 00:33:20.654 spdk_targetn1 00:33:20.654 16:57:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:20.654 16:57:46 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:33:20.654 16:57:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:20.654 16:57:46 -- common/autotest_common.sh@10 -- # set +x 00:33:20.654 [2024-10-13 16:57:46.154423] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:33:20.912 16:57:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:33:20.912 16:57:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:20.912 16:57:46 -- common/autotest_common.sh@10 -- # set +x 00:33:20.912 16:57:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:33:20.912 16:57:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:20.912 16:57:46 -- common/autotest_common.sh@10 -- # set +x 00:33:20.912 16:57:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:33:20.912 16:57:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:20.912 16:57:46 -- common/autotest_common.sh@10 -- # set +x 00:33:20.912 [2024-10-13 16:57:46.186739] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:20.912 16:57:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:20.912 16:57:46 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:20.912 EAL: No free 2048 kB hugepages reported on node 1 00:33:24.190 Initializing NVMe Controllers 00:33:24.190 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:24.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:24.190 Initialization complete. Launching workers. 00:33:24.190 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11643, failed: 0 00:33:24.190 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1188, failed to submit 10455 00:33:24.190 success 686, unsuccess 502, failed 0 00:33:24.190 16:57:49 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:24.190 16:57:49 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:24.190 EAL: No free 2048 kB hugepages reported on node 1 00:33:27.468 [2024-10-13 16:57:52.617424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe0fb0 is same with the state(5) to be set 00:33:27.468 [2024-10-13 16:57:52.617481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe0fb0 is same with the state(5) to be set 00:33:27.468 [2024-10-13 16:57:52.617504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe0fb0 is same with the state(5) to be set 00:33:27.468 [2024-10-13 16:57:52.617526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe0fb0 is same with the state(5) to be set 00:33:27.468 [2024-10-13 16:57:52.617545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe0fb0 is same with the state(5) to be set 00:33:27.468 Initializing NVMe Controllers 00:33:27.468 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:27.468 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:27.468 Initialization complete. Launching workers. 00:33:27.468 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8575, failed: 0 00:33:27.468 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1186, failed to submit 7389 00:33:27.468 success 360, unsuccess 826, failed 0 00:33:27.468 16:57:52 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:27.468 16:57:52 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:27.468 EAL: No free 2048 kB hugepages reported on node 1 00:33:30.746 Initializing NVMe Controllers 00:33:30.746 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:30.746 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:30.746 Initialization complete. Launching workers. 00:33:30.746 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32508, failed: 0 00:33:30.746 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2861, failed to submit 29647 00:33:30.746 success 556, unsuccess 2305, failed 0 00:33:30.746 16:57:55 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:30.746 16:57:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:30.746 16:57:55 -- common/autotest_common.sh@10 -- # set +x 00:33:30.746 16:57:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:30.746 16:57:55 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:30.746 16:57:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:30.746 16:57:55 -- common/autotest_common.sh@10 -- # set +x 00:33:32.154 16:57:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:32.154 16:57:57 -- target/abort_qd_sizes.sh@62 -- # killprocess 1353475 00:33:32.154 16:57:57 -- common/autotest_common.sh@926 -- # '[' -z 1353475 ']' 00:33:32.154 16:57:57 -- common/autotest_common.sh@930 -- # kill -0 1353475 00:33:32.154 16:57:57 -- common/autotest_common.sh@931 -- # uname 00:33:32.154 16:57:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:33:32.154 16:57:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1353475 00:33:32.154 16:57:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:33:32.154 16:57:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:33:32.154 16:57:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1353475' 00:33:32.154 killing process with pid 1353475 00:33:32.154 16:57:57 -- common/autotest_common.sh@945 -- # kill 1353475 00:33:32.154 16:57:57 -- common/autotest_common.sh@950 -- # wait 1353475 00:33:32.154 00:33:32.154 real 0m14.265s 00:33:32.154 user 0m56.923s 00:33:32.154 sys 0m2.374s 00:33:32.154 16:57:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:32.154 16:57:57 -- common/autotest_common.sh@10 -- # set +x 00:33:32.154 ************************************ 00:33:32.154 END TEST spdk_target_abort 00:33:32.154 ************************************ 00:33:32.154 16:57:57 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:32.154 16:57:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:32.154 16:57:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:32.154 16:57:57 -- common/autotest_common.sh@10 -- # set +x 00:33:32.154 ************************************ 00:33:32.154 START TEST kernel_target_abort 00:33:32.154 ************************************ 00:33:32.154 16:57:57 -- common/autotest_common.sh@1104 -- # kernel_target 00:33:32.154 16:57:57 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:32.154 16:57:57 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:32.154 16:57:57 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:32.154 16:57:57 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:32.154 16:57:57 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:32.154 16:57:57 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:32.154 16:57:57 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:32.154 16:57:57 -- nvmf/common.sh@627 -- # local block nvme 00:33:32.154 16:57:57 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:32.154 16:57:57 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:32.154 16:57:57 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:32.154 16:57:57 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:33.528 Waiting for block devices as requested 00:33:33.528 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:33.528 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:33.528 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:33.528 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:33.787 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:33.787 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:33.787 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:33.787 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:33.787 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:34.045 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:34.045 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:34.045 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:34.303 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:34.303 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:34.303 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:34.303 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:34.561 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:34.561 16:57:59 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:34.561 16:57:59 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:34.561 16:57:59 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:34.561 16:57:59 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:34.561 16:57:59 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:34.561 No valid GPT data, bailing 00:33:34.561 16:57:59 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:34.561 16:57:59 -- scripts/common.sh@393 -- # pt= 00:33:34.561 16:57:59 -- scripts/common.sh@394 -- # return 1 00:33:34.561 16:57:59 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:34.561 16:57:59 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:34.561 16:57:59 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:34.561 16:57:59 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:34.561 16:57:59 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:34.561 16:57:59 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:34.561 16:57:59 -- nvmf/common.sh@654 -- # echo 1 00:33:34.561 16:57:59 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:34.561 16:57:59 -- nvmf/common.sh@656 -- # echo 1 00:33:34.561 16:57:59 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:34.561 16:57:59 -- nvmf/common.sh@663 -- # echo tcp 00:33:34.561 16:57:59 -- nvmf/common.sh@664 -- # echo 4420 00:33:34.561 16:57:59 -- nvmf/common.sh@665 -- # echo ipv4 00:33:34.561 16:57:59 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:34.561 16:58:00 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:33:34.819 00:33:34.819 Discovery Log Number of Records 2, Generation counter 2 00:33:34.819 =====Discovery Log Entry 0====== 00:33:34.819 trtype: tcp 00:33:34.819 adrfam: ipv4 00:33:34.819 subtype: current discovery subsystem 00:33:34.819 treq: not specified, sq flow control disable supported 00:33:34.819 portid: 1 00:33:34.819 trsvcid: 4420 00:33:34.819 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:34.819 traddr: 10.0.0.1 00:33:34.819 eflags: none 00:33:34.819 sectype: none 00:33:34.819 =====Discovery Log Entry 1====== 00:33:34.819 trtype: tcp 00:33:34.819 adrfam: ipv4 00:33:34.819 subtype: nvme subsystem 00:33:34.819 treq: not specified, sq flow control disable supported 00:33:34.819 portid: 1 00:33:34.819 trsvcid: 4420 00:33:34.819 subnqn: kernel_target 00:33:34.819 traddr: 10.0.0.1 00:33:34.819 eflags: none 00:33:34.819 sectype: none 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:34.819 16:58:00 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:34.819 EAL: No free 2048 kB hugepages reported on node 1 00:33:38.100 Initializing NVMe Controllers 00:33:38.100 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:38.100 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:38.100 Initialization complete. Launching workers. 00:33:38.100 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 46997, failed: 0 00:33:38.100 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 46997, failed to submit 0 00:33:38.100 success 0, unsuccess 46997, failed 0 00:33:38.100 16:58:03 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:38.100 16:58:03 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:38.100 EAL: No free 2048 kB hugepages reported on node 1 00:33:41.381 Initializing NVMe Controllers 00:33:41.381 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:41.381 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:41.381 Initialization complete. Launching workers. 00:33:41.381 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 87922, failed: 0 00:33:41.381 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 22178, failed to submit 65744 00:33:41.381 success 0, unsuccess 22178, failed 0 00:33:41.381 16:58:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:41.381 16:58:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:41.381 EAL: No free 2048 kB hugepages reported on node 1 00:33:44.661 Initializing NVMe Controllers 00:33:44.661 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:44.661 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:44.661 Initialization complete. Launching workers. 00:33:44.661 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 80713, failed: 0 00:33:44.661 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20146, failed to submit 60567 00:33:44.661 success 0, unsuccess 20146, failed 0 00:33:44.661 16:58:09 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:44.661 16:58:09 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:44.661 16:58:09 -- nvmf/common.sh@677 -- # echo 0 00:33:44.661 16:58:09 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:44.661 16:58:09 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:44.661 16:58:09 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:44.661 16:58:09 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:44.661 16:58:09 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:44.661 16:58:09 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:44.661 00:33:44.661 real 0m11.862s 00:33:44.661 user 0m5.909s 00:33:44.661 sys 0m2.309s 00:33:44.661 16:58:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:44.661 16:58:09 -- common/autotest_common.sh@10 -- # set +x 00:33:44.661 ************************************ 00:33:44.661 END TEST kernel_target_abort 00:33:44.661 ************************************ 00:33:44.661 16:58:09 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:44.661 16:58:09 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:44.661 16:58:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:44.661 16:58:09 -- nvmf/common.sh@116 -- # sync 00:33:44.661 16:58:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:44.661 16:58:09 -- nvmf/common.sh@119 -- # set +e 00:33:44.661 16:58:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:44.661 16:58:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:44.661 rmmod nvme_tcp 00:33:44.661 rmmod nvme_fabrics 00:33:44.661 rmmod nvme_keyring 00:33:44.661 16:58:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:44.661 16:58:09 -- nvmf/common.sh@123 -- # set -e 00:33:44.661 16:58:09 -- nvmf/common.sh@124 -- # return 0 00:33:44.661 16:58:09 -- nvmf/common.sh@477 -- # '[' -n 1353475 ']' 00:33:44.661 16:58:09 -- nvmf/common.sh@478 -- # killprocess 1353475 00:33:44.661 16:58:09 -- common/autotest_common.sh@926 -- # '[' -z 1353475 ']' 00:33:44.661 16:58:09 -- common/autotest_common.sh@930 -- # kill -0 1353475 00:33:44.661 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1353475) - No such process 00:33:44.661 16:58:09 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1353475 is not found' 00:33:44.661 Process with pid 1353475 is not found 00:33:44.661 16:58:09 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:44.661 16:58:09 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:45.227 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:45.227 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:45.227 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:45.227 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:45.227 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:45.227 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:45.227 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:45.227 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:45.227 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:45.485 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:45.485 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:45.485 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:45.485 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:45.485 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:45.485 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:45.485 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:45.485 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:45.485 16:58:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:45.485 16:58:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:45.485 16:58:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:45.485 16:58:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:45.485 16:58:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:45.485 16:58:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:45.485 16:58:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:48.017 16:58:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:48.017 00:33:48.017 real 0m35.310s 00:33:48.017 user 1m5.154s 00:33:48.017 sys 0m8.006s 00:33:48.017 16:58:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:48.017 16:58:12 -- common/autotest_common.sh@10 -- # set +x 00:33:48.017 ************************************ 00:33:48.017 END TEST nvmf_abort_qd_sizes 00:33:48.017 ************************************ 00:33:48.017 16:58:12 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:33:48.017 16:58:12 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:33:48.017 16:58:12 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:33:48.017 16:58:12 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:33:48.017 16:58:12 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:33:48.017 16:58:12 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:33:48.017 16:58:12 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:33:48.017 16:58:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:33:48.017 16:58:12 -- common/autotest_common.sh@10 -- # set +x 00:33:48.017 16:58:12 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:33:48.017 16:58:12 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:33:48.017 16:58:12 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:33:48.017 16:58:12 -- common/autotest_common.sh@10 -- # set +x 00:33:49.390 INFO: APP EXITING 00:33:49.390 INFO: killing all VMs 00:33:49.390 INFO: killing vhost app 00:33:49.390 INFO: EXIT DONE 00:33:50.762 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:50.762 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:50.762 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:50.762 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:50.762 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:50.762 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:50.762 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:50.762 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:50.762 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:50.762 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:50.762 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:50.762 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:50.762 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:50.762 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:50.762 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:50.762 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:50.762 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:52.137 Cleaning 00:33:52.137 Removing: /var/run/dpdk/spdk0/config 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:52.137 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:52.137 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:52.137 Removing: /var/run/dpdk/spdk1/config 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:52.137 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:52.137 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:52.137 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:52.137 Removing: /var/run/dpdk/spdk2/config 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:52.137 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:52.137 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:52.137 Removing: /var/run/dpdk/spdk3/config 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:52.137 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:52.137 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:52.137 Removing: /var/run/dpdk/spdk4/config 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:52.137 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:52.137 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:52.137 Removing: /dev/shm/bdev_svc_trace.1 00:33:52.137 Removing: /dev/shm/nvmf_trace.0 00:33:52.137 Removing: /dev/shm/spdk_tgt_trace.pid1075427 00:33:52.137 Removing: /var/run/dpdk/spdk0 00:33:52.137 Removing: /var/run/dpdk/spdk1 00:33:52.137 Removing: /var/run/dpdk/spdk2 00:33:52.137 Removing: /var/run/dpdk/spdk3 00:33:52.137 Removing: /var/run/dpdk/spdk4 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1073729 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1074483 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1075427 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1075909 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1077138 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1078078 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1078386 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1078588 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1078920 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1079182 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1079403 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1079557 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1079738 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1080199 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1082766 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1083057 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1083233 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1083375 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1083811 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1083951 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1084263 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1084403 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1084574 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1084715 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1084882 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1085021 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1085519 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1085678 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1085878 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086048 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086202 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086255 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086395 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086682 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086824 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1086983 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1087139 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1087403 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1087551 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1087704 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1087850 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088124 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088272 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088431 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088571 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088849 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1088998 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1089152 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1089296 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1089570 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1089716 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1089879 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090017 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090289 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090442 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090605 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090749 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1090953 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1091167 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1091331 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1091470 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1091675 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1091888 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092053 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092200 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092418 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092624 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092784 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1092936 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1093156 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1093374 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1093613 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1093817 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1094011 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1096443 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1152828 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1156082 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1163352 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1166699 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1169194 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1169610 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1173502 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1173504 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1174175 00:33:52.137 Removing: /var/run/dpdk/spdk_pid1174848 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1175407 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1175818 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1175946 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1176084 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1176224 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1176231 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1176909 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1177459 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1178134 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1178551 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1178554 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1178818 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1179883 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1180749 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1186856 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1187140 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1189820 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1193702 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1195940 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1202428 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1207834 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1209182 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1209868 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1220361 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1222709 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1226046 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1227261 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1228744 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1228905 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1229053 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1229328 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1229919 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1231294 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1232303 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1232757 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1236253 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1239839 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1243486 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1267876 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1270592 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1274559 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1275647 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1276770 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1279356 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1281887 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1286858 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1286867 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1289802 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1289940 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1290083 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1290357 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1290433 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1291609 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1292826 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1294048 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1295259 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1296475 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1297691 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1301694 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1302036 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1303358 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1304111 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1307901 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1310064 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1313785 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1317918 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1321428 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1321853 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1322279 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1322815 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1323397 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1323838 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1324392 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1324941 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1327605 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1327754 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1331611 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1331793 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1333549 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1338705 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1338719 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1341789 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1343228 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1344676 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1345550 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1347626 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1348403 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1353915 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1354319 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1354722 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1356205 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1356610 00:33:52.396 Removing: /var/run/dpdk/spdk_pid1357022 00:33:52.396 Clean 00:33:52.396 killing process with pid 1044957 00:34:02.379 killing process with pid 1044954 00:34:02.379 killing process with pid 1044956 00:34:02.379 killing process with pid 1044955 00:34:02.379 16:58:26 -- common/autotest_common.sh@1436 -- # return 0 00:34:02.379 16:58:26 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:34:02.379 16:58:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:34:02.379 16:58:26 -- common/autotest_common.sh@10 -- # set +x 00:34:02.379 16:58:26 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:34:02.379 16:58:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:34:02.379 16:58:26 -- common/autotest_common.sh@10 -- # set +x 00:34:02.379 16:58:26 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:02.379 16:58:26 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:34:02.379 16:58:26 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:34:02.379 16:58:26 -- spdk/autotest.sh@394 -- # hash lcov 00:34:02.379 16:58:26 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:34:02.379 16:58:26 -- spdk/autotest.sh@396 -- # hostname 00:34:02.379 16:58:26 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:34:02.379 geninfo: WARNING: invalid characters removed from testname! 00:34:34.475 16:58:54 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:34.475 16:58:58 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:35.860 16:59:01 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:39.148 16:59:04 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:41.682 16:59:06 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:44.224 16:59:09 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:47.509 16:59:12 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:47.509 16:59:12 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:47.509 16:59:12 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:47.509 16:59:12 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:47.509 16:59:12 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:47.509 16:59:12 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:47.509 16:59:12 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:47.509 16:59:12 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:47.509 16:59:12 -- paths/export.sh@5 -- $ export PATH 00:34:47.509 16:59:12 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:47.509 16:59:12 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:47.509 16:59:12 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:47.509 16:59:12 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1728831552.XXXXXX 00:34:47.509 16:59:12 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1728831552.1JvlWg 00:34:47.509 16:59:12 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:47.509 16:59:12 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:34:47.510 16:59:12 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:47.510 16:59:12 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:47.510 16:59:12 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:47.510 16:59:12 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:47.510 16:59:12 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:47.510 16:59:12 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:34:47.510 16:59:12 -- common/autotest_common.sh@10 -- $ set +x 00:34:47.510 16:59:12 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:47.510 16:59:12 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:47.510 16:59:12 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:47.510 16:59:12 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:47.510 16:59:12 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:47.510 16:59:12 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:47.510 16:59:12 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:47.510 16:59:12 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:47.510 16:59:12 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:47.510 16:59:12 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:47.510 16:59:12 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:47.510 + [[ -n 990197 ]] 00:34:47.510 + sudo kill 990197 00:34:47.519 [Pipeline] } 00:34:47.533 [Pipeline] // stage 00:34:47.538 [Pipeline] } 00:34:47.551 [Pipeline] // timeout 00:34:47.557 [Pipeline] } 00:34:47.569 [Pipeline] // catchError 00:34:47.574 [Pipeline] } 00:34:47.588 [Pipeline] // wrap 00:34:47.594 [Pipeline] } 00:34:47.606 [Pipeline] // catchError 00:34:47.627 [Pipeline] stage 00:34:47.631 [Pipeline] { (Epilogue) 00:34:47.643 [Pipeline] catchError 00:34:47.645 [Pipeline] { 00:34:47.657 [Pipeline] echo 00:34:47.658 Cleanup processes 00:34:47.664 [Pipeline] sh 00:34:47.949 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:47.949 1369395 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:47.963 [Pipeline] sh 00:34:48.239 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:48.239 ++ grep -v 'sudo pgrep' 00:34:48.239 ++ awk '{print $1}' 00:34:48.239 + sudo kill -9 00:34:48.239 + true 00:34:48.251 [Pipeline] sh 00:34:48.531 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:35:00.737 [Pipeline] sh 00:35:01.021 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:35:01.021 Artifacts sizes are good 00:35:01.035 [Pipeline] archiveArtifacts 00:35:01.042 Archiving artifacts 00:35:01.214 [Pipeline] sh 00:35:01.575 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:35:01.588 [Pipeline] cleanWs 00:35:01.597 [WS-CLEANUP] Deleting project workspace... 00:35:01.597 [WS-CLEANUP] Deferred wipeout is used... 00:35:01.604 [WS-CLEANUP] done 00:35:01.606 [Pipeline] } 00:35:01.624 [Pipeline] // catchError 00:35:01.636 [Pipeline] sh 00:35:01.915 + logger -p user.info -t JENKINS-CI 00:35:01.923 [Pipeline] } 00:35:01.936 [Pipeline] // stage 00:35:01.942 [Pipeline] } 00:35:01.956 [Pipeline] // node 00:35:01.961 [Pipeline] End of Pipeline 00:35:02.001 Finished: SUCCESS